-- Logs begin at Tue 2022-08-02 14:35:01 UTC, end at Tue 2022-08-02 15:52:59 UTC. -- Aug 02 15:14:32.445623 dv-cinder-850318-7-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Aug 02 15:14:32.456791 dv-cinder-850318-7-iscsi devstack@keystone.service[80347]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 02 15:14:32.458960 dv-cinder-850318-7-iscsi devstack@keystone.service[80347]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 2 15:14:32 2022] *** Aug 02 15:14:32.458960 dv-cinder-850318-7-iscsi devstack@keystone.service[80347]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 02 15:14:32.458960 dv-cinder-850318-7-iscsi devstack@keystone.service[80347]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 02 15:14:32.458960 dv-cinder-850318-7-iscsi devstack@keystone.service[80347]: nodename: dv-cinder-850318-7-iscsi Aug 02 15:14:32.458960 dv-cinder-850318-7-iscsi devstack@keystone.service[80347]: machine: x86_64 Aug 02 15:14:32.458960 dv-cinder-850318-7-iscsi devstack@keystone.service[80347]: clock source: unix Aug 02 15:14:32.458960 dv-cinder-850318-7-iscsi devstack@keystone.service[80347]: pcre jit disabled Aug 02 15:14:32.458960 dv-cinder-850318-7-iscsi devstack@keystone.service[80347]: detected number of CPU cores: 4 Aug 02 15:14:32.458960 dv-cinder-850318-7-iscsi devstack@keystone.service[80347]: current working directory: / Aug 02 15:14:32.458960 dv-cinder-850318-7-iscsi devstack@keystone.service[80347]: detected binary path: /usr/bin/uwsgi-core Aug 02 15:14:32.458960 dv-cinder-850318-7-iscsi devstack@keystone.service[80347]: your processes number limit is 47680 Aug 02 15:14:32.458960 dv-cinder-850318-7-iscsi devstack@keystone.service[80347]: your memory page size is 4096 bytes Aug 02 15:14:32.458960 dv-cinder-850318-7-iscsi devstack@keystone.service[80347]: detected max file descriptor number: 2048 Aug 02 15:14:32.458960 dv-cinder-850318-7-iscsi devstack@keystone.service[80347]: lock engine: pthread robust mutexes Aug 02 15:14:32.459702 dv-cinder-850318-7-iscsi devstack@keystone.service[80347]: thunder lock: enabled Aug 02 15:14:32.459702 dv-cinder-850318-7-iscsi devstack@keystone.service[80347]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 02 15:14:32.459702 dv-cinder-850318-7-iscsi devstack@keystone.service[80347]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 02 15:14:32.499345 dv-cinder-850318-7-iscsi devstack@keystone.service[80347]: Python main interpreter initialized at 0x55c64ab199c0 Aug 02 15:14:32.499345 dv-cinder-850318-7-iscsi devstack@keystone.service[80347]: python threads support enabled Aug 02 15:14:32.499345 dv-cinder-850318-7-iscsi devstack@keystone.service[80347]: your server socket listen backlog is limited to 100 connections Aug 02 15:14:32.499345 dv-cinder-850318-7-iscsi devstack@keystone.service[80347]: your mercy for graceful operations on workers is 90 seconds Aug 02 15:14:32.499737 dv-cinder-850318-7-iscsi devstack@keystone.service[80347]: mapped 403077 bytes (393 KB) for 2 cores Aug 02 15:14:32.499804 dv-cinder-850318-7-iscsi devstack@keystone.service[80347]: *** Operational MODE: preforking *** Aug 02 15:14:32.500085 dv-cinder-850318-7-iscsi devstack@keystone.service[80347]: *** uWSGI is running in multiple interpreter mode *** Aug 02 15:14:32.500085 dv-cinder-850318-7-iscsi devstack@keystone.service[80347]: spawned uWSGI master process (pid: 80347) Aug 02 15:14:32.500362 dv-cinder-850318-7-iscsi systemd[1]: Started Devstack devstack@keystone.service. Aug 02 15:14:32.500953 dv-cinder-850318-7-iscsi devstack@keystone.service[80347]: spawned uWSGI worker 1 (pid: 80359, cores: 1) Aug 02 15:14:32.502054 dv-cinder-850318-7-iscsi devstack@keystone.service[80347]: spawned uWSGI worker 2 (pid: 80360, cores: 1) Aug 02 15:14:32.502714 dv-cinder-850318-7-iscsi devstack@keystone.service[80347]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 02 15:14:38.159329 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 15:14:38.159329 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: from cryptography.utils import int_from_bytes Aug 02 15:14:38.159985 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 15:14:38.159985 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: from cryptography.utils import int_from_bytes Aug 02 15:14:38.161195 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 15:14:38.161195 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: from cryptography.utils import int_from_bytes Aug 02 15:14:38.161657 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 15:14:38.161657 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: from cryptography.utils import int_from_bytes Aug 02 15:14:38.217787 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 02 15:14:38.218014 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 02 15:14:38.218166 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] command line args: [] {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 02 15:14:38.218445 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 02 15:14:38.218623 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ================================================================================ {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 02 15:14:38.219006 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 02 15:14:38.219168 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] admin_token = **** {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.219280 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 02 15:14:38.219429 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] command line args: [] {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 02 15:14:38.219534 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] config_dir = [] {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.219639 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.219735 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 02 15:14:38.219815 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] config_source = [] {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.219892 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ================================================================================ {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 02 15:14:38.219995 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] debug = True {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.220127 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] admin_token = **** {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.220217 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.220453 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] config_dir = [] {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.220579 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.220656 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.220722 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.220779 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] config_source = [] {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.220911 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] debug = True {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.220997 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.221132 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.221241 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.221374 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.221460 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] list_limit = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.221570 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.221652 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] log_config_append = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.221773 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.221857 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.221978 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] log_dir = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.222062 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.222128 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] log_file = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.222264 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] list_limit = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.222349 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.222459 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] log_config_append = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.222594 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.222673 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.222785 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] log_dir = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.222865 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.222981 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] log_file = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.223099 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.223188 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.223282 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.223452 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.223585 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.223707 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.223830 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.223957 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.224074 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.224198 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.224320 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.224434 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.224556 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.224677 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.224797 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.224918 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.225039 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.225159 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.225282 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.225403 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.225523 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.225636 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.225759 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.225880 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.225880 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.226117 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.226237 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.226409 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.226539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] publish_errors = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.226660 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.226868 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.226986 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.227100 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.227241 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] publish_errors = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.227370 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.227491 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.227611 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.227724 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.227857 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.227979 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] standard_threads = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.227979 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.228192 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.228305 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.228471 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.228594 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.228715 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] standard_threads = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.228829 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] use_journal = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.228948 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.229063 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] use_json = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.229063 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] use_stderr = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.229291 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.229405 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] use_syslog = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.229519 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.229519 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] use_journal = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.229728 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.229849 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] use_json = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.229969 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.230084 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] use_stderr = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.230084 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] use_syslog = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.230300 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.230422 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 15:14:38.230539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.230651 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.230765 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.230883 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.230997 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.230997 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.231244 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.231361 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.231486 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.231602 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.231715 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.231839 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.231955 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.232069 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.232181 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.232295 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.232407 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.232527 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.232639 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.232758 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.232878 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.233004 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.233121 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.233246 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.233361 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.233488 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.233609 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.233729 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.233844 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.234041 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.234159 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.234272 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.234385 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.234498 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.234610 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.234733 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.234849 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.234961 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.235074 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.235198 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.235333 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.235460 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.235575 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.235688 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.235802 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.235915 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.236033 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.236156 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.236272 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.236391 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.236506 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.236620 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.236732 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.236854 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.236975 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.237090 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.237209 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.237322 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.237446 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.237563 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.237675 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.237842 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.237958 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.238076 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.238198 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.238312 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.238426 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.238538 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.238650 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.238763 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.238883 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.238998 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.239111 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.239282 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.239399 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.239513 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.239708 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.239826 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.239939 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.240059 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.240173 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.240287 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.240407 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.240521 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.240634 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.240746 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.240858 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.240970 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.241091 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.241211 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.241310 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.241422 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.241541 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.241655 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.241776 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.241904 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.242002 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.242096 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.242190 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.242284 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.242387 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.242486 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.242582 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.242677 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.242771 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.242896 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.243008 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.243108 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.243203 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.243344 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.243444 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.243539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.243644 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.243750 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.243852 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.243955 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.244053 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.244150 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.244260 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.244367 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.244475 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.244604 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.244724 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.244845 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.244968 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.245079 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.245195 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.245310 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.245433 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.245550 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.245654 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.245766 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.245889 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.245995 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.246107 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.246228 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.246344 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.246458 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.246562 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.246626 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.246740 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.246854 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.246974 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.247089 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.247263 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.247377 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.247502 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.247601 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.247716 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.247839 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.247954 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.248068 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.248187 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.248302 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.248417 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.248539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.248651 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.248765 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.248885 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.249000 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.249114 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.249238 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.249354 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.249469 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.249583 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.249687 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.249799 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.249921 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.250037 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.250151 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.250264 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.250379 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.250500 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.250693 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.250811 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.250925 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.251039 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.251160 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.251160 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.251413 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.251539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.251667 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.251791 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.251908 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.252022 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.252143 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.252259 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.252381 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.252497 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.252619 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.252735 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.252849 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.252963 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.253086 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.253201 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.253315 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.253430 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.253544 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.253544 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.253779 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.253897 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.254012 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.254012 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] auth.external = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.254226 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.254340 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.254447 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.254447 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.254664 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.254664 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.254884 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.255009 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] auth.password = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.255152 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] auth.external = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.255325 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] auth.token = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.255456 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.255574 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.255691 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.255808 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.255923 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.256047 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.256165 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] auth.password = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.256280 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.256396 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] auth.token = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.256511 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.256627 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.256738 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.256861 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.256979 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.257095 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.257211 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] credential.caching = True {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.257326 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.257461 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.258097 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.258216 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.258334 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.258449 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.258565 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.258688 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.258805 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] credential.caching = True {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.258921 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.259044 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.259161 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.259292 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.259422 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.259540 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.259655 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.259770 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.259770 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.259988 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.260112 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.260230 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.260345 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.260345 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.260568 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.260686 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.260686 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.260914 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.260914 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.261131 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.261131 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.261346 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.261469 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.261587 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.261701 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.261817 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] federation.caching = True {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.261817 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.262055 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.262055 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] federation.caching = True {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.262290 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.262395 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.262508 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.262623 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.262739 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.262866 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.262984 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.263101 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.263272 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.263391 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.263508 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.263670 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.263791 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.263937 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.264055 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.264055 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.264272 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.264396 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.264514 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.264714 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] identity.caching = True {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.264834 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.264960 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.265076 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.265273 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.265393 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] identity.caching = True {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.265509 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.265625 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.265740 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.265855 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.265979 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.266086 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.266201 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.266316 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.266431 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.266555 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.266672 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.266788 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.266904 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.267019 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.267135 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.267278 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.267403 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.267520 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.267636 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.267752 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.267868 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.267992 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.268109 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.268224 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.268340 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.268455 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.268570 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.268694 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.268811 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.268928 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.269043 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.269159 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.269276 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.269401 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.269519 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.269634 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.269751 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.269867 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.269983 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.270107 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.270224 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.270339 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.270455 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.270571 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.270687 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.270811 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.270929 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.271044 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.271160 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.271357 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.271479 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.271604 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.271723 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.271839 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.271954 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.272070 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.272185 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.272309 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.272427 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.272544 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.272660 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.272774 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.272890 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.273014 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.273268 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.273901 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.274018 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.274135 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.274251 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.274377 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.274495 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.274613 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.274728 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.274853 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.274970 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.275095 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.275231 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.275352 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.275468 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.275584 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.275701 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.275830 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.275949 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.276065 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.276171 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.276285 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.276401 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.276524 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.276642 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.276758 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.276874 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.276989 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.277105 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.277229 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.277346 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.277462 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.277580 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.user = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.277698 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.277815 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.277938 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.278056 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.278172 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.user = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.278287 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.278403 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.278518 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.278646 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.278766 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.278882 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.278998 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.279113 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.279261 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.279382 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.279498 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.279614 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.279730 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.279848 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.279972 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.280090 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.280206 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.280321 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.280438 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.280554 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.280677 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.280795 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.280913 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.281035 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.281152 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.281268 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.281268 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.281502 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.281620 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.281736 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.281736 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.281953 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.282076 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.282194 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.282194 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.282410 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.282410 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.282626 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.282750 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.282920 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.283044 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.283161 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.283315 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.283433 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.283433 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.283665 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.283665 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.283882 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.283882 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.284083 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.284083 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.284311 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.284427 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.284543 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.284658 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.284774 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.284896 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.285014 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.285130 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.285245 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.285361 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.285476 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.285599 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.285717 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.285833 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.285948 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.286070 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.286188 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.286312 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] resource.caching = True {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.286430 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.286545 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.286660 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.286781 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.286898 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] resource.caching = True {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.287023 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.287141 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.287278 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.287398 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.287514 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.287635 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.287763 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.288143 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.288260 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.288260 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.288477 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.288593 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.288813 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.288935 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] role.caching = True {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.289065 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.289183 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] role.driver = sql {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.289301 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.289417 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.289546 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.289665 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.289781 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] role.caching = True {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.289897 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.290013 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] role.driver = sql {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.290129 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.290252 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.290371 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.290487 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.290602 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.290718 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.290835 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.290960 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.291077 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.291193 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.291360 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.291477 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.291607 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.291726 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.291842 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.291957 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.292073 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.292189 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.292313 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.292432 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.292549 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.292665 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.292665 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.292882 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.293006 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.293124 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.293240 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.293356 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.293356 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.293574 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.293698 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.293816 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.293932 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.294048 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.294164 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.294280 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.294404 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.294523 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.294639 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.294755 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.294871 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.294987 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.295113 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.295245 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.295365 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.295482 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.295598 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.295714 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.295842 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.295960 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.296060 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.296174 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.296290 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.296406 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.296531 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.296650 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.296766 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.296881 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.296997 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.297121 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.297238 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] token.caching = True {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.297360 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.297478 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.297597 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.297715 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.297839 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.297957 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.298072 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] token.caching = True {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.298188 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.298304 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.298420 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.298543 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.298660 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.298784 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.298902 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.299018 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.299133 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.299338 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.299460 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.299576 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.299692 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.299809 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.299925 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.300048 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.300165 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.300280 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.300396 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.300512 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.300627 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.300750 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.300868 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.300984 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.301100 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.301215 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.301331 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.301455 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.301572 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] database.connection = **** {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.301696 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.301822 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.301939 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.302054 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.302170 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.302286 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.302409 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] database.connection = **** {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.302534 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.302658 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.302776 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.302892 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.303008 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.303123 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.303268 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.303389 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.303505 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.303621 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.303736 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.303851 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.303977 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.304095 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.304211 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.304334 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.304455 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.304571 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.304696 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.304814 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.304929 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.305046 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.305161 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.305277 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.305401 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.305401 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.305620 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.305735 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.305851 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.305966 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 02 15:14:38.306091 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.306091 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.306091 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.306091 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 15:14:38.306091 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 02 15:14:38.334925 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80360) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 15:14:38.335160 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80360) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 15:14:38.335418 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 15:14:38.335511 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80360) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 15:14:38.335589 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 15:14:38.335725 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 15:14:38.344689 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 15:14:38.348020 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80360) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 15:14:38.375407 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 15:14:38.375638 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 15:14:38.379299 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80360) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 15:14:38.379540 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80360) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 15:14:38.431393 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 15:14:38.431624 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80360) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 15:14:38.487504 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 15:14:38.487715 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 15:14:38.491439 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80360) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 15:14:38.491682 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80360) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 15:14:38.557918 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 15:14:38.558122 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 15:14:38.558348 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 15:14:38.558570 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 15:14:38.558790 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 15:14:38.559013 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 15:14:38.560602 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80360) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 15:14:38.560870 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80360) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 15:14:38.561099 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80360) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 15:14:38.561319 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80360) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 15:14:38.561534 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80360) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 15:14:38.561751 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80360) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 15:14:38.583325 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 15:14:38.583562 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 15:14:38.583671 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80360) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 15:14:38.583793 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 15:14:38.583878 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80360) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 15:14:38.584021 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 15:14:38.584103 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80360) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 15:14:38.584244 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 15:14:38.584328 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80360) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 15:14:38.584459 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 15:14:38.584541 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80360) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 15:14:38.584673 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 15:14:38.584754 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80360) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 15:14:38.584934 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80360) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 15:14:38.596683 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 15:14:38.597275 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80360) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 15:14:38.610427 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 15:14:38.610657 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 15:14:38.610847 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80360) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 15:14:38.610935 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 15:14:38.611089 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80360) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 15:14:38.611172 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 15:14:38.611327 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 15:14:38.611422 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80360) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 15:14:38.611542 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 15:14:38.611625 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80360) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 15:14:38.611757 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 15:14:38.611838 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80360) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 15:14:38.611974 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80360) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 15:14:38.612195 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80360) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 15:14:38.629200 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.629349 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.629482 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 02 15:14:38.629568 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 02 15:14:38.629744 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.629903 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.629990 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 02 15:14:38.630114 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 02 15:14:38.630193 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.630361 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.630454 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.630622 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.630704 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.630878 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.630959 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.631133 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.640647 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.640920 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.641002 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.641189 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.641271 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.641460 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.641543 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.641748 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.648917 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80359) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 15:14:38.649255 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80360) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 15:14:38.653709 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80359) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 15:14:38.653991 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.654078 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80360) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 15:14:38.654271 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.654352 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.654551 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.654635 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.654831 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.654912 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.655092 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.655182 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.655390 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.655474 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.655660 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.655739 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.655929 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.656019 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.656198 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.656278 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.656461 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.656539 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.656726 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.680685 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.680852 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.682235 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80359) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 15:14:38.682336 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80360) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 15:14:38.682469 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.682604 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.687122 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80359) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 15:14:38.687296 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80360) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 15:14:38.687427 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.687581 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.687710 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.687866 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.694361 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80359) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 15:14:38.694493 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80360) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 15:14:38.694641 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.694777 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.698831 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80359) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 15:14:38.699007 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80360) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 15:14:38.699135 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.699322 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.699450 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.699611 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.699731 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.699894 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.700039 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.700170 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.700293 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.700446 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.700564 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.700733 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.700837 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.701012 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.717331 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.717622 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.717720 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.717933 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.721583 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80359) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 15:14:38.721861 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80360) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 15:14:38.725034 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.725132 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.725330 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.725429 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.729895 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80359) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 15:14:38.730013 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80360) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 15:14:38.733165 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80360) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 15:14:38.733253 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80359) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 15:14:38.736339 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.736427 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.736638 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.736722 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.736931 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.737014 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.737221 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.737305 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.737500 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.737580 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.737782 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.737908 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.754384 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80359) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 15:14:38.754534 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80360) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 15:14:38.754672 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.754762 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.754918 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.755004 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.755178 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.755276 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.762195 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.762379 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.763761 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.763884 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.764038 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.764159 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.766851 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80359) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 15:14:38.767009 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80360) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 15:14:38.767131 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.767318 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.767457 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.767612 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.767741 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.767907 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.768026 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.768196 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.780040 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80359) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 15:14:38.780285 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80360) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 15:14:38.780377 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.780569 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.780655 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.780845 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.780935 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.781122 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.781202 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.781401 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.781481 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.781672 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.781754 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.781952 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.798115 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80359) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 15:14:38.798561 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80360) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 15:14:38.801111 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80359) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 15:14:38.801601 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80360) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 15:14:38.804105 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.805239 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.807186 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.807867 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.808864 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80359) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 15:14:38.809149 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.809366 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80360) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 15:14:38.809447 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.809686 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.809993 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.815912 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.816647 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.817496 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80359) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 15:14:38.818257 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80360) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 15:14:38.821013 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.821304 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.821583 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.821819 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.821903 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.822144 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.822429 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.822712 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.830203 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80359) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 15:14:38.830487 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.830773 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.830871 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80360) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 15:14:38.831110 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.831419 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.837850 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80359) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 15:14:38.838126 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.838411 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.838557 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80360) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 15:14:38.838689 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.838818 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.838946 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.839074 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.839239 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.839374 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.839514 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.839642 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.839769 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.839905 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.840044 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.840170 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.840306 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.840487 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.840654 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.840786 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.840915 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.841041 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.841183 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.841312 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.841439 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.841596 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.841725 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.841972 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 15:14:38.875282 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c64ab199c0 pid: 80359 (default app) Aug 02 15:14:38.876227 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c64ab199c0 pid: 80360 (default app) Aug 02 15:14:38.878615 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4ca18-44e3-44f2-abb9-a6dbdf0ec05a None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:14:38.878906 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4ca18-44e3-44f2-abb9-a6dbdf0ec05a None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:14:38.879181 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4ca18-44e3-44f2-abb9-a6dbdf0ec05a None None] PATH_INFO: `/v3` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:14:38.884426 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 791 bytes} [Tue Aug 2 15:14:38 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:14:46.630740 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3271e7-0e80-47a2-8884-982a89e369ca None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:14:46.631333 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3271e7-0e80-47a2-8884-982a89e369ca None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:14:46.631333 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3271e7-0e80-47a2-8884-982a89e369ca None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:14:46.635723 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1/2] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:14:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 15:14:46.641384 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f12bf3-08a1-4ac8-95b5-5f195be22f5b None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:14:46.641812 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f12bf3-08a1-4ac8-95b5-5f195be22f5b None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:14:46.641965 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f12bf3-08a1-4ac8-95b5-5f195be22f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:14:46.713816 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: INFO dbcounter [None req-a9f12bf3-08a1-4ac8-95b5-5f195be22f5b None None] Registered counter for database keystone Aug 02 15:14:46.733786 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG oslo_db.sqlalchemy.engines [None req-a9f12bf3-08a1-4ac8-95b5-5f195be22f5b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80359) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 15:14:46.741233 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writer thread running {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 15:14:46.936660 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG passlib.handlers.bcrypt [None req-a9f12bf3-08a1-4ac8-95b5-5f195be22f5b None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80359) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 02 15:14:46.937078 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG passlib.handlers.bcrypt [None req-a9f12bf3-08a1-4ac8-95b5-5f195be22f5b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80359) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 02 15:14:46.992377 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-a9f12bf3-08a1-4ac8-95b5-5f195be22f5b None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:14:46.994582 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-a9f12bf3-08a1-4ac8-95b5-5f195be22f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:14:47.125889 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 2/3] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:14:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 485 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 02 15:14:47.289963 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3271e7-0e80-47a2-8884-982a89e369ca None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:14:47.359566 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: INFO dbcounter [None req-8b3271e7-0e80-47a2-8884-982a89e369ca None None] Registered counter for database keystone Aug 02 15:14:47.381455 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG oslo_db.sqlalchemy.engines [None req-8b3271e7-0e80-47a2-8884-982a89e369ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80360) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 15:14:47.388263 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writer thread running {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 15:14:47.506337 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3271e7-0e80-47a2-8884-982a89e369ca None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:14:47.510786 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7246e89-83fc-4362-a82e-c79807c2eefa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:14:47.511417 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7246e89-83fc-4362-a82e-c79807c2eefa admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:14:47.511708 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7246e89-83fc-4362-a82e-c79807c2eefa admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:14:47.511988 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7246e89-83fc-4362-a82e-c79807c2eefa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:14:47.520179 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7246e89-83fc-4362-a82e-c79807c2eefa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:14:47.572896 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b7246e89-83fc-4362-a82e-c79807c2eefa admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 02 15:14:47.573164 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7246e89-83fc-4362-a82e-c79807c2eefa admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:14:47.583334 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 2/4] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Aug 2 15:14:47 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 15:14:47.589905 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f12bf3-08a1-4ac8-95b5-5f195be22f5b None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:14:47.604126 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f12bf3-08a1-4ac8-95b5-5f195be22f5b None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:14:47.608497 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1c62d1-ca96-48ed-bc29-2902a66b84a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:14:47.609646 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1c62d1-ca96-48ed-bc29-2902a66b84a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:14:47.609926 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1c62d1-ca96-48ed-bc29-2902a66b84a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:14:47.610203 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1c62d1-ca96-48ed-bc29-2902a66b84a5 admin admin] PATH_INFO: `/v3/projects/e01cd4e1a6a040d99206efa57fc6e2e1` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:14:47.611796 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1c62d1-ca96-48ed-bc29-2902a66b84a5 admin admin] RBAC: Authorizing `identity:get_project(project_id=e01cd4e1a6a040d99206efa57fc6e2e1)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:14:47.661804 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5d1c62d1-ca96-48ed-bc29-2902a66b84a5 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 02 15:14:47.662391 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1c62d1-ca96-48ed-bc29-2902a66b84a5 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:14:47.667026 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 3/5] 10.222.0.42 () {56 vars in 1207 bytes} [Tue Aug 2 15:14:47 2022] GET /identity/v3/projects/e01cd4e1a6a040d99206efa57fc6e2e1 => generated 344 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:14:49.682335 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd7553-5a51-454c-ac9d-ce4662b9fafc None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:14:49.682870 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd7553-5a51-454c-ac9d-ce4662b9fafc None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:14:49.682870 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd7553-5a51-454c-ac9d-ce4662b9fafc None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:14:49.686982 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 3/6] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:14:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:14:49.692538 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373456ba-ef8f-4210-96d3-ff29be25b47c None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:14:49.692981 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373456ba-ef8f-4210-96d3-ff29be25b47c None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:14:49.693098 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373456ba-ef8f-4210-96d3-ff29be25b47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:14:49.719378 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-373456ba-ef8f-4210-96d3-ff29be25b47c None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:14:49.721261 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-373456ba-ef8f-4210-96d3-ff29be25b47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:14:49.729778 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 4/7] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:14:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 02 15:14:49.751164 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bd7553-5a51-454c-ac9d-ce4662b9fafc None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:14:49.763808 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bd7553-5a51-454c-ac9d-ce4662b9fafc None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:14:49.767958 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f9d5b1-b284-43f5-af8d-a47048f5c87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:14:49.768574 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9d5b1-b284-43f5-af8d-a47048f5c87d admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:14:49.768856 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9d5b1-b284-43f5-af8d-a47048f5c87d admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:14:49.769130 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9d5b1-b284-43f5-af8d-a47048f5c87d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:14:49.781855 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f9d5b1-b284-43f5-af8d-a47048f5c87d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:14:49.783710 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f9d5b1-b284-43f5-af8d-a47048f5c87d admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:14:49.793589 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 4/8] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Aug 2 15:14:49 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 15:14:49.799403 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373456ba-ef8f-4210-96d3-ff29be25b47c None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:14:49.808612 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373456ba-ef8f-4210-96d3-ff29be25b47c None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:14:49.813026 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b9235-7ef9-4300-8811-33879fb66094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:14:49.813666 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b9235-7ef9-4300-8811-33879fb66094 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:14:49.813951 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b9235-7ef9-4300-8811-33879fb66094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:14:49.814230 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b9235-7ef9-4300-8811-33879fb66094 admin admin] PATH_INFO: `/v3/users/f4dc4eb9d79745cba683d968af36705d` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:14:49.815633 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2b9235-7ef9-4300-8811-33879fb66094 admin admin] RBAC: Authorizing `identity:get_user(user_id=f4dc4eb9d79745cba683d968af36705d)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:14:49.817483 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2b9235-7ef9-4300-8811-33879fb66094 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:14:49.819058 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 5/9] 10.222.0.42 () {56 vars in 1198 bytes} [Tue Aug 2 15:14:49 2022] GET /identity/v3/users/f4dc4eb9d79745cba683d968af36705d => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:14:51.964221 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d4a4a-25b1-43a5-86da-35e28447bf32 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:14:51.964770 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d4a4a-25b1-43a5-86da-35e28447bf32 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:14:51.964770 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d4a4a-25b1-43a5-86da-35e28447bf32 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:14:51.966514 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 5/10] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:14:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:14:51.971911 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474849a8-78f5-44b4-869f-db1ca0bdc15d None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:14:51.972340 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474849a8-78f5-44b4-869f-db1ca0bdc15d None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:14:51.972494 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474849a8-78f5-44b4-869f-db1ca0bdc15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:14:51.993111 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-474849a8-78f5-44b4-869f-db1ca0bdc15d None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:14:51.994348 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-474849a8-78f5-44b4-869f-db1ca0bdc15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:14:51.994776 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d639d-3d52-4818-b2e3-bf607b1b872f None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:14:51.995069 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d639d-3d52-4818-b2e3-bf607b1b872f None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:14:51.995395 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d639d-3d52-4818-b2e3-bf607b1b872f None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:14:51.996756 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 6/11] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:14:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:14:52.002036 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629f9bd-d0e2-48a2-b1d1-db0da28f2a5f None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:14:52.002325 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629f9bd-d0e2-48a2-b1d1-db0da28f2a5f None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:14:52.002611 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629f9bd-d0e2-48a2-b1d1-db0da28f2a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:14:52.046741 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG passlib.handlers.bcrypt [None req-a629f9bd-d0e2-48a2-b1d1-db0da28f2a5f None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80360) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 02 15:14:52.047178 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG passlib.handlers.bcrypt [None req-a629f9bd-d0e2-48a2-b1d1-db0da28f2a5f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80360) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 02 15:14:52.078040 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 6/12] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:14:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:14:52.092686 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-a629f9bd-d0e2-48a2-b1d1-db0da28f2a5f None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:14:52.094324 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-a629f9bd-d0e2-48a2-b1d1-db0da28f2a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:14:52.099703 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474849a8-78f5-44b4-869f-db1ca0bdc15d None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:14:52.125869 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:14:52.198673 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 7/13] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:14:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 15:14:52.212594 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474849a8-78f5-44b4-869f-db1ca0bdc15d None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:14:52.221966 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629f9bd-d0e2-48a2-b1d1-db0da28f2a5f None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:14:52.248652 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a6195-ec91-4cef-99f9-114fa46b569d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:14:52.249284 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a6195-ec91-4cef-99f9-114fa46b569d None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:14:52.249580 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a6195-ec91-4cef-99f9-114fa46b569d None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:14:52.249860 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a6195-ec91-4cef-99f9-114fa46b569d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:14:52.325056 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26a6195-ec91-4cef-99f9-114fa46b569d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:14:52.326583 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26a6195-ec91-4cef-99f9-114fa46b569d None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:14:52.326707 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629f9bd-d0e2-48a2-b1d1-db0da28f2a5f None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:14:52.329894 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:14:52.350820 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:14:52.365458 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9041435c-3049-4dfa-bca8-e525cc393a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:14:52.367089 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041435c-3049-4dfa-bca8-e525cc393a26 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:14:52.367410 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041435c-3049-4dfa-bca8-e525cc393a26 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:14:52.367686 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041435c-3049-4dfa-bca8-e525cc393a26 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:14:52.379848 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9041435c-3049-4dfa-bca8-e525cc393a26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:14:52.389302 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-9041435c-3049-4dfa-bca8-e525cc393a26 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 15:14:52.389302 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:14:52.389302 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:14:52.389302 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:14:52.389302 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:14:52.389302 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:14:52.389302 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:14:52.389302 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:14:52.389302 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:14:52.389302 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:14:52.389302 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:14:52.389302 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:14:52.389302 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:14:52.389302 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:14:52.389302 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:14:52.389302 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:14:52.390382 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:14:52.390382 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:14:52.390382 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:14:52.390382 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:14:52.390382 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:14:52.390382 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:14:52.390382 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:14:52.390382 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:14:52.390382 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:14:52.390382 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:14:52.390382 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:14:52.390382 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:14:52.390382 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:14:52.390382 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:14:52.390382 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:14:52.390382 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:14:52.391481 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:14:52.391481 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:14:52.391481 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:14:52.391481 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:14:52.391481 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:14:52.391481 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:14:52.391481 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:14:52.391481 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:14:52.391481 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:14:52.391481 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:14:52.391481 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 15:14:52.391481 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:14:52.391481 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 8/14] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 2 15:14:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:14:52.396413 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9041435c-3049-4dfa-bca8-e525cc393a26 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:14:52.429679 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 7/15] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 2 15:14:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 02 15:14:52.435802 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a6195-ec91-4cef-99f9-114fa46b569d None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:14:52.505145 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9041435c-3049-4dfa-bca8-e525cc393a26 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:14:52.536117 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a6195-ec91-4cef-99f9-114fa46b569d None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:14:52.539103 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed123e8-dbc4-454a-a7dd-962e570498c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:14:52.539765 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed123e8-dbc4-454a-a7dd-962e570498c1 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:14:52.540053 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed123e8-dbc4-454a-a7dd-962e570498c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:14:52.540334 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed123e8-dbc4-454a-a7dd-962e570498c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:14:52.541065 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed123e8-dbc4-454a-a7dd-962e570498c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:14:52.541368 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed123e8-dbc4-454a-a7dd-962e570498c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:14:52.542829 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed123e8-dbc4-454a-a7dd-962e570498c1 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:14:52.555957 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 9/16] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 2 15:14:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:14:52.561308 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:14:52.561729 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed123e8-dbc4-454a-a7dd-962e570498c1 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:14:52.572864 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34158f-fae7-4a1d-9448-3aa0fca4d861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:14:52.573516 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34158f-fae7-4a1d-9448-3aa0fca4d861 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:14:52.573793 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34158f-fae7-4a1d-9448-3aa0fca4d861 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:14:52.574067 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34158f-fae7-4a1d-9448-3aa0fca4d861 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:14:52.584521 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f34158f-fae7-4a1d-9448-3aa0fca4d861 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:14:52.586043 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f34158f-fae7-4a1d-9448-3aa0fca4d861 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:14:52.591128 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:14:52.605352 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-7f34158f-fae7-4a1d-9448-3aa0fca4d861 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:14:52.605352 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:14:52.605352 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:14:52.605352 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:14:52.605352 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:14:52.605352 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:14:52.605352 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:14:52.605352 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:14:52.605352 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:14:52.605352 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:14:52.605352 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:14:52.605352 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:14:52.605352 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:14:52.605352 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:14:52.605352 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:14:52.607407 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:14:52.607407 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:14:52.607407 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:14:52.607407 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:14:52.607407 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:14:52.607407 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:14:52.607407 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:14:52.607407 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:14:52.607407 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:14:52.607407 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:14:52.607407 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:14:52.607407 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:14:52.607407 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:14:52.607407 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:14:52.607407 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:14:52.607407 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:14:52.607407 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:14:52.608698 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:14:52.608698 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:14:52.608698 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:14:52.608698 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:14:52.608698 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 8/17] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:14:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 15:14:52.613091 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34158f-fae7-4a1d-9448-3aa0fca4d861 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:14:52.678086 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed123e8-dbc4-454a-a7dd-962e570498c1 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:14:52.714448 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572f1a4-f92e-4f0d-bb3c-c7cfa6a30790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:14:52.715126 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572f1a4-f92e-4f0d-bb3c-c7cfa6a30790 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:14:52.715459 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572f1a4-f92e-4f0d-bb3c-c7cfa6a30790 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:14:52.715718 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572f1a4-f92e-4f0d-bb3c-c7cfa6a30790 None admin] PATH_INFO: `/v3/users/f4dc4eb9d79745cba683d968af36705d` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:14:52.717425 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3572f1a4-f92e-4f0d-bb3c-c7cfa6a30790 None admin] RBAC: Authorizing `identity:get_user(user_id=f4dc4eb9d79745cba683d968af36705d)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:14:52.718943 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3572f1a4-f92e-4f0d-bb3c-c7cfa6a30790 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:14:52.720727 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 10/18] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 2 15:14:52 2022] GET /identity/v3/users/f4dc4eb9d79745cba683d968af36705d => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:14:52.726777 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572f1a4-f92e-4f0d-bb3c-c7cfa6a30790 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:14:52.829116 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:14:52.836811 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572f1a4-f92e-4f0d-bb3c-c7cfa6a30790 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:14:52.837750 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34158f-fae7-4a1d-9448-3aa0fca4d861 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:14:52.871512 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1edec2-fbea-4b83-a977-8316841fe92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:14:52.872169 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1edec2-fbea-4b83-a977-8316841fe92c None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:14:52.872448 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1edec2-fbea-4b83-a977-8316841fe92c None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:14:52.872726 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1edec2-fbea-4b83-a977-8316841fe92c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:14:52.873903 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1edec2-fbea-4b83-a977-8316841fe92c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:14:52.874168 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca18ee2-df8c-435f-bcfa-dbef98e86e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:14:52.874799 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca18ee2-df8c-435f-bcfa-dbef98e86e0d None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:14:52.875086 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca18ee2-df8c-435f-bcfa-dbef98e86e0d None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:14:52.875401 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca18ee2-df8c-435f-bcfa-dbef98e86e0d None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:14:52.875499 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1edec2-fbea-4b83-a977-8316841fe92c None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:14:52.876105 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca18ee2-df8c-435f-bcfa-dbef98e86e0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:14:52.876415 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca18ee2-df8c-435f-bcfa-dbef98e86e0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:14:52.877027 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 11/19] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:14:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:14:52.877837 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca18ee2-df8c-435f-bcfa-dbef98e86e0d None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:14:52.882778 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1edec2-fbea-4b83-a977-8316841fe92c None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:14:52.899311 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 9/20] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:14:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:14:52.995093 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1edec2-fbea-4b83-a977-8316841fe92c None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:14:53.032791 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35478a87-fe08-42ad-9cd5-ad7a9c79aec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:14:53.033436 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35478a87-fe08-42ad-9cd5-ad7a9c79aec6 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:14:53.033718 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35478a87-fe08-42ad-9cd5-ad7a9c79aec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:14:53.033998 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35478a87-fe08-42ad-9cd5-ad7a9c79aec6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:14:53.034827 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35478a87-fe08-42ad-9cd5-ad7a9c79aec6 None admin] RBAC: Adding query filter params (role.id=d75c9572cb294caeb8eb456521ff6f57, scope.domain.id=default, user.id=f4dc4eb9d79745cba683d968af36705d) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:14:53.035146 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35478a87-fe08-42ad-9cd5-ad7a9c79aec6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:14:53.036716 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35478a87-fe08-42ad-9cd5-ad7a9c79aec6 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:14:53.047406 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 12/21] 10.222.0.42 () {56 vars in 1322 bytes} [Tue Aug 2 15:14:52 2022] GET /identity/v3/role_assignments?user.id=f4dc4eb9d79745cba683d968af36705d&scope.domain.id=default&role.id=d75c9572cb294caeb8eb456521ff6f57 => generated 233 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:14:55.383674 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e3a96-bf47-40e1-8be3-46d1152fdba4 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:14:55.384180 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e3a96-bf47-40e1-8be3-46d1152fdba4 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:14:55.384295 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e3a96-bf47-40e1-8be3-46d1152fdba4 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:14:55.385582 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 10/22] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:14:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:14:55.400787 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd999895-1bb5-4eec-97d0-8e37af9c9478 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:14:55.401252 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd999895-1bb5-4eec-97d0-8e37af9c9478 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:14:55.401328 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd999895-1bb5-4eec-97d0-8e37af9c9478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:14:55.432348 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-bd999895-1bb5-4eec-97d0-8e37af9c9478 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:14:55.433500 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-bd999895-1bb5-4eec-97d0-8e37af9c9478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:14:55.456533 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:14:55.482809 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4957d74e-7257-49f3-8acb-4150bad407f9 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:14:55.483475 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4957d74e-7257-49f3-8acb-4150bad407f9 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:14:55.483954 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4957d74e-7257-49f3-8acb-4150bad407f9 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:14:55.485638 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 11/23] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:14:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:14:55.491354 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43251c04-b4b0-439f-a84a-c9e52e63b329 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:14:55.492482 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43251c04-b4b0-439f-a84a-c9e52e63b329 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:14:55.492968 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43251c04-b4b0-439f-a84a-c9e52e63b329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:14:55.531240 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 13/24] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:14:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:14:55.532689 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-43251c04-b4b0-439f-a84a-c9e52e63b329 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:14:55.534129 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-43251c04-b4b0-439f-a84a-c9e52e63b329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:14:55.564338 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd999895-1bb5-4eec-97d0-8e37af9c9478 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:14:55.588154 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:14:55.705237 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 12/25] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:14:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 15:14:55.738315 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43251c04-b4b0-439f-a84a-c9e52e63b329 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:14:55.742176 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd999895-1bb5-4eec-97d0-8e37af9c9478 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:14:55.792735 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd03bfb4-9366-4838-b68c-65a5864377d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:14:55.793709 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03bfb4-9366-4838-b68c-65a5864377d7 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:14:55.794139 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03bfb4-9366-4838-b68c-65a5864377d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:14:55.794554 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03bfb4-9366-4838-b68c-65a5864377d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:14:55.832653 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd03bfb4-9366-4838-b68c-65a5864377d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:14:55.834449 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd03bfb4-9366-4838-b68c-65a5864377d7 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:14:55.867647 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-bd03bfb4-9366-4838-b68c-65a5864377d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:14:55.867647 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:14:55.867647 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:14:55.867647 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:14:55.867647 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:14:55.867647 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:14:55.867647 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:14:55.867647 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:14:55.867647 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:14:55.867647 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:14:55.867647 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:14:55.867647 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:14:55.867647 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:14:55.867647 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:14:55.867647 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:14:55.868671 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:14:55.868671 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:14:55.868671 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:14:55.868671 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:14:55.868671 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:14:55.868671 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:14:55.868671 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:14:55.868671 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:14:55.868671 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:14:55.868671 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:14:55.868671 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:14:55.868671 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:14:55.868671 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:14:55.868671 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:14:55.868671 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:14:55.868671 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:14:55.868671 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:14:55.869676 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:14:55.869676 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:14:55.869676 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:14:55.869676 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:14:55.871647 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 14/26] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:14:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:14:55.877281 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd03bfb4-9366-4838-b68c-65a5864377d7 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:14:55.898679 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:14:55.989188 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43251c04-b4b0-439f-a84a-c9e52e63b329 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:14:56.026781 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac86c06-802f-4b64-be8e-502471f2c4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:14:56.027885 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac86c06-802f-4b64-be8e-502471f2c4b5 None admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:14:56.028314 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac86c06-802f-4b64-be8e-502471f2c4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:14:56.028733 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac86c06-802f-4b64-be8e-502471f2c4b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:14:56.029628 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac86c06-802f-4b64-be8e-502471f2c4b5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:14:56.031384 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac86c06-802f-4b64-be8e-502471f2c4b5 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:14:56.169669 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd03bfb4-9366-4838-b68c-65a5864377d7 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:14:56.188620 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 13/27] 10.222.0.42 () {60 vars in 1131 bytes} [Tue Aug 2 15:14:55 2022] POST /identity/v3/roles => generated 219 bytes in 451 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 15:14:56.190536 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a88521d-6bcd-4449-8128-f8816e0435c0 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:14:56.191075 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a88521d-6bcd-4449-8128-f8816e0435c0 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:14:56.191681 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a88521d-6bcd-4449-8128-f8816e0435c0 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:14:56.197619 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 14/28] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:14:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:14:56.199701 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76034b3-33b1-4dbf-902b-e3a09016a846 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:14:56.200194 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76034b3-33b1-4dbf-902b-e3a09016a846 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:14:56.200649 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76034b3-33b1-4dbf-902b-e3a09016a846 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:14:56.202366 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 15/29] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:14:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:14:56.204199 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee8826-f167-49e9-bae1-8e8bbef7e161 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:14:56.204697 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee8826-f167-49e9-bae1-8e8bbef7e161 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:14:56.205168 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee8826-f167-49e9-bae1-8e8bbef7e161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:14:56.227571 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-e7ee8826-f167-49e9-bae1-8e8bbef7e161 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:14:56.229613 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-e7ee8826-f167-49e9-bae1-8e8bbef7e161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:14:56.234517 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63302f9-535d-440c-918a-d754c4ee2d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:14:56.235162 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63302f9-535d-440c-918a-d754c4ee2d6e None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:14:56.235478 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63302f9-535d-440c-918a-d754c4ee2d6e None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:14:56.235755 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63302f9-535d-440c-918a-d754c4ee2d6e None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:14:56.236465 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63302f9-535d-440c-918a-d754c4ee2d6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:14:56.236773 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63302f9-535d-440c-918a-d754c4ee2d6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:14:56.238174 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63302f9-535d-440c-918a-d754c4ee2d6e None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:14:56.265965 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:14:56.282501 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 15/30] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:14:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:14:56.284458 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cae476-f97f-44f5-bd90-2b69ffbebb1c None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:14:56.285296 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cae476-f97f-44f5-bd90-2b69ffbebb1c None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:14:56.286367 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cae476-f97f-44f5-bd90-2b69ffbebb1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:14:56.309262 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-09cae476-f97f-44f5-bd90-2b69ffbebb1c None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:14:56.311298 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-09cae476-f97f-44f5-bd90-2b69ffbebb1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:14:56.392998 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 16/31] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:14:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 15:14:56.394730 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee8826-f167-49e9-bae1-8e8bbef7e161 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:14:56.426663 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:14:56.436734 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 16/32] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:14:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:14:56.438116 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cae476-f97f-44f5-bd90-2b69ffbebb1c None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:14:56.574099 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee8826-f167-49e9-bae1-8e8bbef7e161 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:14:56.593906 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cae476-f97f-44f5-bd90-2b69ffbebb1c None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:14:56.644691 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2f80d7-9777-463d-b9d4-0d6e5f59b589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:14:56.645346 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f80d7-9777-463d-b9d4-0d6e5f59b589 None admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:14:56.645639 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f80d7-9777-463d-b9d4-0d6e5f59b589 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:14:56.645919 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f80d7-9777-463d-b9d4-0d6e5f59b589 None admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:14:56.646622 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2f80d7-9777-463d-b9d4-0d6e5f59b589 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:14:56.648494 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2f80d7-9777-463d-b9d4-0d6e5f59b589 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:14:56.649220 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0f7f59-ec36-4c32-8017-1aa8fe23eea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:14:56.650111 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f7f59-ec36-4c32-8017-1aa8fe23eea8 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:14:56.650598 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f7f59-ec36-4c32-8017-1aa8fe23eea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:14:56.651081 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f7f59-ec36-4c32-8017-1aa8fe23eea8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:14:56.668165 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0f7f59-ec36-4c32-8017-1aa8fe23eea8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:14:56.676047 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-8d0f7f59-ec36-4c32-8017-1aa8fe23eea8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 15:14:56.676047 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:14:56.676047 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:14:56.676047 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:14:56.676047 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:14:56.676047 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:14:56.676047 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:14:56.676047 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:14:56.676047 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:14:56.676047 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:14:56.676047 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:14:56.676047 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:14:56.676047 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:14:56.676047 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:14:56.676047 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:14:56.676047 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:14:56.676912 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:14:56.676912 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:14:56.676912 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:14:56.676912 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:14:56.676912 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:14:56.676912 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:14:56.676912 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:14:56.676912 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:14:56.676912 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:14:56.676912 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:14:56.676912 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:14:56.676912 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:14:56.676912 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:14:56.676912 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:14:56.676912 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:14:56.676912 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:14:56.677638 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:14:56.677638 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:14:56.677638 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:14:56.677638 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:14:56.677638 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:14:56.677638 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:14:56.677638 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:14:56.677638 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:14:56.677638 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:14:56.677638 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:14:56.677638 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 15:14:56.677638 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:14:56.681263 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 17/33] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 2 15:14:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:14:56.682330 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0f7f59-ec36-4c32-8017-1aa8fe23eea8 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:14:56.684782 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 17/34] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Aug 2 15:14:56 2022] POST /identity/v3/projects => generated 301 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:14:56.687114 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2f80d7-9777-463d-b9d4-0d6e5f59b589 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:14:56.699823 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:14:56.807721 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:14:56.825558 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2f80d7-9777-463d-b9d4-0d6e5f59b589 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:14:56.859191 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0f7f59-ec36-4c32-8017-1aa8fe23eea8 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:14:56.869486 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8083b05f-024b-4dce-89d6-4362d4d14475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:14:56.870135 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8083b05f-024b-4dce-89d6-4362d4d14475 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:14:56.870545 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8083b05f-024b-4dce-89d6-4362d4d14475 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:14:56.870823 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8083b05f-024b-4dce-89d6-4362d4d14475 None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:14:56.871744 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8083b05f-024b-4dce-89d6-4362d4d14475 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:14:56.872282 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8083b05f-024b-4dce-89d6-4362d4d14475 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:14:56.873848 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8083b05f-024b-4dce-89d6-4362d4d14475 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:14:56.888334 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 18/35] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 2 15:14:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:14:56.889988 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc7b6d-1699-48e8-b4fc-f950956dea53 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:14:56.890271 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc7b6d-1699-48e8-b4fc-f950956dea53 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:14:56.890552 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc7b6d-1699-48e8-b4fc-f950956dea53 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:14:56.891827 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 19/36] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:14:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:14:56.893003 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a11b4a-061f-4ba8-982d-b672517d7824 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:14:56.893440 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a11b4a-061f-4ba8-982d-b672517d7824 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:14:56.893862 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a11b4a-061f-4ba8-982d-b672517d7824 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:14:56.899666 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 20/37] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:14:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:14:56.901405 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a0031-10f6-4ef6-9dbe-daf22b1f88e7 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:14:56.901885 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a0031-10f6-4ef6-9dbe-daf22b1f88e7 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:14:56.902349 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a0031-10f6-4ef6-9dbe-daf22b1f88e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:14:56.907048 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffc21af-4c44-476e-ae86-bdc7599a0bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:14:56.908747 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc21af-4c44-476e-ae86-bdc7599a0bfe None admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:14:56.908975 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc21af-4c44-476e-ae86-bdc7599a0bfe None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:14:56.909250 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc21af-4c44-476e-ae86-bdc7599a0bfe None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:14:56.909982 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffc21af-4c44-476e-ae86-bdc7599a0bfe None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:14:56.911858 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffc21af-4c44-476e-ae86-bdc7599a0bfe None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:14:56.924810 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-298a0031-10f6-4ef6-9dbe-daf22b1f88e7 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:14:56.926012 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-298a0031-10f6-4ef6-9dbe-daf22b1f88e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:14:56.993816 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:14:57.000168 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 21/38] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:14:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:14:57.001024 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a0031-10f6-4ef6-9dbe-daf22b1f88e7 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:14:57.037869 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 18/39] 10.222.0.42 () {60 vars in 1131 bytes} [Tue Aug 2 15:14:56 2022] POST /identity/v3/roles => generated 225 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:14:57.042869 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b6024-e4bb-4c9a-86bb-cb3526d71f89 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:14:57.042869 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b6024-e4bb-4c9a-86bb-cb3526d71f89 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:14:57.042869 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b6024-e4bb-4c9a-86bb-cb3526d71f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:14:57.061988 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-278b6024-e4bb-4c9a-86bb-cb3526d71f89 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:14:57.063650 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-278b6024-e4bb-4c9a-86bb-cb3526d71f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:14:57.120949 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a0031-10f6-4ef6-9dbe-daf22b1f88e7 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:14:57.145573 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 19/40] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:14:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:14:57.146472 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278b6024-e4bb-4c9a-86bb-cb3526d71f89 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:14:57.175719 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce95d24-9f88-4853-b77e-b1156d694aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:14:57.176516 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce95d24-9f88-4853-b77e-b1156d694aee None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:14:57.176831 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce95d24-9f88-4853-b77e-b1156d694aee None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:14:57.177466 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce95d24-9f88-4853-b77e-b1156d694aee None admin] PATH_INFO: `/v3/users/f4dc4eb9d79745cba683d968af36705d` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:14:57.178487 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce95d24-9f88-4853-b77e-b1156d694aee None admin] RBAC: Authorizing `identity:get_user(user_id=f4dc4eb9d79745cba683d968af36705d)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:14:57.180638 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce95d24-9f88-4853-b77e-b1156d694aee None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:14:57.182574 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 22/41] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 2 15:14:57 2022] GET /identity/v3/users/f4dc4eb9d79745cba683d968af36705d => generated 247 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:14:57.183252 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce95d24-9f88-4853-b77e-b1156d694aee None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:14:57.222215 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:14:57.264764 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:14:57.283442 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278b6024-e4bb-4c9a-86bb-cb3526d71f89 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:14:57.302287 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce95d24-9f88-4853-b77e-b1156d694aee None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:14:57.318560 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00141d88-0963-497a-b4f1-71c126817362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:14:57.319236 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00141d88-0963-497a-b4f1-71c126817362 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:14:57.319572 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00141d88-0963-497a-b4f1-71c126817362 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:14:57.319856 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00141d88-0963-497a-b4f1-71c126817362 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:14:57.321021 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00141d88-0963-497a-b4f1-71c126817362 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:14:57.322599 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00141d88-0963-497a-b4f1-71c126817362 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:14:57.328818 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 20/42] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:14:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:14:57.328818 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00141d88-0963-497a-b4f1-71c126817362 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:14:57.340163 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17bdf27-6f9c-4c7e-b6bc-1d5a673cd41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:14:57.340801 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17bdf27-6f9c-4c7e-b6bc-1d5a673cd41f None admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:14:57.341090 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17bdf27-6f9c-4c7e-b6bc-1d5a673cd41f None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:14:57.341369 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17bdf27-6f9c-4c7e-b6bc-1d5a673cd41f None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:14:57.342089 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17bdf27-6f9c-4c7e-b6bc-1d5a673cd41f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:14:57.343521 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17bdf27-6f9c-4c7e-b6bc-1d5a673cd41f None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:14:57.359325 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 23/43] 10.222.0.42 () {60 vars in 1131 bytes} [Tue Aug 2 15:14:57 2022] POST /identity/v3/roles => generated 223 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:14:57.359325 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17bdf27-6f9c-4c7e-b6bc-1d5a673cd41f None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:14:57.448184 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00141d88-0963-497a-b4f1-71c126817362 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:14:57.468323 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:14:57.473841 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17bdf27-6f9c-4c7e-b6bc-1d5a673cd41f None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:14:57.493783 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b89154d-59ee-44da-99db-660b81c4b57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:14:57.494448 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89154d-59ee-44da-99db-660b81c4b57f None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:14:57.494737 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89154d-59ee-44da-99db-660b81c4b57f None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:14:57.495018 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89154d-59ee-44da-99db-660b81c4b57f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:14:57.496279 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b89154d-59ee-44da-99db-660b81c4b57f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:14:57.497780 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b89154d-59ee-44da-99db-660b81c4b57f None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:14:57.499677 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 21/44] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:14:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:14:57.505299 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b89154d-59ee-44da-99db-660b81c4b57f None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:14:57.508417 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:14:57.523394 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46f9b85-b1e3-4240-901b-f6fcb3e5eb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:14:57.523967 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f9b85-b1e3-4240-901b-f6fcb3e5eb36 None admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:14:57.524257 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f9b85-b1e3-4240-901b-f6fcb3e5eb36 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:14:57.524537 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f9b85-b1e3-4240-901b-f6fcb3e5eb36 None admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:14:57.525233 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46f9b85-b1e3-4240-901b-f6fcb3e5eb36 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:14:57.526701 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46f9b85-b1e3-4240-901b-f6fcb3e5eb36 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:14:57.561664 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 24/45] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Aug 2 15:14:57 2022] POST /identity/v3/projects => generated 312 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:14:57.654915 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b89154d-59ee-44da-99db-660b81c4b57f None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:14:57.692342 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363ef9eb-d314-459e-8965-0930298f6c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:14:57.693037 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ef9eb-d314-459e-8965-0930298f6c29 None admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:14:57.693326 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ef9eb-d314-459e-8965-0930298f6c29 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:14:57.693609 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ef9eb-d314-459e-8965-0930298f6c29 None admin] PATH_INFO: `/v3/domains/default/users/f4dc4eb9d79745cba683d968af36705d/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:14:57.696362 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363ef9eb-d314-459e-8965-0930298f6c29 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=f4dc4eb9d79745cba683d968af36705d, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:14:57.697839 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363ef9eb-d314-459e-8965-0930298f6c29 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:14:57.713536 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 22/46] 10.222.0.42 () {58 vars in 1361 bytes} [Tue Aug 2 15:14:57 2022] PUT /identity/v3/domains/default/users/f4dc4eb9d79745cba683d968af36705d/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:14:59.595958 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2d1fb-ea80-442e-b7c7-f75013a4f131 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:14:59.596480 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2d1fb-ea80-442e-b7c7-f75013a4f131 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:14:59.596563 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2d1fb-ea80-442e-b7c7-f75013a4f131 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:14:59.597982 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 25/47] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:14:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:14:59.604068 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172a8df-d1bd-42e3-ad2d-eb387c755504 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:14:59.604463 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172a8df-d1bd-42e3-ad2d-eb387c755504 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:14:59.604757 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172a8df-d1bd-42e3-ad2d-eb387c755504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:14:59.623981 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-5172a8df-d1bd-42e3-ad2d-eb387c755504 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:14:59.625208 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-5172a8df-d1bd-42e3-ad2d-eb387c755504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:14:59.670672 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:14:59.700769 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 23/48] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:14:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:14:59.721565 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8587d8-685f-44f0-9687-198b4a26df4d None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:14:59.721855 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8587d8-685f-44f0-9687-198b4a26df4d None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:14:59.722302 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8587d8-685f-44f0-9687-198b4a26df4d None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:14:59.723682 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 26/49] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:14:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:14:59.723801 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5172a8df-d1bd-42e3-ad2d-eb387c755504 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:14:59.729457 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca3c0d-6d2c-4b30-bd3e-1406bf514906 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:14:59.729744 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca3c0d-6d2c-4b30-bd3e-1406bf514906 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:14:59.730024 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca3c0d-6d2c-4b30-bd3e-1406bf514906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:14:59.749105 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-f7ca3c0d-6d2c-4b30-bd3e-1406bf514906 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:14:59.750336 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-f7ca3c0d-6d2c-4b30-bd3e-1406bf514906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:14:59.821615 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 27/50] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:14:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 15:14:59.828417 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5172a8df-d1bd-42e3-ad2d-eb387c755504 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:14:59.844912 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca3c0d-6d2c-4b30-bd3e-1406bf514906 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:14:59.861457 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5459d2-e287-4c4a-9a83-effde684515f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:14:59.862024 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5459d2-e287-4c4a-9a83-effde684515f None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:14:59.862308 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5459d2-e287-4c4a-9a83-effde684515f None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:14:59.862587 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5459d2-e287-4c4a-9a83-effde684515f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:14:59.863767 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5459d2-e287-4c4a-9a83-effde684515f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:14:59.865222 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5459d2-e287-4c4a-9a83-effde684515f None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:14:59.871445 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 24/51] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:14:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:14:59.872798 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5459d2-e287-4c4a-9a83-effde684515f None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:14:59.917351 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:14:59.951971 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca3c0d-6d2c-4b30-bd3e-1406bf514906 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:14:59.963949 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:14:59.977892 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5459d2-e287-4c4a-9a83-effde684515f None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:14:59.990800 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa14e5-6451-400c-b4ad-7bba46fbf7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:14:59.991508 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa14e5-6451-400c-b4ad-7bba46fbf7b3 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:14:59.991805 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa14e5-6451-400c-b4ad-7bba46fbf7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:14:59.992082 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa14e5-6451-400c-b4ad-7bba46fbf7b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:00.003344 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baa14e5-6451-400c-b4ad-7bba46fbf7b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:15:00.010370 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-4baa14e5-6451-400c-b4ad-7bba46fbf7b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 15:15:00.010370 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:15:00.010370 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:15:00.010370 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:15:00.010370 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:15:00.010370 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:15:00.010370 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:15:00.010370 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:15:00.010370 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:15:00.010370 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:15:00.010370 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:15:00.010370 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:15:00.010370 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:15:00.010370 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:15:00.010370 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:15:00.010370 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:15:00.011197 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:15:00.011197 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:15:00.011197 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:15:00.011197 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:15:00.011197 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:15:00.011197 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:15:00.011197 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:15:00.011197 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:15:00.011197 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:15:00.011197 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:15:00.011197 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:15:00.011197 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:15:00.011197 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:15:00.011197 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:15:00.011197 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:15:00.011197 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:15:00.012148 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:15:00.012148 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:15:00.012148 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:15:00.012148 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:15:00.012148 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:15:00.012148 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:15:00.012148 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:15:00.012148 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:15:00.012148 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:15:00.012148 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:15:00.012148 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 15:15:00.012148 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:15:00.012148 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 28/52] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 2 15:14:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 15:15:00.012985 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f383de61-2259-4861-9127-75d6c0393d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:00.012985 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383de61-2259-4861-9127-75d6c0393d71 None admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:00.012985 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383de61-2259-4861-9127-75d6c0393d71 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:00.013180 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383de61-2259-4861-9127-75d6c0393d71 None admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:00.013758 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f383de61-2259-4861-9127-75d6c0393d71 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:00.015203 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f383de61-2259-4861-9127-75d6c0393d71 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:00.017360 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa14e5-6451-400c-b4ad-7bba46fbf7b3 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:00.045442 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 25/53] 10.222.0.42 () {60 vars in 1140 bytes} [Tue Aug 2 15:14:59 2022] POST /identity/v3/projects => generated 298 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 15:15:00.129511 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa14e5-6451-400c-b4ad-7bba46fbf7b3 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:00.172347 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f97ae-0bbd-48ac-9893-742af485a6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:00.172987 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f97ae-0bbd-48ac-9893-742af485a6bd None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:00.173278 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f97ae-0bbd-48ac-9893-742af485a6bd None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:00.173559 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f97ae-0bbd-48ac-9893-742af485a6bd None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:00.174294 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86f97ae-0bbd-48ac-9893-742af485a6bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:00.174605 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86f97ae-0bbd-48ac-9893-742af485a6bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:00.176102 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86f97ae-0bbd-48ac-9893-742af485a6bd None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:00.185907 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 29/54] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 2 15:15:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:15:00.191791 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f383de61-2259-4861-9127-75d6c0393d71 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:00.291476 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:00.298888 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f383de61-2259-4861-9127-75d6c0393d71 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:00.334797 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f84631-fea0-46dd-90dd-fad68b978caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:00.335521 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f84631-fea0-46dd-90dd-fad68b978caa None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:00.335806 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f84631-fea0-46dd-90dd-fad68b978caa None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:00.336084 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f84631-fea0-46dd-90dd-fad68b978caa None admin] PATH_INFO: `/v3/users/f4dc4eb9d79745cba683d968af36705d` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:00.337266 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f84631-fea0-46dd-90dd-fad68b978caa None admin] RBAC: Authorizing `identity:get_user(user_id=f4dc4eb9d79745cba683d968af36705d)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:00.338708 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f84631-fea0-46dd-90dd-fad68b978caa None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:00.340341 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 26/55] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 2 15:15:00 2022] GET /identity/v3/users/f4dc4eb9d79745cba683d968af36705d => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:15:00.345741 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f97ae-0bbd-48ac-9893-742af485a6bd None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:00.376926 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:00.447996 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f97ae-0bbd-48ac-9893-742af485a6bd None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:00.482952 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec0b24a-bbd1-4247-9268-7139e5867e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:00.483616 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0b24a-bbd1-4247-9268-7139e5867e3b None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:00.483900 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0b24a-bbd1-4247-9268-7139e5867e3b None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:00.484175 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0b24a-bbd1-4247-9268-7139e5867e3b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:00.485327 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec0b24a-bbd1-4247-9268-7139e5867e3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:00.486783 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec0b24a-bbd1-4247-9268-7139e5867e3b None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:00.488401 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 30/56] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:15:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:00.494303 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f84631-fea0-46dd-90dd-fad68b978caa None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:00.597889 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f84631-fea0-46dd-90dd-fad68b978caa None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:00.632968 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea6c83b-c3f7-4a03-a7ec-db58d3209f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:00.633640 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6c83b-c3f7-4a03-a7ec-db58d3209f40 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:00.633858 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6c83b-c3f7-4a03-a7ec-db58d3209f40 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:00.634131 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6c83b-c3f7-4a03-a7ec-db58d3209f40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:00.634914 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea6c83b-c3f7-4a03-a7ec-db58d3209f40 None admin] RBAC: Adding query filter params (role.id=d75c9572cb294caeb8eb456521ff6f57, scope.domain.id=default, user.id=f4dc4eb9d79745cba683d968af36705d) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:00.635243 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea6c83b-c3f7-4a03-a7ec-db58d3209f40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:00.636724 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea6c83b-c3f7-4a03-a7ec-db58d3209f40 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:00.642546 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 27/57] 10.222.0.42 () {56 vars in 1322 bytes} [Tue Aug 2 15:15:00 2022] GET /identity/v3/role_assignments?user.id=f4dc4eb9d79745cba683d968af36705d&scope.domain.id=default&role.id=d75c9572cb294caeb8eb456521ff6f57 => generated 530 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:02.112237 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad1bb6-8c94-467f-a18e-56cbde761c57 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:02.112790 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad1bb6-8c94-467f-a18e-56cbde761c57 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:02.112790 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad1bb6-8c94-467f-a18e-56cbde761c57 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:02.114126 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 31/58] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:15:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:15:02.119276 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d417d61e-36d8-4b68-9871-aa15b934e708 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:02.119694 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d417d61e-36d8-4b68-9871-aa15b934e708 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:02.119902 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d417d61e-36d8-4b68-9871-aa15b934e708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:02.137817 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-d417d61e-36d8-4b68-9871-aa15b934e708 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:15:02.139016 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-d417d61e-36d8-4b68-9871-aa15b934e708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:15:02.159620 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:02.206158 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 28/59] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:15:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:15:02.230437 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad1bb6-8c94-467f-a18e-56cbde761c57 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:02.330215 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:02.335844 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad1bb6-8c94-467f-a18e-56cbde761c57 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:02.368356 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ea2b3-7be1-4296-8d43-5b93bcd8ea11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:02.368924 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ea2b3-7be1-4296-8d43-5b93bcd8ea11 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:02.369207 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ea2b3-7be1-4296-8d43-5b93bcd8ea11 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:02.369483 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ea2b3-7be1-4296-8d43-5b93bcd8ea11 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:02.370628 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380ea2b3-7be1-4296-8d43-5b93bcd8ea11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:02.372106 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380ea2b3-7be1-4296-8d43-5b93bcd8ea11 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:02.373680 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 32/60] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:15:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:15:02.379306 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d417d61e-36d8-4b68-9871-aa15b934e708 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:02.474893 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d417d61e-36d8-4b68-9871-aa15b934e708 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:02.509645 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f9f2fc-f2a8-4e06-b3ea-a8317138b622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:02.510253 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9f2fc-f2a8-4e06-b3ea-a8317138b622 None admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:02.510539 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9f2fc-f2a8-4e06-b3ea-a8317138b622 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:02.510818 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9f2fc-f2a8-4e06-b3ea-a8317138b622 None admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:02.511528 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f9f2fc-f2a8-4e06-b3ea-a8317138b622 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:02.512982 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f9f2fc-f2a8-4e06-b3ea-a8317138b622 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:02.540180 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 29/61] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Aug 2 15:15:02 2022] POST /identity/v3/users => generated 275 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 15:15:05.802268 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d49ff-5de8-4306-b17d-bed94be5af06 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:05.803345 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d49ff-5de8-4306-b17d-bed94be5af06 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:05.803863 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d49ff-5de8-4306-b17d-bed94be5af06 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:05.805426 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 33/62] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:15:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:15:05.810975 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90110136-ec9a-4a94-9f49-1d15b989b108 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:05.811852 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90110136-ec9a-4a94-9f49-1d15b989b108 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:05.812352 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90110136-ec9a-4a94-9f49-1d15b989b108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:05.836328 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-90110136-ec9a-4a94-9f49-1d15b989b108 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:15:05.837964 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-90110136-ec9a-4a94-9f49-1d15b989b108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:15:05.846504 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:05.921660 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733bbdc3-35d0-4b70-9e77-68736ecf7659 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:05.921660 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733bbdc3-35d0-4b70-9e77-68736ecf7659 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:05.921660 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733bbdc3-35d0-4b70-9e77-68736ecf7659 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:05.921660 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 34/63] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:15:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 15:15:05.929152 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae8eb5e-8429-482d-a0be-4070600644be None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:05.929746 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae8eb5e-8429-482d-a0be-4070600644be None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:05.930218 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae8eb5e-8429-482d-a0be-4070600644be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:05.932575 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 30/64] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:15:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:15:05.949231 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-8ae8eb5e-8429-482d-a0be-4070600644be None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:15:05.950764 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-8ae8eb5e-8429-482d-a0be-4070600644be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:15:05.972735 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90110136-ec9a-4a94-9f49-1d15b989b108 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:06.043131 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 35/65] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:15:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:15:06.044690 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33e77f-e355-473c-b4d2-6db52787375d None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:06.045108 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33e77f-e355-473c-b4d2-6db52787375d None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:06.045511 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33e77f-e355-473c-b4d2-6db52787375d None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:06.046904 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 36/66] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:15:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:15:06.052536 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f5f2b-d82a-4194-a0bc-c1e56af189d0 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:06.053029 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f5f2b-d82a-4194-a0bc-c1e56af189d0 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:06.053455 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f5f2b-d82a-4194-a0bc-c1e56af189d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:06.073022 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-7c2f5f2b-d82a-4194-a0bc-c1e56af189d0 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:15:06.074442 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-7c2f5f2b-d82a-4194-a0bc-c1e56af189d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:15:06.123891 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90110136-ec9a-4a94-9f49-1d15b989b108 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:06.158845 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 37/67] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:15:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 15:15:06.159919 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2f5f2b-d82a-4194-a0bc-c1e56af189d0 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:06.172150 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c2158a-cbf3-4dce-9ee1-1767442d60e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:06.173073 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2158a-cbf3-4dce-9ee1-1767442d60e0 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:06.173532 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2158a-cbf3-4dce-9ee1-1767442d60e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:06.173974 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2158a-cbf3-4dce-9ee1-1767442d60e0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:06.189304 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c2158a-cbf3-4dce-9ee1-1767442d60e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:15:06.195901 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-96c2158a-cbf3-4dce-9ee1-1767442d60e0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 15:15:06.195901 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:15:06.195901 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:15:06.195901 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:15:06.195901 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:15:06.195901 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:15:06.195901 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:15:06.195901 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:15:06.195901 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:15:06.195901 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:15:06.195901 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:15:06.195901 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:15:06.195901 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:15:06.195901 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:15:06.195901 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:15:06.195901 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:15:06.196912 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:15:06.196912 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:15:06.196912 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:15:06.196912 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:15:06.196912 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:15:06.196912 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:15:06.196912 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:15:06.196912 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:15:06.196912 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:15:06.196912 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:15:06.196912 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:15:06.196912 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:15:06.196912 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:15:06.196912 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:15:06.196912 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:15:06.196912 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:15:06.197661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:15:06.197661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:15:06.197661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:15:06.197661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:15:06.197661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:15:06.197661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:15:06.197661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:15:06.197661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:15:06.197661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:15:06.197661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:15:06.197661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 15:15:06.197661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:15:06.198250 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 31/68] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 2 15:15:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 15:15:06.199561 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32037dcc-5654-4e2b-aa71-f971f10510eb None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:06.199714 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:06.199905 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32037dcc-5654-4e2b-aa71-f971f10510eb None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:06.200199 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32037dcc-5654-4e2b-aa71-f971f10510eb None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:06.201584 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 32/69] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:15:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:15:06.204025 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32037dcc-5654-4e2b-aa71-f971f10510eb None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:06.207199 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:06.284808 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2f5f2b-d82a-4194-a0bc-c1e56af189d0 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:06.324766 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6622c396-1281-4b11-a453-8ce362324b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:06.324960 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32037dcc-5654-4e2b-aa71-f971f10510eb None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:06.325343 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6622c396-1281-4b11-a453-8ce362324b43 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:06.325629 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6622c396-1281-4b11-a453-8ce362324b43 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:06.325940 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6622c396-1281-4b11-a453-8ce362324b43 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:06.337004 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6622c396-1281-4b11-a453-8ce362324b43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:15:06.341990 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-6622c396-1281-4b11-a453-8ce362324b43 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 15:15:06.341990 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:15:06.341990 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:15:06.341990 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:15:06.341990 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:15:06.341990 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:15:06.341990 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:15:06.341990 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:15:06.341990 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:15:06.341990 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:15:06.341990 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:15:06.341990 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:15:06.341990 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:15:06.341990 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:15:06.341990 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:15:06.341990 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:15:06.342839 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:15:06.342839 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:15:06.342839 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:15:06.342839 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:15:06.342839 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:15:06.342839 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:15:06.342839 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:15:06.342839 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:15:06.342839 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:15:06.342839 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:15:06.342839 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:15:06.342839 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:15:06.342839 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:15:06.342839 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:15:06.342839 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:15:06.342839 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:15:06.343948 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:15:06.343948 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:15:06.343948 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:15:06.343948 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:15:06.343948 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:15:06.343948 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:15:06.343948 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:15:06.343948 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:15:06.343948 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:15:06.343948 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:15:06.343948 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 15:15:06.343948 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:15:06.343948 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 38/70] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Aug 2 15:15:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:15:06.344844 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19096a-4728-4e48-a5a1-5d376efef023 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:06.344844 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19096a-4728-4e48-a5a1-5d376efef023 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:06.344844 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19096a-4728-4e48-a5a1-5d376efef023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:06.362750 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60866f8a-123f-4260-babc-f4586ccf8b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:06.363118 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-9e19096a-4728-4e48-a5a1-5d376efef023 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:15:06.363433 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60866f8a-123f-4260-babc-f4586ccf8b21 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:06.363726 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60866f8a-123f-4260-babc-f4586ccf8b21 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:06.364007 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60866f8a-123f-4260-babc-f4586ccf8b21 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:06.364462 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-9e19096a-4728-4e48-a5a1-5d376efef023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:15:06.375497 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60866f8a-123f-4260-babc-f4586ccf8b21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:15:06.380529 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-60866f8a-123f-4260-babc-f4586ccf8b21 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 15:15:06.380529 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:15:06.380529 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:15:06.380529 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:15:06.380529 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:15:06.380529 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:15:06.380529 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:15:06.380529 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:15:06.380529 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:15:06.380529 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:15:06.380529 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:15:06.380529 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:15:06.380529 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:15:06.380529 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:15:06.380529 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:15:06.380529 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:15:06.381554 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:15:06.381554 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:15:06.381554 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:15:06.381554 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:15:06.381554 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:15:06.381554 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:15:06.381554 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:15:06.381554 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:15:06.381554 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:15:06.381554 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:15:06.381554 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:15:06.381554 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:15:06.381554 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:15:06.381554 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:15:06.381554 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:15:06.381554 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:15:06.383030 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:15:06.383030 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:15:06.383030 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:15:06.383030 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:15:06.383030 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:15:06.383030 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:15:06.383030 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:15:06.383030 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:15:06.383030 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:15:06.383030 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:15:06.383030 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 15:15:06.383030 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:15:06.383030 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 33/71] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 2 15:15:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:15:06.384014 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60866f8a-123f-4260-babc-f4586ccf8b21 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:06.434922 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 39/72] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:15:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:15:06.436216 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f4445-cded-4036-b813-12ba320f3c11 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:06.436512 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f4445-cded-4036-b813-12ba320f3c11 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:06.436790 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f4445-cded-4036-b813-12ba320f3c11 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:06.438037 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 40/73] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:15:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:15:06.438724 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f4445-cded-4036-b813-12ba320f3c11 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:06.453366 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:06.461456 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:06.494148 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60866f8a-123f-4260-babc-f4586ccf8b21 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:06.530254 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a53c0-f0d9-475c-ad87-09c49b76b41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:06.530884 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a53c0-f0d9-475c-ad87-09c49b76b41b None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:06.531175 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a53c0-f0d9-475c-ad87-09c49b76b41b None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:06.531496 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a53c0-f0d9-475c-ad87-09c49b76b41b None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:06.532225 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229a53c0-f0d9-475c-ad87-09c49b76b41b None admin] RBAC: Adding query filter params (name=member) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:06.532538 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229a53c0-f0d9-475c-ad87-09c49b76b41b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:06.533943 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229a53c0-f0d9-475c-ad87-09c49b76b41b None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:06.544117 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 34/74] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 2 15:15:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:06.549180 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f4445-cded-4036-b813-12ba320f3c11 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:06.549634 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a53c0-f0d9-475c-ad87-09c49b76b41b None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:06.583574 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4178cfd5-e614-4fd6-9279-aa3d20fc4430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:06.584107 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178cfd5-e614-4fd6-9279-aa3d20fc4430 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:06.584388 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178cfd5-e614-4fd6-9279-aa3d20fc4430 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:06.584680 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178cfd5-e614-4fd6-9279-aa3d20fc4430 None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:06.585873 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4178cfd5-e614-4fd6-9279-aa3d20fc4430 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:06.586179 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4178cfd5-e614-4fd6-9279-aa3d20fc4430 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:06.587616 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4178cfd5-e614-4fd6-9279-aa3d20fc4430 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:06.595925 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 41/75] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 2 15:15:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:06.602189 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a8c4f-d2b3-4a20-b651-bba758ee9cc7 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:06.602487 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a8c4f-d2b3-4a20-b651-bba758ee9cc7 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:06.602763 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a8c4f-d2b3-4a20-b651-bba758ee9cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:06.620944 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-841a8c4f-d2b3-4a20-b651-bba758ee9cc7 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:15:06.622158 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-841a8c4f-d2b3-4a20-b651-bba758ee9cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:15:06.656693 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a53c0-f0d9-475c-ad87-09c49b76b41b None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:06.681737 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:06.690313 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 42/76] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:15:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:15:06.691170 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a8c4f-d2b3-4a20-b651-bba758ee9cc7 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:06.701273 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:06.706391 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ff8f2-7c05-472c-a177-072c39b9745e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:06.707141 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ff8f2-7c05-472c-a177-072c39b9745e None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:06.707378 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ff8f2-7c05-472c-a177-072c39b9745e None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:06.707634 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ff8f2-7c05-472c-a177-072c39b9745e None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:06.708359 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678ff8f2-7c05-472c-a177-072c39b9745e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:06.708657 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678ff8f2-7c05-472c-a177-072c39b9745e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:06.710606 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678ff8f2-7c05-472c-a177-072c39b9745e None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:06.719566 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 35/77] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 2 15:15:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:06.720410 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ff8f2-7c05-472c-a177-072c39b9745e None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:06.804158 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a8c4f-d2b3-4a20-b651-bba758ee9cc7 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:06.832382 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ff8f2-7c05-472c-a177-072c39b9745e None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:06.840741 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfdc310-2074-4b4c-9381-3cd5b73ae057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:06.841323 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfdc310-2074-4b4c-9381-3cd5b73ae057 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:06.841611 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfdc310-2074-4b4c-9381-3cd5b73ae057 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:06.841899 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfdc310-2074-4b4c-9381-3cd5b73ae057 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:06.852150 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfdc310-2074-4b4c-9381-3cd5b73ae057 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:15:06.857100 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-1cfdc310-2074-4b4c-9381-3cd5b73ae057 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 15:15:06.857100 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:15:06.857100 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:15:06.857100 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:15:06.857100 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:15:06.857100 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:15:06.857100 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:15:06.857100 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:15:06.857100 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:15:06.857100 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:15:06.857100 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:15:06.857100 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:15:06.857100 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:15:06.857100 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:15:06.857100 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:15:06.857100 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:15:06.858136 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:15:06.858136 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:15:06.858136 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:15:06.858136 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:15:06.858136 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:15:06.858136 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:15:06.858136 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:15:06.858136 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:15:06.858136 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:15:06.858136 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:15:06.858136 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:15:06.858136 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:15:06.858136 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:15:06.858136 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:15:06.858136 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:15:06.858136 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:15:06.859330 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:15:06.859330 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:15:06.859330 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:15:06.859330 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:15:06.859330 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:15:06.859330 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:15:06.859330 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:15:06.859330 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:15:06.859330 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:15:06.859330 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:15:06.859330 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 15:15:06.859330 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:15:06.859330 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 43/78] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 2 15:15:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:15:06.859330 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfdc310-2074-4b4c-9381-3cd5b73ae057 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:06.871769 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af29d6-6e5d-4af1-bfe4-3eda3e8c5b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:06.872421 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af29d6-6e5d-4af1-bfe4-3eda3e8c5b41 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:06.872703 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af29d6-6e5d-4af1-bfe4-3eda3e8c5b41 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:06.872982 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af29d6-6e5d-4af1-bfe4-3eda3e8c5b41 None admin] PATH_INFO: `/v3/users/c6226fdf121845309b74b8c58d113534` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:06.889710 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34af29d6-6e5d-4af1-bfe4-3eda3e8c5b41 None admin] RBAC: Authorizing `identity:get_user(user_id=c6226fdf121845309b74b8c58d113534)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:06.891170 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34af29d6-6e5d-4af1-bfe4-3eda3e8c5b41 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:06.892887 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 36/79] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 2 15:15:06 2022] GET /identity/v3/users/c6226fdf121845309b74b8c58d113534 => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:06.893660 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af29d6-6e5d-4af1-bfe4-3eda3e8c5b41 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:06.932282 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:06.941498 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:06.969991 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfdc310-2074-4b4c-9381-3cd5b73ae057 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:07.000200 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af29d6-6e5d-4af1-bfe4-3eda3e8c5b41 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:07.006198 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2cec19-4999-4dff-a9d7-5685eb8f63f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:07.007408 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2cec19-4999-4dff-a9d7-5685eb8f63f4 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:07.007695 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2cec19-4999-4dff-a9d7-5685eb8f63f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:07.008017 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2cec19-4999-4dff-a9d7-5685eb8f63f4 None admin] PATH_INFO: `/v3/users/c6226fdf121845309b74b8c58d113534` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:07.009222 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2cec19-4999-4dff-a9d7-5685eb8f63f4 None admin] RBAC: Authorizing `identity:get_user(user_id=c6226fdf121845309b74b8c58d113534)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:07.010703 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2cec19-4999-4dff-a9d7-5685eb8f63f4 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:07.012804 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 44/80] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 2 15:15:06 2022] GET /identity/v3/users/c6226fdf121845309b74b8c58d113534 => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:07.013778 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2cec19-4999-4dff-a9d7-5685eb8f63f4 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:07.039589 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d40f064-7701-4a16-ac25-ff19c189bd03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:07.040248 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40f064-7701-4a16-ac25-ff19c189bd03 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:07.040543 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40f064-7701-4a16-ac25-ff19c189bd03 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:07.040826 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40f064-7701-4a16-ac25-ff19c189bd03 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:07.042094 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d40f064-7701-4a16-ac25-ff19c189bd03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:07.043604 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d40f064-7701-4a16-ac25-ff19c189bd03 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:07.045474 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 37/81] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:15:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:07.046168 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d40f064-7701-4a16-ac25-ff19c189bd03 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:07.124299 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2cec19-4999-4dff-a9d7-5685eb8f63f4 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:07.158885 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d40f064-7701-4a16-ac25-ff19c189bd03 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:07.168602 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab6cdf7-225e-4640-a825-d2de21293007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:07.169422 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6cdf7-225e-4640-a825-d2de21293007 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:07.169706 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6cdf7-225e-4640-a825-d2de21293007 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:07.169982 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6cdf7-225e-4640-a825-d2de21293007 None admin] PATH_INFO: `/v3/users/f4dc4eb9d79745cba683d968af36705d` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:07.171180 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab6cdf7-225e-4640-a825-d2de21293007 None admin] RBAC: Authorizing `identity:get_user(user_id=f4dc4eb9d79745cba683d968af36705d)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:07.172711 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab6cdf7-225e-4640-a825-d2de21293007 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:07.174275 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:07.174435 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 45/82] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 2 15:15:07 2022] GET /identity/v3/users/f4dc4eb9d79745cba683d968af36705d => generated 247 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:07.175094 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab6cdf7-225e-4640-a825-d2de21293007 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:07.182735 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:07.200634 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b2cbfc-1d01-4156-b51b-686ea80e6667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:07.201525 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2cbfc-1d01-4156-b51b-686ea80e6667 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:07.201804 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2cbfc-1d01-4156-b51b-686ea80e6667 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:07.202089 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2cbfc-1d01-4156-b51b-686ea80e6667 None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:07.202821 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b2cbfc-1d01-4156-b51b-686ea80e6667 None admin] RBAC: Adding query filter params (name=member) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:07.203131 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b2cbfc-1d01-4156-b51b-686ea80e6667 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:07.204574 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b2cbfc-1d01-4156-b51b-686ea80e6667 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:07.213169 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 38/83] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 2 15:15:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:07.213997 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b2cbfc-1d01-4156-b51b-686ea80e6667 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:07.289353 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab6cdf7-225e-4640-a825-d2de21293007 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:07.320644 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b2cbfc-1d01-4156-b51b-686ea80e6667 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:07.324849 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515417fb-6104-4f12-a32d-f3b9b9b5ab86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:07.325484 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515417fb-6104-4f12-a32d-f3b9b9b5ab86 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:07.325774 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515417fb-6104-4f12-a32d-f3b9b9b5ab86 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:07.326056 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515417fb-6104-4f12-a32d-f3b9b9b5ab86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:07.354673 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b7423-d121-4cd6-8fbf-9c60e41b7e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:07.355321 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b7423-d121-4cd6-8fbf-9c60e41b7e4b None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:07.355618 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b7423-d121-4cd6-8fbf-9c60e41b7e4b None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:07.355897 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b7423-d121-4cd6-8fbf-9c60e41b7e4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:07.394513 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515417fb-6104-4f12-a32d-f3b9b9b5ab86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:07.396042 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515417fb-6104-4f12-a32d-f3b9b9b5ab86 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:07.398764 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:07.399910 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:07.427166 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903b7423-d121-4cd6-8fbf-9c60e41b7e4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:07.429527 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903b7423-d121-4cd6-8fbf-9c60e41b7e4b None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:07.501838 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 46/84] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 2 15:15:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 15:15:07.502702 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515417fb-6104-4f12-a32d-f3b9b9b5ab86 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:07.539740 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 39/85] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 2 15:15:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 15:15:07.540614 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b7423-d121-4cd6-8fbf-9c60e41b7e4b None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:07.608739 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515417fb-6104-4f12-a32d-f3b9b9b5ab86 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:07.611054 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:07.617648 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:07.644434 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b7423-d121-4cd6-8fbf-9c60e41b7e4b None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:07.646978 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f27d1-aa23-4e82-a960-9d6d8febdf58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:07.647628 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f27d1-aa23-4e82-a960-9d6d8febdf58 None admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:07.647913 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f27d1-aa23-4e82-a960-9d6d8febdf58 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:07.648704 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f27d1-aa23-4e82-a960-9d6d8febdf58 None admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:07.649402 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1f27d1-aa23-4e82-a960-9d6d8febdf58 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:07.650881 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1f27d1-aa23-4e82-a960-9d6d8febdf58 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:07.679320 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 47/86] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Aug 2 15:15:07 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:15:07.680174 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f27d1-aa23-4e82-a960-9d6d8febdf58 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:07.682197 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e281b-364f-494f-a110-f06e25c0b9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:07.683054 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e281b-364f-494f-a110-f06e25c0b9ff None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:07.683547 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e281b-364f-494f-a110-f06e25c0b9ff None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:07.683982 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e281b-364f-494f-a110-f06e25c0b9ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:07.769461 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e281b-364f-494f-a110-f06e25c0b9ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:07.770970 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e281b-364f-494f-a110-f06e25c0b9ff None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:07.799588 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f27d1-aa23-4e82-a960-9d6d8febdf58 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:07.840722 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce796cce-6f1c-43a6-a1e8-13e8a8bac37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:07.841977 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce796cce-6f1c-43a6-a1e8-13e8a8bac37d None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:07.841977 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce796cce-6f1c-43a6-a1e8-13e8a8bac37d None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:07.841977 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce796cce-6f1c-43a6-a1e8-13e8a8bac37d None admin] PATH_INFO: `/v3/users/c6226fdf121845309b74b8c58d113534` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:07.843208 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce796cce-6f1c-43a6-a1e8-13e8a8bac37d None admin] RBAC: Authorizing `identity:get_user(user_id=c6226fdf121845309b74b8c58d113534)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:07.844968 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce796cce-6f1c-43a6-a1e8-13e8a8bac37d None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:07.846597 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 48/87] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 2 15:15:07 2022] GET /identity/v3/users/c6226fdf121845309b74b8c58d113534 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:07.847445 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce796cce-6f1c-43a6-a1e8-13e8a8bac37d None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:07.878565 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:07.886772 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:07.910645 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 40/88] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 2 15:15:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 15:15:07.911671 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e281b-364f-494f-a110-f06e25c0b9ff None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:08.002107 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce796cce-6f1c-43a6-a1e8-13e8a8bac37d None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:08.049774 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e281b-364f-494f-a110-f06e25c0b9ff None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:08.059018 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f84e4-d718-4479-9a96-e0c560bf05eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:08.059743 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f84e4-d718-4479-9a96-e0c560bf05eb None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:08.060023 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f84e4-d718-4479-9a96-e0c560bf05eb None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:08.060298 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f84e4-d718-4479-9a96-e0c560bf05eb None admin] PATH_INFO: `/v3/projects/3f5199ad4b6b4534bfa9c94c6da85f3e` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:08.062140 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133f84e4-d718-4479-9a96-e0c560bf05eb None admin] RBAC: Authorizing `identity:get_project(project_id=3f5199ad4b6b4534bfa9c94c6da85f3e)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:08.064260 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133f84e4-d718-4479-9a96-e0c560bf05eb None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:08.066780 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 49/89] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 2 15:15:07 2022] GET /identity/v3/projects/3f5199ad4b6b4534bfa9c94c6da85f3e => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:08.067245 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f84e4-d718-4479-9a96-e0c560bf05eb None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:08.102076 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57928d33-6f56-49ea-b36f-66d28081bda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:08.103247 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57928d33-6f56-49ea-b36f-66d28081bda1 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:08.103794 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57928d33-6f56-49ea-b36f-66d28081bda1 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:08.104566 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57928d33-6f56-49ea-b36f-66d28081bda1 None admin] PATH_INFO: `/v3/projects/3f5199ad4b6b4534bfa9c94c6da85f3e` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:08.106477 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57928d33-6f56-49ea-b36f-66d28081bda1 None admin] RBAC: Authorizing `identity:get_project(project_id=3f5199ad4b6b4534bfa9c94c6da85f3e)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:08.109005 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57928d33-6f56-49ea-b36f-66d28081bda1 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:08.112216 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 41/90] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 2 15:15:07 2022] GET /identity/v3/projects/3f5199ad4b6b4534bfa9c94c6da85f3e => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:08.113374 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57928d33-6f56-49ea-b36f-66d28081bda1 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:08.178173 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:08.209793 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:08.221038 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f84e4-d718-4479-9a96-e0c560bf05eb None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:08.258797 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57928d33-6f56-49ea-b36f-66d28081bda1 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:08.274800 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d26d79c-e29d-4c75-8eee-ad56298bcfdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:08.275594 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26d79c-e29d-4c75-8eee-ad56298bcfdb None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:08.275880 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26d79c-e29d-4c75-8eee-ad56298bcfdb None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:08.276154 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26d79c-e29d-4c75-8eee-ad56298bcfdb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:08.308218 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f2a0e0-8f3f-4015-b25b-1f0ffdae5b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:08.309278 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2a0e0-8f3f-4015-b25b-1f0ffdae5b0b None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:08.309834 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2a0e0-8f3f-4015-b25b-1f0ffdae5b0b None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:08.310117 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2a0e0-8f3f-4015-b25b-1f0ffdae5b0b None admin] PATH_INFO: `/v3/projects/3f5199ad4b6b4534bfa9c94c6da85f3e` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:08.311578 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f2a0e0-8f3f-4015-b25b-1f0ffdae5b0b None admin] RBAC: Authorizing `identity:get_project(project_id=3f5199ad4b6b4534bfa9c94c6da85f3e)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:08.313702 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f2a0e0-8f3f-4015-b25b-1f0ffdae5b0b None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:08.316804 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 42/91] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 2 15:15:08 2022] GET /identity/v3/projects/3f5199ad4b6b4534bfa9c94c6da85f3e => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:08.317613 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f2a0e0-8f3f-4015-b25b-1f0ffdae5b0b None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:08.355271 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d26d79c-e29d-4c75-8eee-ad56298bcfdb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:08.357076 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d26d79c-e29d-4c75-8eee-ad56298bcfdb None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:08.449748 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f2a0e0-8f3f-4015-b25b-1f0ffdae5b0b None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:08.464898 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:08.466163 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:08.479377 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 50/92] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 2 15:15:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 15:15:08.480625 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d26d79c-e29d-4c75-8eee-ad56298bcfdb None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:08.497325 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874db5e5-bb83-4cdd-bb64-fc3b5b59a175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:08.497954 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874db5e5-bb83-4cdd-bb64-fc3b5b59a175 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:08.498240 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874db5e5-bb83-4cdd-bb64-fc3b5b59a175 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:08.498518 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874db5e5-bb83-4cdd-bb64-fc3b5b59a175 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:08.499624 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874db5e5-bb83-4cdd-bb64-fc3b5b59a175 None admin] RBAC: Adding query filter params (role.id=bf4fcdd92d8a4a6d855f3eaa4f542529, scope.project.id=3f5199ad4b6b4534bfa9c94c6da85f3e, user.id=c6226fdf121845309b74b8c58d113534) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:08.499952 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874db5e5-bb83-4cdd-bb64-fc3b5b59a175 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:08.501837 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874db5e5-bb83-4cdd-bb64-fc3b5b59a175 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:08.511039 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 43/93] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 2 15:15:08 2022] GET /identity/v3/role_assignments?user.id=c6226fdf121845309b74b8c58d113534&scope.project.id=3f5199ad4b6b4534bfa9c94c6da85f3e&role.id=bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:08.519250 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874db5e5-bb83-4cdd-bb64-fc3b5b59a175 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:08.683080 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d26d79c-e29d-4c75-8eee-ad56298bcfdb None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:08.727777 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ddaad-74c8-42d0-b399-7ba9515a49fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:08.728353 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ddaad-74c8-42d0-b399-7ba9515a49fe None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:08.728638 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ddaad-74c8-42d0-b399-7ba9515a49fe None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:08.728914 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ddaad-74c8-42d0-b399-7ba9515a49fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:08.729812 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1ddaad-74c8-42d0-b399-7ba9515a49fe None admin] RBAC: Adding query filter params (role.id=3e1c8e0567ff4244aef0d6a62fc8b18d, scope.project.id=3f5199ad4b6b4534bfa9c94c6da85f3e, user.id=c6226fdf121845309b74b8c58d113534) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:08.730126 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1ddaad-74c8-42d0-b399-7ba9515a49fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:08.731622 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1ddaad-74c8-42d0-b399-7ba9515a49fe None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:08.736318 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874db5e5-bb83-4cdd-bb64-fc3b5b59a175 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:08.739701 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 51/94] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 2 15:15:08 2022] GET /identity/v3/role_assignments?user.id=c6226fdf121845309b74b8c58d113534&scope.project.id=3f5199ad4b6b4534bfa9c94c6da85f3e&role.id=3e1c8e0567ff4244aef0d6a62fc8b18d => generated 259 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:08.740016 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ddaad-74c8-42d0-b399-7ba9515a49fe None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:08.780793 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405326e3-4e21-409a-834e-5fd837ea0a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:08.781796 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405326e3-4e21-409a-834e-5fd837ea0a13 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:08.782280 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405326e3-4e21-409a-834e-5fd837ea0a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:08.782800 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405326e3-4e21-409a-834e-5fd837ea0a13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:08.783993 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405326e3-4e21-409a-834e-5fd837ea0a13 None admin] RBAC: Adding query filter params (role.id=d75c9572cb294caeb8eb456521ff6f57, scope.project.id=3f5199ad4b6b4534bfa9c94c6da85f3e, user.id=f4dc4eb9d79745cba683d968af36705d) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:08.784597 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405326e3-4e21-409a-834e-5fd837ea0a13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:08.786751 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405326e3-4e21-409a-834e-5fd837ea0a13 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:08.794288 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 44/95] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 2 15:15:08 2022] GET /identity/v3/role_assignments?user.id=f4dc4eb9d79745cba683d968af36705d&scope.project.id=3f5199ad4b6b4534bfa9c94c6da85f3e&role.id=d75c9572cb294caeb8eb456521ff6f57 => generated 259 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:08.825753 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:08.873955 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ddaad-74c8-42d0-b399-7ba9515a49fe None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:08.913680 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7634a8-d2e7-48e8-9b94-a430c6918d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:08.914337 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7634a8-d2e7-48e8-9b94-a430c6918d1c None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:08.914620 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7634a8-d2e7-48e8-9b94-a430c6918d1c None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:08.914895 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7634a8-d2e7-48e8-9b94-a430c6918d1c None admin] PATH_INFO: `/v3/projects/14904f87911d4aefba46cdbd07ff0c43` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:08.916180 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7634a8-d2e7-48e8-9b94-a430c6918d1c None admin] RBAC: Authorizing `identity:get_project(project_id=14904f87911d4aefba46cdbd07ff0c43)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:08.917660 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7634a8-d2e7-48e8-9b94-a430c6918d1c None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:08.919520 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 52/96] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 2 15:15:08 2022] GET /identity/v3/projects/14904f87911d4aefba46cdbd07ff0c43 => generated 312 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:08.925367 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405326e3-4e21-409a-834e-5fd837ea0a13 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:08.978285 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:09.066323 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405326e3-4e21-409a-834e-5fd837ea0a13 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:09.110913 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315543f4-d30b-4df3-a2d3-26a53e577040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:09.111885 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315543f4-d30b-4df3-a2d3-26a53e577040 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:09.112350 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315543f4-d30b-4df3-a2d3-26a53e577040 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:09.112829 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315543f4-d30b-4df3-a2d3-26a53e577040 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:09.113811 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315543f4-d30b-4df3-a2d3-26a53e577040 None admin] RBAC: Adding query filter params (role.id=bf4fcdd92d8a4a6d855f3eaa4f542529, scope.project.id=14904f87911d4aefba46cdbd07ff0c43, user.id=c6226fdf121845309b74b8c58d113534) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:09.114299 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315543f4-d30b-4df3-a2d3-26a53e577040 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:09.116045 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315543f4-d30b-4df3-a2d3-26a53e577040 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:09.127823 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 45/97] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 2 15:15:08 2022] GET /identity/v3/role_assignments?user.id=c6226fdf121845309b74b8c58d113534&scope.project.id=14904f87911d4aefba46cdbd07ff0c43&role.id=bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:10.260904 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee95dc-4cd3-4d3a-81c9-199d9ed577d6 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:10.261901 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee95dc-4cd3-4d3a-81c9-199d9ed577d6 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:10.262380 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee95dc-4cd3-4d3a-81c9-199d9ed577d6 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:10.264203 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 53/98] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:15:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:15:10.271034 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc705456-c07b-4d29-b671-9af03e97f480 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:10.271939 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc705456-c07b-4d29-b671-9af03e97f480 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:10.272451 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc705456-c07b-4d29-b671-9af03e97f480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:10.291935 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-cc705456-c07b-4d29-b671-9af03e97f480 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:15:10.293455 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-cc705456-c07b-4d29-b671-9af03e97f480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:15:10.340982 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08350f0-48c3-42cc-82f7-248a0ac4d1ed None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:10.341639 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08350f0-48c3-42cc-82f7-248a0ac4d1ed None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:10.342133 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08350f0-48c3-42cc-82f7-248a0ac4d1ed None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:10.343793 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 54/99] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:15:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 15:15:10.350808 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3696f-c7d0-4454-95f0-3d5608031349 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:10.351534 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3696f-c7d0-4454-95f0-3d5608031349 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:10.352009 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3696f-c7d0-4454-95f0-3d5608031349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:10.380928 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-9eb3696f-c7d0-4454-95f0-3d5608031349 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:15:10.384266 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-9eb3696f-c7d0-4454-95f0-3d5608031349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:15:10.408443 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 46/100] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:15:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 15:15:10.469354 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc705456-c07b-4d29-b671-9af03e97f480 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:10.494439 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 55/101] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:15:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 15:15:10.509113 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:10.543864 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3696f-c7d0-4454-95f0-3d5608031349 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:10.616014 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:10.646180 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc705456-c07b-4d29-b671-9af03e97f480 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:10.683320 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3696f-c7d0-4454-95f0-3d5608031349 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:10.722055 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042dca03-b50d-42fd-ac45-4fd0e3226933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:10.723066 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042dca03-b50d-42fd-ac45-4fd0e3226933 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:10.723575 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042dca03-b50d-42fd-ac45-4fd0e3226933 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:10.724047 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042dca03-b50d-42fd-ac45-4fd0e3226933 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:10.744898 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042dca03-b50d-42fd-ac45-4fd0e3226933 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:15:10.751169 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-042dca03-b50d-42fd-ac45-4fd0e3226933 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 15:15:10.751169 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:15:10.751169 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:15:10.751169 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:15:10.751169 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:15:10.751169 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:15:10.751169 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:15:10.751169 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:15:10.751169 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:15:10.751169 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:15:10.751169 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:15:10.751169 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:15:10.751169 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:15:10.751169 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:15:10.751169 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:15:10.751169 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:15:10.752101 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:15:10.752101 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:15:10.752101 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:15:10.752101 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:15:10.752101 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:15:10.752101 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:15:10.752101 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:15:10.752101 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:15:10.752101 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:15:10.752101 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:15:10.752101 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:15:10.752101 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:15:10.752101 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:15:10.752101 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:15:10.752101 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:15:10.752101 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:15:10.752940 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:15:10.752940 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:15:10.752940 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:15:10.752940 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:15:10.752940 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:15:10.752940 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:15:10.752940 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:15:10.752940 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:15:10.752940 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:15:10.752940 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:15:10.752940 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 15:15:10.752940 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:15:10.756986 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15497a56-13d6-4617-9e17-5bd9ee7213c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:10.757962 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15497a56-13d6-4617-9e17-5bd9ee7213c7 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:10.758462 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15497a56-13d6-4617-9e17-5bd9ee7213c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:10.758930 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15497a56-13d6-4617-9e17-5bd9ee7213c7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:10.760971 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 47/102] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 2 15:15:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 15:15:10.761832 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15497a56-13d6-4617-9e17-5bd9ee7213c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:10.763716 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15497a56-13d6-4617-9e17-5bd9ee7213c7 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:10.765668 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 56/103] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:15:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:15:10.768532 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042dca03-b50d-42fd-ac45-4fd0e3226933 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:10.773297 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15497a56-13d6-4617-9e17-5bd9ee7213c7 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:10.961294 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:10.971649 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15497a56-13d6-4617-9e17-5bd9ee7213c7 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:10.978576 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042dca03-b50d-42fd-ac45-4fd0e3226933 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:11.000832 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:11.013493 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaa1412-a42a-4231-85d2-b5034b68a191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:11.014122 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa1412-a42a-4231-85d2-b5034b68a191 None admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:11.014403 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa1412-a42a-4231-85d2-b5034b68a191 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:11.014676 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa1412-a42a-4231-85d2-b5034b68a191 None admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:11.015715 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaa1412-a42a-4231-85d2-b5034b68a191 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:11.017242 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaa1412-a42a-4231-85d2-b5034b68a191 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:11.049211 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bee697-8a51-471c-8e02-06299630ca96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:11.049839 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bee697-8a51-471c-8e02-06299630ca96 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:11.050123 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bee697-8a51-471c-8e02-06299630ca96 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:11.050404 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bee697-8a51-471c-8e02-06299630ca96 None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:11.051126 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bee697-8a51-471c-8e02-06299630ca96 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:11.051458 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bee697-8a51-471c-8e02-06299630ca96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:11.052858 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bee697-8a51-471c-8e02-06299630ca96 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:11.072308 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 57/104] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Aug 2 15:15:10 2022] POST /identity/v3/projects => generated 302 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:15:11.076736 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 48/105] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 2 15:15:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:15:11.083158 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaa1412-a42a-4231-85d2-b5034b68a191 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:11.224878 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaa1412-a42a-4231-85d2-b5034b68a191 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:11.270113 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1b8680-d35f-4497-811d-593404c0a6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:11.270823 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b8680-d35f-4497-811d-593404c0a6eb None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:11.271137 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b8680-d35f-4497-811d-593404c0a6eb None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:11.271439 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b8680-d35f-4497-811d-593404c0a6eb None admin] PATH_INFO: `/v3/users/8deb58b82f244801b76925e67e60f252` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:11.290256 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1b8680-d35f-4497-811d-593404c0a6eb None admin] RBAC: Authorizing `identity:get_user(user_id=8deb58b82f244801b76925e67e60f252)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:11.291841 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1b8680-d35f-4497-811d-593404c0a6eb None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:11.293682 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 58/106] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 2 15:15:11 2022] GET /identity/v3/users/8deb58b82f244801b76925e67e60f252 => generated 289 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:11.299601 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bee697-8a51-471c-8e02-06299630ca96 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:11.430782 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bee697-8a51-471c-8e02-06299630ca96 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:11.473044 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223cbe09-1c14-4f20-be9f-f8b80948529b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:11.473728 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223cbe09-1c14-4f20-be9f-f8b80948529b None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:11.474012 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223cbe09-1c14-4f20-be9f-f8b80948529b None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:11.474291 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223cbe09-1c14-4f20-be9f-f8b80948529b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:11.502537 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:11.552920 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223cbe09-1c14-4f20-be9f-f8b80948529b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:11.555113 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223cbe09-1c14-4f20-be9f-f8b80948529b None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:11.626927 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e39b13-39c0-4320-9f0a-ce885a809951 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:11.627307 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e39b13-39c0-4320-9f0a-ce885a809951 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:11.627590 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e39b13-39c0-4320-9f0a-ce885a809951 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:11.630023 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 59/107] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:15:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 15:15:11.639649 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3a6fc-b4fb-4be0-83f9-55966ed27b7c None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:11.640251 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3a6fc-b4fb-4be0-83f9-55966ed27b7c None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:11.640761 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3a6fc-b4fb-4be0-83f9-55966ed27b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:11.673306 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-71b3a6fc-b4fb-4be0-83f9-55966ed27b7c None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:15:11.674540 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-71b3a6fc-b4fb-4be0-83f9-55966ed27b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:15:11.697733 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 49/108] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 2 15:15:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 15:15:11.704658 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223cbe09-1c14-4f20-be9f-f8b80948529b None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:11.743149 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:11.811686 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 60/109] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:15:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 15:15:11.847054 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b3a6fc-b4fb-4be0-83f9-55966ed27b7c None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:11.926199 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:12.018469 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223cbe09-1c14-4f20-be9f-f8b80948529b None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:12.064146 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa218c-66da-452f-a6bb-bb59fb8eff51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:12.064710 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa218c-66da-452f-a6bb-bb59fb8eff51 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:12.065000 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa218c-66da-452f-a6bb-bb59fb8eff51 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:12.065286 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa218c-66da-452f-a6bb-bb59fb8eff51 None admin] PATH_INFO: `/v3/projects/3f5199ad4b6b4534bfa9c94c6da85f3e` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:12.066533 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aa218c-66da-452f-a6bb-bb59fb8eff51 None admin] RBAC: Authorizing `identity:get_project(project_id=3f5199ad4b6b4534bfa9c94c6da85f3e)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:12.068165 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aa218c-66da-452f-a6bb-bb59fb8eff51 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:12.070990 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 50/110] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 2 15:15:11 2022] GET /identity/v3/projects/3f5199ad4b6b4534bfa9c94c6da85f3e => generated 298 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:12.072329 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1942c-4fd6-4936-a570-692427238c75 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:12.072630 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1942c-4fd6-4936-a570-692427238c75 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:12.072919 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1942c-4fd6-4936-a570-692427238c75 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:12.074451 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 51/111] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:15:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:15:12.078493 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b3a6fc-b4fb-4be0-83f9-55966ed27b7c None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:12.092193 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa1942c-4fd6-4936-a570-692427238c75 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:12.163910 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3113f8b6-797d-4ea7-9248-e6851b3964f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:12.163910 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113f8b6-797d-4ea7-9248-e6851b3964f4 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:12.163910 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113f8b6-797d-4ea7-9248-e6851b3964f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:12.164345 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113f8b6-797d-4ea7-9248-e6851b3964f4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:12.183854 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3113f8b6-797d-4ea7-9248-e6851b3964f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:15:12.193256 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-3113f8b6-797d-4ea7-9248-e6851b3964f4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 15:15:12.193256 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:15:12.193256 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:15:12.193256 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:15:12.193256 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:15:12.193256 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:15:12.193256 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:15:12.193256 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:15:12.193256 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:15:12.193256 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:15:12.193256 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:15:12.193256 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:15:12.193256 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:15:12.193256 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:15:12.193256 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:15:12.193256 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:15:12.194712 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:15:12.194712 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:15:12.194712 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:15:12.194712 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:15:12.194712 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:15:12.194712 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:15:12.194712 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:15:12.194712 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:15:12.194712 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:15:12.194712 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:15:12.194712 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:15:12.194712 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:15:12.194712 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:15:12.194712 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:15:12.194712 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:15:12.194712 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:15:12.195493 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:15:12.195493 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:15:12.195493 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:15:12.195493 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:15:12.195493 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:15:12.195493 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:15:12.195493 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:15:12.195493 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:15:12.195493 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:15:12.195493 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:15:12.195493 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 15:15:12.195493 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:15:12.195493 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 61/112] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Aug 2 15:15:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 15:15:12.200089 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d76b6-bd54-4c00-ab06-7f0831beb30e None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:12.200341 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d76b6-bd54-4c00-ab06-7f0831beb30e None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:12.200629 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d76b6-bd54-4c00-ab06-7f0831beb30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:12.232295 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-3d1d76b6-bd54-4c00-ab06-7f0831beb30e None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:15:12.233624 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-3d1d76b6-bd54-4c00-ab06-7f0831beb30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:15:12.258105 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:12.258843 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa1942c-4fd6-4936-a570-692427238c75 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:12.285897 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:12.299236 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70c08c-e47f-4da8-8b45-9b328b688702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:12.299867 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70c08c-e47f-4da8-8b45-9b328b688702 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:12.300444 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70c08c-e47f-4da8-8b45-9b328b688702 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:12.300444 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70c08c-e47f-4da8-8b45-9b328b688702 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:12.301357 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc70c08c-e47f-4da8-8b45-9b328b688702 None admin] RBAC: Adding query filter params (role.id=f3287619b177442b8bf83cf5f376b897, scope.project.id=3f5199ad4b6b4534bfa9c94c6da85f3e, user.id=8deb58b82f244801b76925e67e60f252) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:12.301644 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc70c08c-e47f-4da8-8b45-9b328b688702 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:12.303284 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc70c08c-e47f-4da8-8b45-9b328b688702 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:12.310415 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 52/113] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 2 15:15:12 2022] GET /identity/v3/role_assignments?user.id=8deb58b82f244801b76925e67e60f252&scope.project.id=3f5199ad4b6b4534bfa9c94c6da85f3e&role.id=f3287619b177442b8bf83cf5f376b897 => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:12.315776 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 62/114] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:15:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:15:12.317750 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd31172-3ccd-49f3-b602-b2f428a9218b None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:12.318206 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd31172-3ccd-49f3-b602-b2f428a9218b None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:12.318637 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd31172-3ccd-49f3-b602-b2f428a9218b None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:12.320189 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70c08c-e47f-4da8-8b45-9b328b688702 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:12.321213 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 63/115] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:15:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:15:12.348922 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893eea9-12a9-4642-9259-ffbb760337cf None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:12.349569 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893eea9-12a9-4642-9259-ffbb760337cf None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:12.350011 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893eea9-12a9-4642-9259-ffbb760337cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:12.400327 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-5893eea9-12a9-4642-9259-ffbb760337cf None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:15:12.406538 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-5893eea9-12a9-4642-9259-ffbb760337cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:15:12.533877 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 64/116] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:15:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 15:15:12.534547 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5893eea9-12a9-4642-9259-ffbb760337cf None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:12.557953 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70c08c-e47f-4da8-8b45-9b328b688702 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:12.620484 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598dea68-5994-4ac2-ba73-20032a0c058e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:12.620681 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598dea68-5994-4ac2-ba73-20032a0c058e None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:12.620946 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598dea68-5994-4ac2-ba73-20032a0c058e None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:12.621305 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598dea68-5994-4ac2-ba73-20032a0c058e None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:12.622153 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598dea68-5994-4ac2-ba73-20032a0c058e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:12.622489 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598dea68-5994-4ac2-ba73-20032a0c058e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:12.624414 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598dea68-5994-4ac2-ba73-20032a0c058e None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:12.634203 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 53/117] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 2 15:15:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:12.635049 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598dea68-5994-4ac2-ba73-20032a0c058e None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:12.641936 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:12.660444 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5893eea9-12a9-4642-9259-ffbb760337cf None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:12.702650 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3331b428-3644-418e-a75a-d893d53006c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:12.704477 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331b428-3644-418e-a75a-d893d53006c4 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:12.705090 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331b428-3644-418e-a75a-d893d53006c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:12.705770 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331b428-3644-418e-a75a-d893d53006c4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:12.720581 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:12.730376 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3331b428-3644-418e-a75a-d893d53006c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:15:12.737992 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-3331b428-3644-418e-a75a-d893d53006c4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 15:15:12.737992 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:15:12.737992 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:15:12.737992 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:15:12.737992 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:15:12.737992 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:15:12.737992 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:15:12.737992 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:15:12.737992 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:15:12.737992 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:15:12.737992 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:15:12.737992 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:15:12.737992 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:15:12.737992 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:15:12.737992 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:15:12.737992 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:15:12.738969 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:15:12.738969 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:15:12.738969 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:15:12.738969 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:15:12.738969 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:15:12.738969 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:15:12.738969 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:15:12.738969 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:15:12.738969 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:15:12.738969 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:15:12.738969 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:15:12.738969 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:15:12.738969 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:15:12.738969 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:15:12.738969 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:15:12.738969 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:15:12.739804 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:15:12.739804 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:15:12.739804 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:15:12.739804 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:15:12.739804 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:15:12.739804 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:15:12.739804 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:15:12.739804 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:15:12.739804 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:15:12.739804 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:15:12.739804 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 15:15:12.739804 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:15:12.741081 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 65/118] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 2 15:15:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:15:12.744105 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3331b428-3644-418e-a75a-d893d53006c4 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:12.795532 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598dea68-5994-4ac2-ba73-20032a0c058e None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:12.841156 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ade431-8754-4b92-8f16-2b2959500081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:12.842452 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ade431-8754-4b92-8f16-2b2959500081 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:12.842967 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ade431-8754-4b92-8f16-2b2959500081 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:12.843595 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ade431-8754-4b92-8f16-2b2959500081 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:12.857686 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ade431-8754-4b92-8f16-2b2959500081 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:15:12.864767 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-56ade431-8754-4b92-8f16-2b2959500081 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 15:15:12.864767 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:15:12.864767 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:15:12.864767 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:15:12.864767 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:15:12.864767 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:15:12.864767 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:15:12.864767 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:15:12.864767 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:15:12.864767 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:15:12.864767 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:15:12.864767 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:15:12.864767 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:15:12.864767 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:15:12.864767 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:15:12.864767 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:15:12.865627 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:15:12.865627 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:15:12.865627 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:15:12.865627 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:15:12.865627 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:15:12.865627 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:15:12.865627 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:15:12.865627 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:15:12.865627 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:15:12.865627 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:15:12.865627 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:15:12.865627 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:15:12.865627 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:15:12.865627 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:15:12.865627 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:15:12.865627 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:15:12.866420 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:15:12.866420 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:15:12.866420 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:15:12.866420 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:15:12.866420 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:15:12.866420 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:15:12.866420 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:15:12.866420 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:15:12.866420 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:15:12.866420 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:15:12.866420 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 15:15:12.866420 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:15:12.868758 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 54/119] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 2 15:15:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:15:12.870189 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d149fc-66e7-4644-b215-50efd339bcca None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:12.870676 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d149fc-66e7-4644-b215-50efd339bcca None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:12.871083 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d149fc-66e7-4644-b215-50efd339bcca None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:12.872529 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 55/120] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:15:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:15:12.873363 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d149fc-66e7-4644-b215-50efd339bcca None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:12.889291 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3331b428-3644-418e-a75a-d893d53006c4 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:12.929205 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf001ce-c2b2-4370-9d43-5495d13eb43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:12.929882 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf001ce-c2b2-4370-9d43-5495d13eb43a None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:12.930216 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf001ce-c2b2-4370-9d43-5495d13eb43a None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:12.930500 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf001ce-c2b2-4370-9d43-5495d13eb43a None admin] PATH_INFO: `/v3/users/c6226fdf121845309b74b8c58d113534` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:12.931841 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf001ce-c2b2-4370-9d43-5495d13eb43a None admin] RBAC: Authorizing `identity:get_user(user_id=c6226fdf121845309b74b8c58d113534)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:12.933913 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf001ce-c2b2-4370-9d43-5495d13eb43a None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:12.935762 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 66/121] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 2 15:15:12 2022] GET /identity/v3/users/c6226fdf121845309b74b8c58d113534 => generated 275 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:12.941847 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf001ce-c2b2-4370-9d43-5495d13eb43a None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:12.963626 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:13.025276 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d149fc-66e7-4644-b215-50efd339bcca None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:13.039044 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:13.073069 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c53eecb-4399-41b4-ad3c-35b68d5416dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:13.074018 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c53eecb-4399-41b4-ad3c-35b68d5416dc None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:13.074362 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf001ce-c2b2-4370-9d43-5495d13eb43a None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:13.074618 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c53eecb-4399-41b4-ad3c-35b68d5416dc None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:13.075044 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c53eecb-4399-41b4-ad3c-35b68d5416dc None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:13.076021 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c53eecb-4399-41b4-ad3c-35b68d5416dc None admin] RBAC: Adding query filter params (name=member) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:13.076484 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c53eecb-4399-41b4-ad3c-35b68d5416dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:13.078098 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c53eecb-4399-41b4-ad3c-35b68d5416dc None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:13.088191 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 56/122] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 2 15:15:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:13.089695 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b9a26-2bb6-4eb0-9265-78956c1c9739 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:13.090148 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b9a26-2bb6-4eb0-9265-78956c1c9739 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:13.090567 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b9a26-2bb6-4eb0-9265-78956c1c9739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:13.109854 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-b83b9a26-2bb6-4eb0-9265-78956c1c9739 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:15:13.111726 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-b83b9a26-2bb6-4eb0-9265-78956c1c9739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:15:13.116454 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dd4807-5585-4508-b931-b9228f730ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:13.117218 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd4807-5585-4508-b931-b9228f730ed5 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:13.117603 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd4807-5585-4508-b931-b9228f730ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:13.117983 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd4807-5585-4508-b931-b9228f730ed5 None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:13.118824 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dd4807-5585-4508-b931-b9228f730ed5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:13.119243 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dd4807-5585-4508-b931-b9228f730ed5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:13.120792 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dd4807-5585-4508-b931-b9228f730ed5 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:13.138897 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 67/123] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 2 15:15:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:13.138897 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dd4807-5585-4508-b931-b9228f730ed5 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:13.201886 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 57/124] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:15:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:15:13.208113 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83b9a26-2bb6-4eb0-9265-78956c1c9739 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:13.235437 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:13.262930 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dd4807-5585-4508-b931-b9228f730ed5 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:13.301970 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bae17c5-e712-4d58-ae6f-2107988cb5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:13.303021 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae17c5-e712-4d58-ae6f-2107988cb5a9 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:13.304110 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae17c5-e712-4d58-ae6f-2107988cb5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:13.304605 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae17c5-e712-4d58-ae6f-2107988cb5a9 None admin] PATH_INFO: `/v3/projects/3f5199ad4b6b4534bfa9c94c6da85f3e` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:13.306040 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bae17c5-e712-4d58-ae6f-2107988cb5a9 None admin] RBAC: Authorizing `identity:get_project(project_id=3f5199ad4b6b4534bfa9c94c6da85f3e)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:13.307926 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bae17c5-e712-4d58-ae6f-2107988cb5a9 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:13.310058 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 68/125] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 2 15:15:13 2022] GET /identity/v3/projects/3f5199ad4b6b4534bfa9c94c6da85f3e => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:13.315599 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bae17c5-e712-4d58-ae6f-2107988cb5a9 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:13.335131 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:13.338464 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83b9a26-2bb6-4eb0-9265-78956c1c9739 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:13.377329 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf72ba-f565-4d20-8cad-319a68588f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:13.377914 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf72ba-f565-4d20-8cad-319a68588f16 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:13.378200 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf72ba-f565-4d20-8cad-319a68588f16 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:13.378477 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf72ba-f565-4d20-8cad-319a68588f16 None admin] PATH_INFO: `/v3/users/c6226fdf121845309b74b8c58d113534` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:13.379687 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cf72ba-f565-4d20-8cad-319a68588f16 None admin] RBAC: Authorizing `identity:get_user(user_id=c6226fdf121845309b74b8c58d113534)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:13.382070 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cf72ba-f565-4d20-8cad-319a68588f16 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:13.383504 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 58/126] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 2 15:15:13 2022] GET /identity/v3/users/c6226fdf121845309b74b8c58d113534 => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:13.384288 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf72ba-f565-4d20-8cad-319a68588f16 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:13.436987 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bae17c5-e712-4d58-ae6f-2107988cb5a9 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:13.476778 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdac15a5-a0e7-4d43-8f01-0193badd6c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:13.477852 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac15a5-a0e7-4d43-8f01-0193badd6c2c None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:13.478342 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac15a5-a0e7-4d43-8f01-0193badd6c2c None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:13.478876 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac15a5-a0e7-4d43-8f01-0193badd6c2c None admin] PATH_INFO: `/v3/users/c6226fdf121845309b74b8c58d113534` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:13.480394 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdac15a5-a0e7-4d43-8f01-0193badd6c2c None admin] RBAC: Authorizing `identity:get_user(user_id=c6226fdf121845309b74b8c58d113534)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:13.482204 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdac15a5-a0e7-4d43-8f01-0193badd6c2c None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:13.484225 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 69/127] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 2 15:15:13 2022] GET /identity/v3/users/c6226fdf121845309b74b8c58d113534 => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:13.485281 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdac15a5-a0e7-4d43-8f01-0193badd6c2c None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:13.502692 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf72ba-f565-4d20-8cad-319a68588f16 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:13.509108 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:13.548949 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7399ff-3b5b-457b-bce0-faaaab3d06ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:13.550362 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7399ff-3b5b-457b-bce0-faaaab3d06ca None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:13.550934 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7399ff-3b5b-457b-bce0-faaaab3d06ca None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:13.551756 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7399ff-3b5b-457b-bce0-faaaab3d06ca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:13.568861 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7399ff-3b5b-457b-bce0-faaaab3d06ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:15:13.580090 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-8d7399ff-3b5b-457b-bce0-faaaab3d06ca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 15:15:13.580090 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:15:13.580090 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:15:13.580090 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:15:13.580090 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:15:13.580090 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:15:13.580090 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:15:13.580090 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:15:13.580090 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:15:13.580090 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:15:13.580090 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:15:13.580090 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:15:13.580090 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:15:13.580090 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:15:13.580090 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:15:13.580090 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:15:13.581523 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:15:13.581523 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:15:13.581523 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:15:13.581523 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:15:13.581523 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:15:13.581523 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:15:13.581523 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:15:13.581523 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:15:13.581523 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:15:13.581523 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:15:13.581523 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:15:13.581523 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:15:13.581523 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:15:13.581523 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:15:13.581523 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:15:13.581523 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:15:13.582269 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:15:13.582269 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:15:13.582269 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:15:13.582269 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:15:13.582269 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:15:13.582269 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:15:13.582269 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:15:13.582269 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:15:13.582269 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:15:13.582269 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:15:13.582269 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 15:15:13.582269 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:15:13.584794 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 59/128] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 2 15:15:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:15:13.585430 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7399ff-3b5b-457b-bce0-faaaab3d06ca None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:13.627446 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:13.635885 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdac15a5-a0e7-4d43-8f01-0193badd6c2c None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:13.681338 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e6594a-62ca-4b3c-8b48-71163521934c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:13.682094 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6594a-62ca-4b3c-8b48-71163521934c None admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:13.682380 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6594a-62ca-4b3c-8b48-71163521934c None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:13.682657 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6594a-62ca-4b3c-8b48-71163521934c None admin] PATH_INFO: `/v3/projects/3f5199ad4b6b4534bfa9c94c6da85f3e/users/c6226fdf121845309b74b8c58d113534/roles/3e1c8e0567ff4244aef0d6a62fc8b18d` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:13.685555 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e6594a-62ca-4b3c-8b48-71163521934c None admin] RBAC: Authorizing `identity:create_grant(project_id=3f5199ad4b6b4534bfa9c94c6da85f3e, user_id=c6226fdf121845309b74b8c58d113534, role_id=3e1c8e0567ff4244aef0d6a62fc8b18d)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:13.687398 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e6594a-62ca-4b3c-8b48-71163521934c None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:13.706456 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 70/129] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 2 15:15:13 2022] PUT /identity/v3/projects/3f5199ad4b6b4534bfa9c94c6da85f3e/users/c6226fdf121845309b74b8c58d113534/roles/3e1c8e0567ff4244aef0d6a62fc8b18d => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:15:13.707338 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e6594a-62ca-4b3c-8b48-71163521934c None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:13.753760 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7399ff-3b5b-457b-bce0-faaaab3d06ca None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:13.801663 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:13.831022 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a036a051-b2eb-460c-a6a5-6e4199c6b731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:13.832276 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036a051-b2eb-460c-a6a5-6e4199c6b731 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:13.832910 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036a051-b2eb-460c-a6a5-6e4199c6b731 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:13.833401 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036a051-b2eb-460c-a6a5-6e4199c6b731 None admin] PATH_INFO: `/v3/projects/14904f87911d4aefba46cdbd07ff0c43` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:13.835800 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a036a051-b2eb-460c-a6a5-6e4199c6b731 None admin] RBAC: Authorizing `identity:get_project(project_id=14904f87911d4aefba46cdbd07ff0c43)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:13.837699 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a036a051-b2eb-460c-a6a5-6e4199c6b731 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:13.839870 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 60/130] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 2 15:15:13 2022] GET /identity/v3/projects/14904f87911d4aefba46cdbd07ff0c43 => generated 312 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:13.841089 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a036a051-b2eb-460c-a6a5-6e4199c6b731 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:13.853796 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e6594a-62ca-4b3c-8b48-71163521934c None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:13.904243 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58f48a4-5999-490d-9eeb-5223e50697e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:13.904667 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f48a4-5999-490d-9eeb-5223e50697e6 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:13.904979 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f48a4-5999-490d-9eeb-5223e50697e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:13.905265 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f48a4-5999-490d-9eeb-5223e50697e6 None admin] PATH_INFO: `/v3/projects/3f5199ad4b6b4534bfa9c94c6da85f3e` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:13.906925 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58f48a4-5999-490d-9eeb-5223e50697e6 None admin] RBAC: Authorizing `identity:get_project(project_id=3f5199ad4b6b4534bfa9c94c6da85f3e)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:13.908474 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58f48a4-5999-490d-9eeb-5223e50697e6 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:13.910255 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 71/131] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 2 15:15:13 2022] GET /identity/v3/projects/3f5199ad4b6b4534bfa9c94c6da85f3e => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:13.912180 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f69137-fe9b-4038-a6cd-9674d352812f None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:13.912478 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f69137-fe9b-4038-a6cd-9674d352812f None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:13.913614 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f69137-fe9b-4038-a6cd-9674d352812f None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:13.918494 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 72/132] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:15:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:15:13.918494 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f69137-fe9b-4038-a6cd-9674d352812f None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:13.974551 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:13.982456 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a036a051-b2eb-460c-a6a5-6e4199c6b731 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:14.018023 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bae673-e19d-414a-861a-76e833ffdb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:14.019010 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bae673-e19d-414a-861a-76e833ffdb6a None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:14.019516 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bae673-e19d-414a-861a-76e833ffdb6a None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:14.020021 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bae673-e19d-414a-861a-76e833ffdb6a None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:14.020937 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bae673-e19d-414a-861a-76e833ffdb6a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:14.021446 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bae673-e19d-414a-861a-76e833ffdb6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:14.023581 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bae673-e19d-414a-861a-76e833ffdb6a None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:14.033258 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 61/133] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 2 15:15:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:14.034455 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bae673-e19d-414a-861a-76e833ffdb6a None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:14.037297 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f69137-fe9b-4038-a6cd-9674d352812f None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:14.074278 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf28940-2a8a-41f3-9ef3-55eca6fe8685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:14.074963 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf28940-2a8a-41f3-9ef3-55eca6fe8685 None admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:14.075272 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf28940-2a8a-41f3-9ef3-55eca6fe8685 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:14.075562 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf28940-2a8a-41f3-9ef3-55eca6fe8685 None admin] PATH_INFO: `/v3/projects/14904f87911d4aefba46cdbd07ff0c43/users/c6226fdf121845309b74b8c58d113534/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:14.077728 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf28940-2a8a-41f3-9ef3-55eca6fe8685 None admin] RBAC: Authorizing `identity:create_grant(project_id=14904f87911d4aefba46cdbd07ff0c43, user_id=c6226fdf121845309b74b8c58d113534, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:14.079225 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf28940-2a8a-41f3-9ef3-55eca6fe8685 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:14.092036 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:14.101992 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 73/134] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 2 15:15:13 2022] PUT /identity/v3/projects/14904f87911d4aefba46cdbd07ff0c43/users/c6226fdf121845309b74b8c58d113534/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:15:14.106030 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8dee34-8ef3-40c6-8288-db699dc96df0 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:14.108210 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8dee34-8ef3-40c6-8288-db699dc96df0 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:14.108784 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8dee34-8ef3-40c6-8288-db699dc96df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:14.164532 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-3e8dee34-8ef3-40c6-8288-db699dc96df0 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:15:14.167472 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-3e8dee34-8ef3-40c6-8288-db699dc96df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:15:14.246153 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bae673-e19d-414a-861a-76e833ffdb6a None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:14.270172 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 74/135] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:15:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:15:14.275607 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8dee34-8ef3-40c6-8288-db699dc96df0 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:14.318964 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa64ff6-3ef3-4b80-b30f-c190032b033a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:14.320044 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa64ff6-3ef3-4b80-b30f-c190032b033a None admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:14.320539 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa64ff6-3ef3-4b80-b30f-c190032b033a None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:14.321012 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa64ff6-3ef3-4b80-b30f-c190032b033a None admin] PATH_INFO: `/v3/projects/3f5199ad4b6b4534bfa9c94c6da85f3e/users/c6226fdf121845309b74b8c58d113534/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:14.323374 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa64ff6-3ef3-4b80-b30f-c190032b033a None admin] RBAC: Authorizing `identity:create_grant(project_id=3f5199ad4b6b4534bfa9c94c6da85f3e, user_id=c6226fdf121845309b74b8c58d113534, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:14.325235 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa64ff6-3ef3-4b80-b30f-c190032b033a None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:14.343695 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 62/136] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 2 15:15:14 2022] PUT /identity/v3/projects/3f5199ad4b6b4534bfa9c94c6da85f3e/users/c6226fdf121845309b74b8c58d113534/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:15:14.345294 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa64ff6-3ef3-4b80-b30f-c190032b033a None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:14.369181 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:14.433358 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8dee34-8ef3-40c6-8288-db699dc96df0 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:14.485045 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:14.501223 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4994c9dc-f565-41eb-bd91-b85f0b41f755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:14.501902 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4994c9dc-f565-41eb-bd91-b85f0b41f755 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:14.502193 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4994c9dc-f565-41eb-bd91-b85f0b41f755 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:14.502476 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4994c9dc-f565-41eb-bd91-b85f0b41f755 None admin] PATH_INFO: `/v3/users/f4dc4eb9d79745cba683d968af36705d` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:14.504039 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4994c9dc-f565-41eb-bd91-b85f0b41f755 None admin] RBAC: Authorizing `identity:get_user(user_id=f4dc4eb9d79745cba683d968af36705d)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:14.505388 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4994c9dc-f565-41eb-bd91-b85f0b41f755 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:14.507763 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 75/137] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 2 15:15:14 2022] GET /identity/v3/users/f4dc4eb9d79745cba683d968af36705d => generated 247 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:14.513321 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4994c9dc-f565-41eb-bd91-b85f0b41f755 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:14.521720 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa64ff6-3ef3-4b80-b30f-c190032b033a None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:14.591963 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709ba66-2494-4254-b9a3-174878366844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:14.592642 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709ba66-2494-4254-b9a3-174878366844 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:14.593147 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709ba66-2494-4254-b9a3-174878366844 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:14.593436 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709ba66-2494-4254-b9a3-174878366844 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:14.597616 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c709ba66-2494-4254-b9a3-174878366844 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:14.599135 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c709ba66-2494-4254-b9a3-174878366844 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:14.600956 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 63/138] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:15:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:14.607069 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709ba66-2494-4254-b9a3-174878366844 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:14.710699 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4994c9dc-f565-41eb-bd91-b85f0b41f755 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:14.755577 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:14.775538 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709ba66-2494-4254-b9a3-174878366844 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:14.778866 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d3ce0d-c7ec-49a6-8f59-bb5f5985cb2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:14.779552 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d3ce0d-c7ec-49a6-8f59-bb5f5985cb2e None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:14.779833 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d3ce0d-c7ec-49a6-8f59-bb5f5985cb2e None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:14.780107 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d3ce0d-c7ec-49a6-8f59-bb5f5985cb2e None admin] PATH_INFO: `/v3/projects/3f5199ad4b6b4534bfa9c94c6da85f3e` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:14.782889 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d3ce0d-c7ec-49a6-8f59-bb5f5985cb2e None admin] RBAC: Authorizing `identity:get_project(project_id=3f5199ad4b6b4534bfa9c94c6da85f3e)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:14.787494 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d3ce0d-c7ec-49a6-8f59-bb5f5985cb2e None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:14.789764 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 76/139] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 2 15:15:14 2022] GET /identity/v3/projects/3f5199ad4b6b4534bfa9c94c6da85f3e => generated 298 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:15:14.791077 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63eb458-665b-4a73-ae7d-c3cbaabbe300 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:14.791388 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63eb458-665b-4a73-ae7d-c3cbaabbe300 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:14.791669 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63eb458-665b-4a73-ae7d-c3cbaabbe300 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:14.798409 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 77/140] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:15:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:15:14.799270 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63eb458-665b-4a73-ae7d-c3cbaabbe300 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:14.847260 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa4832-2bfb-49d2-9879-8d54eb548e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:14.847260 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa4832-2bfb-49d2-9879-8d54eb548e1f None admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:14.847260 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa4832-2bfb-49d2-9879-8d54eb548e1f None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:14.847260 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa4832-2bfb-49d2-9879-8d54eb548e1f None admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:14.847663 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daa4832-2bfb-49d2-9879-8d54eb548e1f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:14.847964 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daa4832-2bfb-49d2-9879-8d54eb548e1f None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:14.876218 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 64/141] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Aug 2 15:15:14 2022] POST /identity/v3/users => generated 283 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:15:14.877495 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2dcbc-650b-40c5-971b-22fd2a34664c None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:14.877793 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2dcbc-650b-40c5-971b-22fd2a34664c None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:14.878074 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2dcbc-650b-40c5-971b-22fd2a34664c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:14.919483 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-e7e2dcbc-650b-40c5-971b-22fd2a34664c None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:15:14.920782 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-e7e2dcbc-650b-40c5-971b-22fd2a34664c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:15:14.956087 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:15.034769 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63eb458-665b-4a73-ae7d-c3cbaabbe300 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:15.060253 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 65/142] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:15:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:15:15.085523 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac0ff9-27ff-42b0-b6e5-9a5a29f0b51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:15.086211 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac0ff9-27ff-42b0-b6e5-9a5a29f0b51c None admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:15.086494 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac0ff9-27ff-42b0-b6e5-9a5a29f0b51c None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:15.086766 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac0ff9-27ff-42b0-b6e5-9a5a29f0b51c None admin] PATH_INFO: `/v3/projects/3f5199ad4b6b4534bfa9c94c6da85f3e/users/f4dc4eb9d79745cba683d968af36705d/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:15.088752 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ac0ff9-27ff-42b0-b6e5-9a5a29f0b51c None admin] RBAC: Authorizing `identity:create_grant(project_id=3f5199ad4b6b4534bfa9c94c6da85f3e, user_id=f4dc4eb9d79745cba683d968af36705d, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:15.090221 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ac0ff9-27ff-42b0-b6e5-9a5a29f0b51c None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:15.107465 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 78/143] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 2 15:15:14 2022] PUT /identity/v3/projects/3f5199ad4b6b4534bfa9c94c6da85f3e/users/f4dc4eb9d79745cba683d968af36705d/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:15:15.110130 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e2dcbc-650b-40c5-971b-22fd2a34664c None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:15.245569 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:15.297260 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e2dcbc-650b-40c5-971b-22fd2a34664c None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:15.350055 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0875a0df-bc8d-4d04-b364-386a352d26a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:15.351335 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875a0df-bc8d-4d04-b364-386a352d26a7 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:15.353558 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875a0df-bc8d-4d04-b364-386a352d26a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:15.353558 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875a0df-bc8d-4d04-b364-386a352d26a7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:15.364942 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0875a0df-bc8d-4d04-b364-386a352d26a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:15:15.370661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-0875a0df-bc8d-4d04-b364-386a352d26a7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 15:15:15.370661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:15:15.370661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:15:15.370661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:15:15.370661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:15:15.370661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:15:15.370661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:15:15.370661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:15:15.370661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:15:15.370661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:15:15.370661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:15:15.370661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:15:15.370661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:15:15.370661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:15:15.370661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:15:15.370661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:15:15.371560 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:15:15.371560 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:15:15.371560 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:15:15.371560 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:15:15.371560 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:15:15.371560 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:15:15.371560 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:15:15.371560 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:15:15.371560 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:15:15.371560 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:15:15.371560 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:15:15.371560 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:15:15.371560 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:15:15.371560 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:15:15.371560 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:15:15.371560 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:15:15.372769 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:15:15.372769 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:15:15.372769 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:15:15.372769 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:15:15.372769 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:15:15.372769 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:15:15.372769 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:15:15.372769 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:15:15.372769 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:15:15.372769 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:15:15.372769 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 15:15:15.372769 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:15:15.372769 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 66/144] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 2 15:15:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:15:15.378058 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac0ff9-27ff-42b0-b6e5-9a5a29f0b51c None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:15.486884 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac0ff9-27ff-42b0-b6e5-9a5a29f0b51c None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:15.523615 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:15.529663 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d2f481-cdbf-4afb-a953-68dd1ff8ba9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:15.530300 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d2f481-cdbf-4afb-a953-68dd1ff8ba9d None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:15.530580 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d2f481-cdbf-4afb-a953-68dd1ff8ba9d None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:15.530842 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d2f481-cdbf-4afb-a953-68dd1ff8ba9d None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:15.531654 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d2f481-cdbf-4afb-a953-68dd1ff8ba9d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:15.534598 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d2f481-cdbf-4afb-a953-68dd1ff8ba9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:15.536339 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d2f481-cdbf-4afb-a953-68dd1ff8ba9d None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:15.550291 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 79/145] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 2 15:15:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:15.556157 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0875a0df-bc8d-4d04-b364-386a352d26a7 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:15.676113 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0875a0df-bc8d-4d04-b364-386a352d26a7 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:15.715343 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:15.722003 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9051e4-8f64-494a-9888-0d687a8e4ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:15.722891 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9051e4-8f64-494a-9888-0d687a8e4ca7 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:15.723438 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9051e4-8f64-494a-9888-0d687a8e4ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:15.723765 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9051e4-8f64-494a-9888-0d687a8e4ca7 None admin] PATH_INFO: `/v3/users/8deb58b82f244801b76925e67e60f252` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:15.724996 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9051e4-8f64-494a-9888-0d687a8e4ca7 None admin] RBAC: Authorizing `identity:get_user(user_id=8deb58b82f244801b76925e67e60f252)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:15.727017 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9051e4-8f64-494a-9888-0d687a8e4ca7 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:15.729042 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 67/146] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 2 15:15:15 2022] GET /identity/v3/users/8deb58b82f244801b76925e67e60f252 => generated 289 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:15.735286 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d2f481-cdbf-4afb-a953-68dd1ff8ba9d None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:15.849358 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d2f481-cdbf-4afb-a953-68dd1ff8ba9d None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:15.887959 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1534d9b0-bfc2-4adc-9d67-f823768784d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:15.888799 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534d9b0-bfc2-4adc-9d67-f823768784d6 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:15.889091 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534d9b0-bfc2-4adc-9d67-f823768784d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:15.889371 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534d9b0-bfc2-4adc-9d67-f823768784d6 None admin] PATH_INFO: `/v3/projects/3f5199ad4b6b4534bfa9c94c6da85f3e` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:15.890787 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1534d9b0-bfc2-4adc-9d67-f823768784d6 None admin] RBAC: Authorizing `identity:get_project(project_id=3f5199ad4b6b4534bfa9c94c6da85f3e)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:15.892428 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1534d9b0-bfc2-4adc-9d67-f823768784d6 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:15.894405 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 80/147] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 2 15:15:15 2022] GET /identity/v3/projects/3f5199ad4b6b4534bfa9c94c6da85f3e => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:15.902033 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9051e4-8f64-494a-9888-0d687a8e4ca7 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:16.025368 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9051e4-8f64-494a-9888-0d687a8e4ca7 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:16.067910 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d839e-693e-4614-b943-3eb59bdc16f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:16.068607 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d839e-693e-4614-b943-3eb59bdc16f6 None admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:16.069480 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d839e-693e-4614-b943-3eb59bdc16f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:16.069758 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d839e-693e-4614-b943-3eb59bdc16f6 None admin] PATH_INFO: `/v3/projects/3f5199ad4b6b4534bfa9c94c6da85f3e/users/8deb58b82f244801b76925e67e60f252/roles/f3287619b177442b8bf83cf5f376b897` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:16.071801 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330d839e-693e-4614-b943-3eb59bdc16f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=3f5199ad4b6b4534bfa9c94c6da85f3e, user_id=8deb58b82f244801b76925e67e60f252, role_id=f3287619b177442b8bf83cf5f376b897)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:16.073276 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330d839e-693e-4614-b943-3eb59bdc16f6 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:16.092746 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 68/148] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 2 15:15:15 2022] PUT /identity/v3/projects/3f5199ad4b6b4534bfa9c94c6da85f3e/users/8deb58b82f244801b76925e67e60f252/roles/f3287619b177442b8bf83cf5f376b897 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 15:15:16.251570 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42add7d3-07c1-4ba0-9dcb-8beab7fa64a8 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:16.251911 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42add7d3-07c1-4ba0-9dcb-8beab7fa64a8 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:16.252130 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42add7d3-07c1-4ba0-9dcb-8beab7fa64a8 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:16.253842 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 81/149] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:15:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:15:16.262620 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aec8d3-d04d-4b96-a210-3e7992f31079 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:16.263005 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aec8d3-d04d-4b96-a210-3e7992f31079 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:16.263386 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aec8d3-d04d-4b96-a210-3e7992f31079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:16.290673 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-69aec8d3-d04d-4b96-a210-3e7992f31079 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:15:16.292014 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-69aec8d3-d04d-4b96-a210-3e7992f31079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:15:16.362000 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:16.376311 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 69/150] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:15:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:15:16.405598 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42add7d3-07c1-4ba0-9dcb-8beab7fa64a8 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:16.477572 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:16.536823 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42add7d3-07c1-4ba0-9dcb-8beab7fa64a8 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:16.578344 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa0a83c-ebff-4657-b849-291700185d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:16.579001 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa0a83c-ebff-4657-b849-291700185d63 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:16.579304 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa0a83c-ebff-4657-b849-291700185d63 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:16.579586 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa0a83c-ebff-4657-b849-291700185d63 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:16.591761 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa0a83c-ebff-4657-b849-291700185d63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:15:16.597469 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-2aa0a83c-ebff-4657-b849-291700185d63 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 15:15:16.597469 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:15:16.597469 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:15:16.597469 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:15:16.597469 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:15:16.597469 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:15:16.597469 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:15:16.597469 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:15:16.597469 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:15:16.597469 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:15:16.597469 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:15:16.597469 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:15:16.597469 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:15:16.597469 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:15:16.597469 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:15:16.597469 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:15:16.599551 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:15:16.599551 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:15:16.599551 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:15:16.599551 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:15:16.599551 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:15:16.599551 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:15:16.599551 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:15:16.599551 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:15:16.599551 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:15:16.599551 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:15:16.599551 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:15:16.599551 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:15:16.599551 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:15:16.599551 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:15:16.599551 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:15:16.599551 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:15:16.602120 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:15:16.602120 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:15:16.602120 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:15:16.602120 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:15:16.602120 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:15:16.602120 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:15:16.602120 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:15:16.602120 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:15:16.602120 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:15:16.602120 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:15:16.602120 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 15:15:16.602120 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:15:16.602120 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 82/151] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Aug 2 15:15:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:15:16.608449 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aec8d3-d04d-4b96-a210-3e7992f31079 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:16.725769 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aec8d3-d04d-4b96-a210-3e7992f31079 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:16.765011 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ced9461-aa66-4125-9ae7-c2b484463b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:16.765566 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced9461-aa66-4125-9ae7-c2b484463b05 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:16.765844 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced9461-aa66-4125-9ae7-c2b484463b05 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:16.766115 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced9461-aa66-4125-9ae7-c2b484463b05 None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:16.766846 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ced9461-aa66-4125-9ae7-c2b484463b05 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:16.767149 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ced9461-aa66-4125-9ae7-c2b484463b05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:16.768586 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ced9461-aa66-4125-9ae7-c2b484463b05 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:16.782902 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 70/152] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 2 15:15:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:16.789702 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa0a83c-ebff-4657-b849-291700185d63 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:16.939185 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa0a83c-ebff-4657-b849-291700185d63 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:16.960786 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:16.989957 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf137be8-6eb1-4617-8dc4-595dc3472e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:16.989957 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf137be8-6eb1-4617-8dc4-595dc3472e87 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:16.989957 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf137be8-6eb1-4617-8dc4-595dc3472e87 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:16.989957 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf137be8-6eb1-4617-8dc4-595dc3472e87 None admin] PATH_INFO: `/v3/users/c6226fdf121845309b74b8c58d113534` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:16.990564 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf137be8-6eb1-4617-8dc4-595dc3472e87 None admin] RBAC: Authorizing `identity:get_user(user_id=c6226fdf121845309b74b8c58d113534)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:16.992742 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf137be8-6eb1-4617-8dc4-595dc3472e87 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:16.994695 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 83/153] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 2 15:15:16 2022] GET /identity/v3/users/c6226fdf121845309b74b8c58d113534 => generated 275 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:17.000386 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ced9461-aa66-4125-9ae7-c2b484463b05 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:17.090135 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:17.153131 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ced9461-aa66-4125-9ae7-c2b484463b05 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:17.202398 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c03cdc-251e-456c-b1ac-d96e861f28cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:17.203030 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c03cdc-251e-456c-b1ac-d96e861f28cb None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:17.203334 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c03cdc-251e-456c-b1ac-d96e861f28cb None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:17.203613 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c03cdc-251e-456c-b1ac-d96e861f28cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:17.305874 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c03cdc-251e-456c-b1ac-d96e861f28cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:17.307398 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c03cdc-251e-456c-b1ac-d96e861f28cb None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:17.374988 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:17.446382 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 71/154] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 2 15:15:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 15:15:17.451951 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf137be8-6eb1-4617-8dc4-595dc3472e87 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:17.601225 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf137be8-6eb1-4617-8dc4-595dc3472e87 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:17.646655 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221afe30-e3e0-483a-82cf-8a689b542054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:17.647258 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221afe30-e3e0-483a-82cf-8a689b542054 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:17.647601 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221afe30-e3e0-483a-82cf-8a689b542054 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:17.647867 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221afe30-e3e0-483a-82cf-8a689b542054 None admin] PATH_INFO: `/v3/projects/3f5199ad4b6b4534bfa9c94c6da85f3e` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:17.649038 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221afe30-e3e0-483a-82cf-8a689b542054 None admin] RBAC: Authorizing `identity:get_project(project_id=3f5199ad4b6b4534bfa9c94c6da85f3e)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:17.650515 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221afe30-e3e0-483a-82cf-8a689b542054 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:17.652202 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 84/155] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 2 15:15:17 2022] GET /identity/v3/projects/3f5199ad4b6b4534bfa9c94c6da85f3e => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:17.658200 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c03cdc-251e-456c-b1ac-d96e861f28cb None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:17.802412 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c03cdc-251e-456c-b1ac-d96e861f28cb None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:17.843969 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e257850a-0cc7-472b-9fc7-1b46a19983d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:17.844594 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257850a-0cc7-472b-9fc7-1b46a19983d8 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:17.844874 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257850a-0cc7-472b-9fc7-1b46a19983d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:17.845150 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257850a-0cc7-472b-9fc7-1b46a19983d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:17.845948 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e257850a-0cc7-472b-9fc7-1b46a19983d8 None admin] RBAC: Adding query filter params (role.id=3e1c8e0567ff4244aef0d6a62fc8b18d, scope.project.id=3f5199ad4b6b4534bfa9c94c6da85f3e, user.id=c6226fdf121845309b74b8c58d113534) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:17.846257 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e257850a-0cc7-472b-9fc7-1b46a19983d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:17.847729 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e257850a-0cc7-472b-9fc7-1b46a19983d8 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:17.855878 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 72/156] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 2 15:15:17 2022] GET /identity/v3/role_assignments?user.id=c6226fdf121845309b74b8c58d113534&scope.project.id=3f5199ad4b6b4534bfa9c94c6da85f3e&role.id=3e1c8e0567ff4244aef0d6a62fc8b18d => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:18.030402 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028eada-b4f5-4b2e-a42f-98627a2e659f None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:18.030793 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028eada-b4f5-4b2e-a42f-98627a2e659f None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:18.030963 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028eada-b4f5-4b2e-a42f-98627a2e659f None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:18.032598 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 85/157] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:15:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:15:18.039204 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31621c-9ac0-4dda-9bf6-69ff6e777cb5 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:18.039590 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31621c-9ac0-4dda-9bf6-69ff6e777cb5 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:18.039848 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31621c-9ac0-4dda-9bf6-69ff6e777cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:18.065466 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-cf31621c-9ac0-4dda-9bf6-69ff6e777cb5 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:15:18.066688 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-cf31621c-9ac0-4dda-9bf6-69ff6e777cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:15:18.084946 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:18.153220 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3952525-ea18-47fe-a0a8-2b9619b81ceb None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:18.153547 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3952525-ea18-47fe-a0a8-2b9619b81ceb None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:18.153873 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3952525-ea18-47fe-a0a8-2b9619b81ceb None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:18.157182 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 86/158] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:15:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:15:18.163611 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ed9da-5dfc-4d6d-aa03-d9b7f0a86806 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:18.163974 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ed9da-5dfc-4d6d-aa03-d9b7f0a86806 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:18.164195 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ed9da-5dfc-4d6d-aa03-d9b7f0a86806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:18.177560 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 73/159] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:15:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:15:18.198395 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-7f7ed9da-5dfc-4d6d-aa03-d9b7f0a86806 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:15:18.199646 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-7f7ed9da-5dfc-4d6d-aa03-d9b7f0a86806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:15:18.270414 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf31621c-9ac0-4dda-9bf6-69ff6e777cb5 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:18.280683 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:18.325484 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 87/160] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:15:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:15:18.362773 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ed9da-5dfc-4d6d-aa03-d9b7f0a86806 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:18.408291 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf31621c-9ac0-4dda-9bf6-69ff6e777cb5 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:18.450170 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da279255-8771-4608-86f4-5b955b628e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:18.450835 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da279255-8771-4608-86f4-5b955b628e35 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:18.451117 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da279255-8771-4608-86f4-5b955b628e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:18.455563 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da279255-8771-4608-86f4-5b955b628e35 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:18.468083 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da279255-8771-4608-86f4-5b955b628e35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:15:18.478421 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-da279255-8771-4608-86f4-5b955b628e35 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 15:15:18.478421 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:15:18.478421 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:15:18.478421 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:15:18.478421 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:15:18.478421 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:15:18.478421 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:15:18.478421 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:15:18.478421 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:15:18.478421 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:15:18.478421 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:15:18.478421 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:15:18.478421 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:15:18.478421 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:15:18.478421 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:15:18.478421 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:15:18.479476 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:15:18.479476 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:15:18.479476 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:15:18.479476 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:15:18.479476 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:15:18.479476 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:15:18.479476 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:15:18.479476 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:15:18.479476 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:15:18.479476 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:15:18.479476 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:15:18.479476 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:15:18.479476 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:15:18.479476 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:15:18.479476 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:15:18.479476 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:15:18.480437 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:15:18.480437 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:15:18.480437 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:15:18.480437 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:15:18.480437 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:15:18.480437 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:15:18.480437 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:15:18.480437 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:15:18.480437 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:15:18.480437 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:15:18.480437 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 15:15:18.480437 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:15:18.483475 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 74/161] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 2 15:15:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 15:15:18.505370 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da279255-8771-4608-86f4-5b955b628e35 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:18.527699 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:18.547331 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ed9da-5dfc-4d6d-aa03-d9b7f0a86806 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:18.600900 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c294da-371c-47dd-b33f-010e0ea3d9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:18.601935 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c294da-371c-47dd-b33f-010e0ea3d9fd None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:18.602806 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c294da-371c-47dd-b33f-010e0ea3d9fd None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:18.603234 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c294da-371c-47dd-b33f-010e0ea3d9fd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:18.629603 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c294da-371c-47dd-b33f-010e0ea3d9fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:15:18.637011 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-68c294da-371c-47dd-b33f-010e0ea3d9fd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 15:15:18.637011 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:15:18.637011 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:15:18.637011 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:15:18.637011 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:15:18.637011 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:15:18.637011 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:15:18.637011 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:15:18.637011 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:15:18.637011 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:15:18.637011 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:15:18.637011 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:15:18.637011 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:15:18.637011 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:15:18.637011 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:15:18.637011 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:15:18.638098 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:15:18.638098 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:15:18.638098 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:15:18.638098 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:15:18.638098 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:15:18.638098 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:15:18.638098 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:15:18.638098 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:15:18.638098 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:15:18.638098 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:15:18.638098 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:15:18.638098 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:15:18.638098 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:15:18.638098 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:15:18.638098 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:15:18.638098 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:15:18.639051 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:15:18.639051 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:15:18.639051 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:15:18.639051 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:15:18.639051 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:15:18.639051 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:15:18.639051 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:15:18.639051 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:15:18.639051 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:15:18.639051 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:15:18.639051 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 15:15:18.639051 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:15:18.648731 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 88/162] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 2 15:15:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 15:15:18.657702 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c294da-371c-47dd-b33f-010e0ea3d9fd None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:18.712473 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da279255-8771-4608-86f4-5b955b628e35 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:18.724993 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:18.768055 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c9cd86-c988-4d62-9386-e5573057360a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:18.768393 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9cd86-c988-4d62-9386-e5573057360a None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:18.768673 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9cd86-c988-4d62-9386-e5573057360a None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:18.768949 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9cd86-c988-4d62-9386-e5573057360a None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:18.769686 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c9cd86-c988-4d62-9386-e5573057360a None admin] RBAC: Adding query filter params (name=member) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:18.769988 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c9cd86-c988-4d62-9386-e5573057360a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:18.771421 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c9cd86-c988-4d62-9386-e5573057360a None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:18.786965 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 75/163] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 2 15:15:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:18.806184 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c294da-371c-47dd-b33f-010e0ea3d9fd None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:18.810772 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c9cd86-c988-4d62-9386-e5573057360a None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:18.857790 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcf9a99-4394-419e-a99e-ae4171ed7cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:18.863992 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf9a99-4394-419e-a99e-ae4171ed7cf6 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:18.864529 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf9a99-4394-419e-a99e-ae4171ed7cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:18.865851 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf9a99-4394-419e-a99e-ae4171ed7cf6 None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:18.866998 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcf9a99-4394-419e-a99e-ae4171ed7cf6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:18.867678 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcf9a99-4394-419e-a99e-ae4171ed7cf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:18.870646 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcf9a99-4394-419e-a99e-ae4171ed7cf6 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:18.896043 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 89/164] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 2 15:15:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:18.903654 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcf9a99-4394-419e-a99e-ae4171ed7cf6 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:18.967620 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:19.054168 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcf9a99-4394-419e-a99e-ae4171ed7cf6 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:19.057596 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:19.073206 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c9cd86-c988-4d62-9386-e5573057360a None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:19.101729 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea24c51-0374-490d-8531-6cd4b356fb65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:19.104608 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea24c51-0374-490d-8531-6cd4b356fb65 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:19.106145 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea24c51-0374-490d-8531-6cd4b356fb65 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:19.106818 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea24c51-0374-490d-8531-6cd4b356fb65 None admin] PATH_INFO: `/v3/users/c6226fdf121845309b74b8c58d113534` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:19.110037 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea24c51-0374-490d-8531-6cd4b356fb65 None admin] RBAC: Authorizing `identity:get_user(user_id=c6226fdf121845309b74b8c58d113534)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:19.111832 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea24c51-0374-490d-8531-6cd4b356fb65 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:19.120131 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 90/165] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 2 15:15:18 2022] GET /identity/v3/users/c6226fdf121845309b74b8c58d113534 => generated 275 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:19.123717 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea24c51-0374-490d-8531-6cd4b356fb65 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:19.172055 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27010e98-a2ed-4700-9a73-80b07a8fe31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:19.173093 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27010e98-a2ed-4700-9a73-80b07a8fe31e None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:19.173093 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27010e98-a2ed-4700-9a73-80b07a8fe31e None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:19.173322 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27010e98-a2ed-4700-9a73-80b07a8fe31e None admin] PATH_INFO: `/v3/users/c6226fdf121845309b74b8c58d113534` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:19.175472 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27010e98-a2ed-4700-9a73-80b07a8fe31e None admin] RBAC: Authorizing `identity:get_user(user_id=c6226fdf121845309b74b8c58d113534)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:19.176969 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27010e98-a2ed-4700-9a73-80b07a8fe31e None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:19.183738 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 76/166] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 2 15:15:18 2022] GET /identity/v3/users/c6226fdf121845309b74b8c58d113534 => generated 275 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:15:19.188386 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27010e98-a2ed-4700-9a73-80b07a8fe31e None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:19.278784 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea24c51-0374-490d-8531-6cd4b356fb65 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:19.324251 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f144b436-89e2-49ec-ad06-baf70d2df0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:19.325215 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144b436-89e2-49ec-ad06-baf70d2df0d4 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:19.326075 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144b436-89e2-49ec-ad06-baf70d2df0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:19.326605 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144b436-89e2-49ec-ad06-baf70d2df0d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:19.386665 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:19.421731 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f144b436-89e2-49ec-ad06-baf70d2df0d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:19.423718 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f144b436-89e2-49ec-ad06-baf70d2df0d4 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:19.489238 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27010e98-a2ed-4700-9a73-80b07a8fe31e None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:19.545262 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 91/167] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 2 15:15:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 15:15:19.547236 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72736ab9-9709-416b-8166-759addc3f7f7 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:19.547735 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72736ab9-9709-416b-8166-759addc3f7f7 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:19.548211 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72736ab9-9709-416b-8166-759addc3f7f7 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:19.550171 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 92/168] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:15:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:15:19.551535 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72736ab9-9709-416b-8166-759addc3f7f7 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:19.584694 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e5e165-8086-4e35-ac0d-8268a0aa8de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:19.585273 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5e165-8086-4e35-ac0d-8268a0aa8de4 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:19.585546 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5e165-8086-4e35-ac0d-8268a0aa8de4 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:19.586001 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5e165-8086-4e35-ac0d-8268a0aa8de4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:19.595555 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:19.689503 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e5e165-8086-4e35-ac0d-8268a0aa8de4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:19.691062 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e5e165-8086-4e35-ac0d-8268a0aa8de4 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:19.694810 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:19.742840 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72736ab9-9709-416b-8166-759addc3f7f7 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:19.813839 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7ae5a-7b71-4654-9bca-0d1a2a0463c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:19.814679 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7ae5a-7b71-4654-9bca-0d1a2a0463c6 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:19.815066 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7ae5a-7b71-4654-9bca-0d1a2a0463c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:19.815463 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7ae5a-7b71-4654-9bca-0d1a2a0463c6 None admin] PATH_INFO: `/v3/projects/3f5199ad4b6b4534bfa9c94c6da85f3e` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:19.817471 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c7ae5a-7b71-4654-9bca-0d1a2a0463c6 None admin] RBAC: Authorizing `identity:get_project(project_id=3f5199ad4b6b4534bfa9c94c6da85f3e)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:19.819233 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c7ae5a-7b71-4654-9bca-0d1a2a0463c6 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:19.826025 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 93/169] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 2 15:15:19 2022] GET /identity/v3/projects/3f5199ad4b6b4534bfa9c94c6da85f3e => generated 298 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:19.826025 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee78c74-ce64-48af-800d-f7a6572912e7 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:19.826025 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee78c74-ce64-48af-800d-f7a6572912e7 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:19.826025 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee78c74-ce64-48af-800d-f7a6572912e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:19.833033 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 77/170] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 2 15:15:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 645 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 15:15:19.834987 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a30c1f-9443-43d8-ab39-d99bfe56acc1 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:19.835497 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a30c1f-9443-43d8-ab39-d99bfe56acc1 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:19.835979 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a30c1f-9443-43d8-ab39-d99bfe56acc1 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:19.837786 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 78/171] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:15:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:15:19.838734 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a30c1f-9443-43d8-ab39-d99bfe56acc1 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:19.864308 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-5ee78c74-ce64-48af-800d-f7a6572912e7 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:15:19.865829 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-5ee78c74-ce64-48af-800d-f7a6572912e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:15:19.887582 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:20.006851 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 94/172] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:15:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:15:20.007878 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee78c74-ce64-48af-800d-f7a6572912e7 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:20.031942 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a30c1f-9443-43d8-ab39-d99bfe56acc1 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:20.091054 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:20.098735 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a3c942-21ed-4101-bf67-ab7825f50387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:20.099392 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3c942-21ed-4101-bf67-ab7825f50387 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:20.099674 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3c942-21ed-4101-bf67-ab7825f50387 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:20.099971 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3c942-21ed-4101-bf67-ab7825f50387 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:20.103246 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a3c942-21ed-4101-bf67-ab7825f50387 None admin] RBAC: Adding query filter params (role.id=bf4fcdd92d8a4a6d855f3eaa4f542529, scope.project.id=3f5199ad4b6b4534bfa9c94c6da85f3e, user.id=c6226fdf121845309b74b8c58d113534) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:20.103246 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a3c942-21ed-4101-bf67-ab7825f50387 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:20.103246 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a3c942-21ed-4101-bf67-ab7825f50387 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:20.117733 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 79/173] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 2 15:15:19 2022] GET /identity/v3/role_assignments?user.id=c6226fdf121845309b74b8c58d113534&scope.project.id=3f5199ad4b6b4534bfa9c94c6da85f3e&role.id=bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 608 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:20.119002 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38f822-cb89-4b63-b002-8cb6316f3eaf None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:20.119311 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38f822-cb89-4b63-b002-8cb6316f3eaf None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:20.119590 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38f822-cb89-4b63-b002-8cb6316f3eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:20.130775 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee78c74-ce64-48af-800d-f7a6572912e7 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:20.164888 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-2c38f822-cb89-4b63-b002-8cb6316f3eaf None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:15:20.166442 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-2c38f822-cb89-4b63-b002-8cb6316f3eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:15:20.175484 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7254e919-ec16-469f-b291-126aaac18484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:20.176258 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254e919-ec16-469f-b291-126aaac18484 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:20.176425 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254e919-ec16-469f-b291-126aaac18484 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:20.176760 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254e919-ec16-469f-b291-126aaac18484 None admin] PATH_INFO: `/v3/projects/14904f87911d4aefba46cdbd07ff0c43` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:20.178031 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7254e919-ec16-469f-b291-126aaac18484 None admin] RBAC: Authorizing `identity:get_project(project_id=14904f87911d4aefba46cdbd07ff0c43)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:20.180089 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7254e919-ec16-469f-b291-126aaac18484 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:20.181938 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 95/174] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 2 15:15:20 2022] GET /identity/v3/projects/14904f87911d4aefba46cdbd07ff0c43 => generated 312 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:20.182865 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7254e919-ec16-469f-b291-126aaac18484 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:20.312037 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7254e919-ec16-469f-b291-126aaac18484 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:20.315780 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 80/175] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:15:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:15:20.316813 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c38f822-cb89-4b63-b002-8cb6316f3eaf None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:20.359951 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4b9bc-8ee9-4b0d-ba5d-93d972a59d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:20.361242 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4b9bc-8ee9-4b0d-ba5d-93d972a59d15 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:20.361529 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4b9bc-8ee9-4b0d-ba5d-93d972a59d15 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:20.361807 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4b9bc-8ee9-4b0d-ba5d-93d972a59d15 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:20.362092 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:20.371617 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:20.376703 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe4b9bc-8ee9-4b0d-ba5d-93d972a59d15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:15:20.382123 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-9fe4b9bc-8ee9-4b0d-ba5d-93d972a59d15 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 15:15:20.382123 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:15:20.382123 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:15:20.382123 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:15:20.382123 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:15:20.382123 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:15:20.382123 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:15:20.382123 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:15:20.382123 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:15:20.382123 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:15:20.382123 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:15:20.382123 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:15:20.382123 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:15:20.382123 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:15:20.382123 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:15:20.382123 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:15:20.383011 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:15:20.383011 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:15:20.383011 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:15:20.383011 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:15:20.383011 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:15:20.383011 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:15:20.383011 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:15:20.383011 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:15:20.383011 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:15:20.383011 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:15:20.383011 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:15:20.383011 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:15:20.383011 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:15:20.383011 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:15:20.383011 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:15:20.383011 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:15:20.383841 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:15:20.383841 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:15:20.383841 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:15:20.383841 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:15:20.383841 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:15:20.383841 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:15:20.383841 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:15:20.383841 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:15:20.383841 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:15:20.383841 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:15:20.383841 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 15:15:20.383841 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:15:20.386430 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 96/176] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 2 15:15:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:15:20.386430 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f0baa-831c-472b-898c-77696657a0a0 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:20.386430 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f0baa-831c-472b-898c-77696657a0a0 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:20.386726 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f0baa-831c-472b-898c-77696657a0a0 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:20.388451 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 97/177] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:15:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:15:20.389696 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41879ec6-395c-452f-ba78-39254a6609ab None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:20.391291 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41879ec6-395c-452f-ba78-39254a6609ab None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:20.391291 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41879ec6-395c-452f-ba78-39254a6609ab None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:20.392265 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 98/178] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:15:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:15:20.393083 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41879ec6-395c-452f-ba78-39254a6609ab None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:20.454500 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c38f822-cb89-4b63-b002-8cb6316f3eaf None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:20.489894 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad542d54-e489-4790-9b90-474fbc4c5933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:20.490545 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad542d54-e489-4790-9b90-474fbc4c5933 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:20.491440 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad542d54-e489-4790-9b90-474fbc4c5933 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:20.491702 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad542d54-e489-4790-9b90-474fbc4c5933 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:20.492508 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad542d54-e489-4790-9b90-474fbc4c5933 None admin] RBAC: Adding query filter params (role.id=bf4fcdd92d8a4a6d855f3eaa4f542529, scope.project.id=14904f87911d4aefba46cdbd07ff0c43, user.id=c6226fdf121845309b74b8c58d113534) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:20.492811 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad542d54-e489-4790-9b90-474fbc4c5933 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:20.494273 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad542d54-e489-4790-9b90-474fbc4c5933 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:20.500278 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 81/179] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 2 15:15:20 2022] GET /identity/v3/role_assignments?user.id=c6226fdf121845309b74b8c58d113534&scope.project.id=14904f87911d4aefba46cdbd07ff0c43&role.id=bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:20.501633 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae2f46-2a1b-4933-b6f4-2ce0a8f729d3 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:20.501771 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae2f46-2a1b-4933-b6f4-2ce0a8f729d3 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:20.502018 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae2f46-2a1b-4933-b6f4-2ce0a8f729d3 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:20.503497 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 82/180] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:15:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:15:20.503978 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bae2f46-2a1b-4933-b6f4-2ce0a8f729d3 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:20.510610 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41879ec6-395c-452f-ba78-39254a6609ab None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:20.552639 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0098dea8-c7a2-461d-87bd-ffb3fa9a7d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:20.553313 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098dea8-c7a2-461d-87bd-ffb3fa9a7d63 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:20.553598 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098dea8-c7a2-461d-87bd-ffb3fa9a7d63 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:20.553876 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098dea8-c7a2-461d-87bd-ffb3fa9a7d63 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:20.566598 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0098dea8-c7a2-461d-87bd-ffb3fa9a7d63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:15:20.572250 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-0098dea8-c7a2-461d-87bd-ffb3fa9a7d63 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 15:15:20.572250 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:15:20.572250 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:15:20.572250 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:15:20.572250 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:15:20.572250 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:15:20.572250 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:15:20.572250 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:15:20.572250 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:15:20.572250 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:15:20.572250 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:15:20.572250 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:15:20.572250 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:15:20.572250 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:15:20.572250 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:15:20.572250 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:15:20.573384 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:15:20.573384 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:15:20.573384 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:15:20.573384 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:15:20.573384 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:15:20.573384 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:15:20.573384 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:15:20.573384 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:15:20.573384 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:15:20.573384 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:15:20.573384 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:15:20.573384 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:15:20.573384 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:15:20.573384 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:15:20.573384 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:15:20.573384 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:15:20.574184 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:15:20.574184 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:15:20.574184 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:15:20.574184 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:15:20.574184 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:15:20.574184 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:15:20.574184 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:15:20.574184 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:15:20.574184 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:15:20.574184 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:15:20.574184 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 15:15:20.574184 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:15:20.576396 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 99/181] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 2 15:15:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:15:20.578031 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a3b00-ef17-44a2-920d-fcc4258f8ed0 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:20.578463 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a3b00-ef17-44a2-920d-fcc4258f8ed0 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:20.578895 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a3b00-ef17-44a2-920d-fcc4258f8ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:20.600543 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-574a3b00-ef17-44a2-920d-fcc4258f8ed0 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:15:20.602132 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-574a3b00-ef17-44a2-920d-fcc4258f8ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:15:20.622771 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:20.634372 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bae2f46-2a1b-4933-b6f4-2ce0a8f729d3 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:20.665321 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:20.680479 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 100/182] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:15:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:15:20.683852 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5963c6bb-af61-408c-b5e3-581a68c073e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:20.683988 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963c6bb-af61-408c-b5e3-581a68c073e4 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:20.684219 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963c6bb-af61-408c-b5e3-581a68c073e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:20.684481 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963c6bb-af61-408c-b5e3-581a68c073e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:20.684625 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878c206-87aa-48fb-a5a7-9e9fa0def9d9 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:20.684835 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878c206-87aa-48fb-a5a7-9e9fa0def9d9 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:20.685115 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878c206-87aa-48fb-a5a7-9e9fa0def9d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:20.685202 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5963c6bb-af61-408c-b5e3-581a68c073e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:20.685501 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5963c6bb-af61-408c-b5e3-581a68c073e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:20.686872 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5963c6bb-af61-408c-b5e3-581a68c073e4 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:20.699294 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 83/183] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 2 15:15:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:20.702705 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65e912-3493-4360-8b9f-029e02d5124d None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:20.703002 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65e912-3493-4360-8b9f-029e02d5124d None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:20.703630 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65e912-3493-4360-8b9f-029e02d5124d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:20.705177 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-6878c206-87aa-48fb-a5a7-9e9fa0def9d9 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:15:20.706387 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-6878c206-87aa-48fb-a5a7-9e9fa0def9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:15:20.726316 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-0a65e912-3493-4360-8b9f-029e02d5124d None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:15:20.727551 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-0a65e912-3493-4360-8b9f-029e02d5124d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:15:20.783410 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 101/184] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:15:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:15:20.784582 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6878c206-87aa-48fb-a5a7-9e9fa0def9d9 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:20.805683 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 84/185] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:15:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:15:20.807418 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65e912-3493-4360-8b9f-029e02d5124d None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:20.909397 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6878c206-87aa-48fb-a5a7-9e9fa0def9d9 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:20.913459 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:20.927469 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:20.929554 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65e912-3493-4360-8b9f-029e02d5124d None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:20.945670 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccaee42-5370-42d5-a572-1108e0a6bbbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:20.946290 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccaee42-5370-42d5-a572-1108e0a6bbbf None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:20.946569 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccaee42-5370-42d5-a572-1108e0a6bbbf None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:20.946845 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccaee42-5370-42d5-a572-1108e0a6bbbf None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:20.947588 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccaee42-5370-42d5-a572-1108e0a6bbbf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:20.948004 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccaee42-5370-42d5-a572-1108e0a6bbbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:20.949402 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccaee42-5370-42d5-a572-1108e0a6bbbf None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:20.957876 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 102/186] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 2 15:15:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:20.958767 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccaee42-5370-42d5-a572-1108e0a6bbbf None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:20.965704 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3dfb21-5bc6-4252-b7f4-313de13d3977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:20.966351 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3dfb21-5bc6-4252-b7f4-313de13d3977 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:20.966632 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3dfb21-5bc6-4252-b7f4-313de13d3977 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:20.966906 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3dfb21-5bc6-4252-b7f4-313de13d3977 None admin] PATH_INFO: `/v3/users/f4dc4eb9d79745cba683d968af36705d` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:20.968109 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3dfb21-5bc6-4252-b7f4-313de13d3977 None admin] RBAC: Authorizing `identity:get_user(user_id=f4dc4eb9d79745cba683d968af36705d)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:20.969560 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3dfb21-5bc6-4252-b7f4-313de13d3977 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:20.971160 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 85/187] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 2 15:15:20 2022] GET /identity/v3/users/f4dc4eb9d79745cba683d968af36705d => generated 247 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:20.971940 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3dfb21-5bc6-4252-b7f4-313de13d3977 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:21.063465 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccaee42-5370-42d5-a572-1108e0a6bbbf None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:21.073631 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3dfb21-5bc6-4252-b7f4-313de13d3977 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:21.099048 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a003a44-7957-4ecb-b80c-bd564077c127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:21.099802 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a003a44-7957-4ecb-b80c-bd564077c127 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:21.100151 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a003a44-7957-4ecb-b80c-bd564077c127 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:21.100492 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a003a44-7957-4ecb-b80c-bd564077c127 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:21.108833 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa7422e-b177-4f82-88db-9cf1867bf72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:21.109470 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7422e-b177-4f82-88db-9cf1867bf72f None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:21.109753 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7422e-b177-4f82-88db-9cf1867bf72f None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:21.110028 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7422e-b177-4f82-88db-9cf1867bf72f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:21.110673 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a003a44-7957-4ecb-b80c-bd564077c127 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:15:21.116097 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-6a003a44-7957-4ecb-b80c-bd564077c127 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 15:15:21.116097 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:15:21.116097 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:15:21.116097 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:15:21.116097 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:15:21.116097 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:15:21.116097 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:15:21.116097 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:15:21.116097 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:15:21.116097 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:15:21.116097 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:15:21.116097 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:15:21.116097 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:15:21.116097 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:15:21.116097 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:15:21.116097 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:15:21.117208 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:15:21.117208 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:15:21.117208 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:15:21.117208 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:15:21.117208 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:15:21.117208 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:15:21.117208 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:15:21.117208 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:15:21.117208 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:15:21.117208 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:15:21.117208 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:15:21.117208 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:15:21.117208 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:15:21.117208 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:15:21.117208 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:15:21.117208 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:15:21.118170 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:15:21.118170 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:15:21.118170 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:15:21.118170 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:15:21.118170 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:15:21.118170 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:15:21.118170 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:15:21.118170 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:15:21.118170 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:15:21.118170 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:15:21.118170 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 15:15:21.118170 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:15:21.118170 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 103/188] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 2 15:15:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:15:21.118170 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a003a44-7957-4ecb-b80c-bd564077c127 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:21.122409 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa7422e-b177-4f82-88db-9cf1867bf72f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:15:21.127416 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-ffa7422e-b177-4f82-88db-9cf1867bf72f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 15:15:21.127416 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:15:21.127416 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:15:21.127416 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:15:21.127416 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:15:21.127416 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:15:21.127416 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:15:21.127416 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:15:21.127416 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:15:21.127416 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:15:21.127416 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:15:21.127416 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:15:21.127416 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:15:21.127416 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:15:21.127416 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:15:21.127416 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:15:21.128441 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:15:21.128441 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:15:21.128441 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:15:21.128441 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:15:21.128441 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:15:21.128441 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:15:21.128441 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:15:21.128441 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:15:21.128441 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:15:21.128441 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:15:21.128441 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:15:21.128441 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:15:21.128441 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:15:21.128441 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:15:21.128441 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:15:21.128441 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:15:21.129386 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:15:21.129386 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:15:21.129386 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:15:21.129386 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:15:21.129386 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:15:21.129386 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:15:21.129386 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:15:21.129386 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:15:21.129386 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:15:21.129386 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:15:21.129386 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 15:15:21.129386 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:15:21.133896 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 86/189] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Aug 2 15:15:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:15:21.134791 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa7422e-b177-4f82-88db-9cf1867bf72f None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:21.151632 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:21.169702 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:21.240394 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a003a44-7957-4ecb-b80c-bd564077c127 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:21.242500 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa7422e-b177-4f82-88db-9cf1867bf72f None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:21.279001 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88738a71-c3fd-43a1-b2a3-d89fa4884d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:21.279770 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88738a71-c3fd-43a1-b2a3-d89fa4884d52 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:21.280118 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88738a71-c3fd-43a1-b2a3-d89fa4884d52 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:21.280470 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88738a71-c3fd-43a1-b2a3-d89fa4884d52 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:21.281688 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88738a71-c3fd-43a1-b2a3-d89fa4884d52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:21.283255 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88738a71-c3fd-43a1-b2a3-d89fa4884d52 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:21.283462 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef71b0-2ba6-4cf3-8ee2-92b57d90f8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:21.284095 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef71b0-2ba6-4cf3-8ee2-92b57d90f8c4 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:21.284373 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef71b0-2ba6-4cf3-8ee2-92b57d90f8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:21.284642 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef71b0-2ba6-4cf3-8ee2-92b57d90f8c4 None admin] PATH_INFO: `/v3/users/c75f6c42ab30436ab529f926fc850408` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:21.284872 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 104/190] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:15:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:21.285635 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88738a71-c3fd-43a1-b2a3-d89fa4884d52 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:21.299675 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ef71b0-2ba6-4cf3-8ee2-92b57d90f8c4 None admin] RBAC: Authorizing `identity:get_user(user_id=c75f6c42ab30436ab529f926fc850408)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:21.301154 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ef71b0-2ba6-4cf3-8ee2-92b57d90f8c4 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:21.302846 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 87/191] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 2 15:15:21 2022] GET /identity/v3/users/c75f6c42ab30436ab529f926fc850408 => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:21.302846 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef71b0-2ba6-4cf3-8ee2-92b57d90f8c4 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:21.372872 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:21.390513 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88738a71-c3fd-43a1-b2a3-d89fa4884d52 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:21.402058 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:21.408914 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef71b0-2ba6-4cf3-8ee2-92b57d90f8c4 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:21.427894 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560b4212-aa9c-4737-9aa6-199754920d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:21.428428 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b4212-aa9c-4737-9aa6-199754920d7e None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:21.428714 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b4212-aa9c-4737-9aa6-199754920d7e None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:21.428993 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b4212-aa9c-4737-9aa6-199754920d7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:21.443076 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7198f69-e2a0-4f04-8dff-589a4d85ac40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:21.443734 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7198f69-e2a0-4f04-8dff-589a4d85ac40 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:21.444025 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7198f69-e2a0-4f04-8dff-589a4d85ac40 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:21.444286 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7198f69-e2a0-4f04-8dff-589a4d85ac40 None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:21.444987 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7198f69-e2a0-4f04-8dff-589a4d85ac40 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:21.445287 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7198f69-e2a0-4f04-8dff-589a4d85ac40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:21.446654 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7198f69-e2a0-4f04-8dff-589a4d85ac40 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:21.454614 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 88/192] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 2 15:15:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:21.459867 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7198f69-e2a0-4f04-8dff-589a4d85ac40 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:21.502885 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560b4212-aa9c-4737-9aa6-199754920d7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:21.504416 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560b4212-aa9c-4737-9aa6-199754920d7e None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:21.560287 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7198f69-e2a0-4f04-8dff-589a4d85ac40 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:21.595117 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44909efb-6151-4adf-8a90-d932839b1a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:21.595770 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44909efb-6151-4adf-8a90-d932839b1a76 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:21.596059 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44909efb-6151-4adf-8a90-d932839b1a76 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:21.596342 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44909efb-6151-4adf-8a90-d932839b1a76 None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:21.597064 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44909efb-6151-4adf-8a90-d932839b1a76 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:21.597374 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44909efb-6151-4adf-8a90-d932839b1a76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:21.598759 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44909efb-6151-4adf-8a90-d932839b1a76 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:21.600821 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:21.604017 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 105/193] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 2 15:15:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 15:15:21.604688 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560b4212-aa9c-4737-9aa6-199754920d7e None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:21.609797 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 89/194] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 2 15:15:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:21.610495 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44909efb-6151-4adf-8a90-d932839b1a76 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:21.614833 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:21.705754 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560b4212-aa9c-4737-9aa6-199754920d7e None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:21.711364 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44909efb-6151-4adf-8a90-d932839b1a76 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:21.739769 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1379ff-a9f1-406c-beb1-cce1e3ea1c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:21.740508 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1379ff-a9f1-406c-beb1-cce1e3ea1c4b None admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:21.741329 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1379ff-a9f1-406c-beb1-cce1e3ea1c4b None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:21.741604 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1379ff-a9f1-406c-beb1-cce1e3ea1c4b None admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:21.742295 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1379ff-a9f1-406c-beb1-cce1e3ea1c4b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:21.743795 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1379ff-a9f1-406c-beb1-cce1e3ea1c4b None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:21.752334 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb54a1dd-d9b7-4860-8633-4af4d220ab0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:21.752978 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb54a1dd-d9b7-4860-8633-4af4d220ab0e None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:21.753265 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb54a1dd-d9b7-4860-8633-4af4d220ab0e None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:21.753565 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb54a1dd-d9b7-4860-8633-4af4d220ab0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:21.766230 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 106/195] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Aug 2 15:15:21 2022] POST /identity/v3/users => generated 297 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:15:21.772809 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1379ff-a9f1-406c-beb1-cce1e3ea1c4b None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:21.838833 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:21.846784 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb54a1dd-d9b7-4860-8633-4af4d220ab0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:21.848350 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb54a1dd-d9b7-4860-8633-4af4d220ab0e None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:21.849429 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:21.900387 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1379ff-a9f1-406c-beb1-cce1e3ea1c4b None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:21.944423 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bd9894-9ed6-4446-a580-18a4feef35b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:21.945207 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd9894-9ed6-4446-a580-18a4feef35b0 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:21.945559 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd9894-9ed6-4446-a580-18a4feef35b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:21.945898 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd9894-9ed6-4446-a580-18a4feef35b0 None admin] PATH_INFO: `/v3/users/8deb58b82f244801b76925e67e60f252` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:21.947260 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bd9894-9ed6-4446-a580-18a4feef35b0 None admin] RBAC: Authorizing `identity:get_user(user_id=8deb58b82f244801b76925e67e60f252)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:21.948754 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bd9894-9ed6-4446-a580-18a4feef35b0 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:21.950415 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 107/196] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 2 15:15:21 2022] GET /identity/v3/users/8deb58b82f244801b76925e67e60f252 => generated 289 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:21.951202 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bd9894-9ed6-4446-a580-18a4feef35b0 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:21.970486 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 90/197] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 2 15:15:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 15:15:21.971738 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb54a1dd-d9b7-4860-8633-4af4d220ab0e None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:22.089113 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bd9894-9ed6-4446-a580-18a4feef35b0 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:22.112725 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:22.120300 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb54a1dd-d9b7-4860-8633-4af4d220ab0e None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:22.126410 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:22.133168 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c248320-d55a-4e59-9ce6-0b2915779e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:22.133928 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c248320-d55a-4e59-9ce6-0b2915779e61 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:22.134217 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c248320-d55a-4e59-9ce6-0b2915779e61 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:22.134496 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c248320-d55a-4e59-9ce6-0b2915779e61 None admin] PATH_INFO: `/v3/projects/3f5199ad4b6b4534bfa9c94c6da85f3e` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:22.135773 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c248320-d55a-4e59-9ce6-0b2915779e61 None admin] RBAC: Authorizing `identity:get_project(project_id=3f5199ad4b6b4534bfa9c94c6da85f3e)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:22.137298 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c248320-d55a-4e59-9ce6-0b2915779e61 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:22.139002 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 108/198] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 2 15:15:21 2022] GET /identity/v3/projects/3f5199ad4b6b4534bfa9c94c6da85f3e => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:22.139914 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c248320-d55a-4e59-9ce6-0b2915779e61 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:22.172069 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe962b-7f53-48bf-974b-1ce98085240e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:22.173056 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe962b-7f53-48bf-974b-1ce98085240e None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:22.173530 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe962b-7f53-48bf-974b-1ce98085240e None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:22.174119 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe962b-7f53-48bf-974b-1ce98085240e None admin] PATH_INFO: `/v3/users/c75f6c42ab30436ab529f926fc850408` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:22.175750 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe962b-7f53-48bf-974b-1ce98085240e None admin] RBAC: Authorizing `identity:get_user(user_id=c75f6c42ab30436ab529f926fc850408)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:22.177691 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe962b-7f53-48bf-974b-1ce98085240e None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:22.179900 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 91/199] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 2 15:15:21 2022] GET /identity/v3/users/c75f6c42ab30436ab529f926fc850408 => generated 283 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:22.185441 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe962b-7f53-48bf-974b-1ce98085240e None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:22.260946 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c248320-d55a-4e59-9ce6-0b2915779e61 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:22.297137 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f928f50c-85b7-4b2f-9c1e-36595796d632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:22.297769 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f928f50c-85b7-4b2f-9c1e-36595796d632 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:22.298096 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f928f50c-85b7-4b2f-9c1e-36595796d632 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:22.298385 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f928f50c-85b7-4b2f-9c1e-36595796d632 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:22.306419 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe962b-7f53-48bf-974b-1ce98085240e None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:22.345458 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5088d1-f0d8-4cb7-aaa8-4c97adfb3dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:22.346472 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5088d1-f0d8-4cb7-aaa8-4c97adfb3dd0 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:22.347030 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5088d1-f0d8-4cb7-aaa8-4c97adfb3dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:22.347529 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5088d1-f0d8-4cb7-aaa8-4c97adfb3dd0 None admin] PATH_INFO: `/v3/projects/02cccaf1e1a44792916250e99dc79efa` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:22.348963 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5088d1-f0d8-4cb7-aaa8-4c97adfb3dd0 None admin] RBAC: Authorizing `identity:get_project(project_id=02cccaf1e1a44792916250e99dc79efa)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:22.351406 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5088d1-f0d8-4cb7-aaa8-4c97adfb3dd0 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:22.353362 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 92/200] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 2 15:15:22 2022] GET /identity/v3/projects/02cccaf1e1a44792916250e99dc79efa => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:22.354439 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5088d1-f0d8-4cb7-aaa8-4c97adfb3dd0 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:22.374597 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:22.377149 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f928f50c-85b7-4b2f-9c1e-36595796d632 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:22.378839 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f928f50c-85b7-4b2f-9c1e-36595796d632 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:22.393139 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:22.476988 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5088d1-f0d8-4cb7-aaa8-4c97adfb3dd0 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:22.487522 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 109/201] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 2 15:15:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 15:15:22.492343 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f928f50c-85b7-4b2f-9c1e-36595796d632 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:22.517597 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962720e-e5d9-4ada-9f09-eb7adf14811c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:22.518454 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962720e-e5d9-4ada-9f09-eb7adf14811c None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:22.518876 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962720e-e5d9-4ada-9f09-eb7adf14811c None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:22.519385 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962720e-e5d9-4ada-9f09-eb7adf14811c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:22.520414 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0962720e-e5d9-4ada-9f09-eb7adf14811c None admin] RBAC: Adding query filter params (role.id=d75c9572cb294caeb8eb456521ff6f57, scope.project.id=3f5199ad4b6b4534bfa9c94c6da85f3e, user.id=f4dc4eb9d79745cba683d968af36705d) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:22.520939 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0962720e-e5d9-4ada-9f09-eb7adf14811c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:22.523246 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0962720e-e5d9-4ada-9f09-eb7adf14811c None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:22.535395 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 93/202] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 2 15:15:22 2022] GET /identity/v3/role_assignments?user.id=f4dc4eb9d79745cba683d968af36705d&scope.project.id=3f5199ad4b6b4534bfa9c94c6da85f3e&role.id=d75c9572cb294caeb8eb456521ff6f57 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:22.536620 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962720e-e5d9-4ada-9f09-eb7adf14811c None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:22.613364 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:22.618134 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f928f50c-85b7-4b2f-9c1e-36595796d632 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:22.664036 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5839eb-7761-41ee-8dcb-ba7e190c882b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:22.664690 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5839eb-7761-41ee-8dcb-ba7e190c882b None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:22.664977 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5839eb-7761-41ee-8dcb-ba7e190c882b None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:22.665257 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5839eb-7761-41ee-8dcb-ba7e190c882b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:22.783114 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:22.793327 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962720e-e5d9-4ada-9f09-eb7adf14811c None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:22.794154 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5839eb-7761-41ee-8dcb-ba7e190c882b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:22.796142 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5839eb-7761-41ee-8dcb-ba7e190c882b None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:22.846782 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b60c1f-ac26-4d67-8087-62d1b981c384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:22.847697 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b60c1f-ac26-4d67-8087-62d1b981c384 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:22.848052 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b60c1f-ac26-4d67-8087-62d1b981c384 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:22.848480 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b60c1f-ac26-4d67-8087-62d1b981c384 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:22.850871 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b60c1f-ac26-4d67-8087-62d1b981c384 None admin] RBAC: Adding query filter params (role.id=d75c9572cb294caeb8eb456521ff6f57, scope.project.id=02cccaf1e1a44792916250e99dc79efa, user.id=c75f6c42ab30436ab529f926fc850408) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:22.851272 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b60c1f-ac26-4d67-8087-62d1b981c384 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:22.852850 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b60c1f-ac26-4d67-8087-62d1b981c384 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:22.860473 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 94/203] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 2 15:15:22 2022] GET /identity/v3/role_assignments?user.id=c75f6c42ab30436ab529f926fc850408&scope.project.id=02cccaf1e1a44792916250e99dc79efa&role.id=d75c9572cb294caeb8eb456521ff6f57 => generated 259 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:22.861481 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b60c1f-ac26-4d67-8087-62d1b981c384 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:22.942928 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:22.952794 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 110/204] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 2 15:15:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 15:15:22.960981 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5839eb-7761-41ee-8dcb-ba7e190c882b None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:23.100837 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5839eb-7761-41ee-8dcb-ba7e190c882b None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:23.101997 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b60c1f-ac26-4d67-8087-62d1b981c384 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:23.144318 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e8a95c-1606-42f1-8ff5-19c2b9c4fc7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:23.145006 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8a95c-1606-42f1-8ff5-19c2b9c4fc7f None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:23.145289 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8a95c-1606-42f1-8ff5-19c2b9c4fc7f None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:23.145570 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8a95c-1606-42f1-8ff5-19c2b9c4fc7f None admin] PATH_INFO: `/v3/projects/02cccaf1e1a44792916250e99dc79efa` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:23.146953 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e8a95c-1606-42f1-8ff5-19c2b9c4fc7f None admin] RBAC: Authorizing `identity:get_project(project_id=02cccaf1e1a44792916250e99dc79efa)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:23.150379 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e8a95c-1606-42f1-8ff5-19c2b9c4fc7f None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:23.155723 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 111/205] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 2 15:15:22 2022] GET /identity/v3/projects/02cccaf1e1a44792916250e99dc79efa => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:23.159178 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e8a95c-1606-42f1-8ff5-19c2b9c4fc7f None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:23.164807 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc52832d-426b-4e1f-95e6-36dd948579b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:23.165804 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52832d-426b-4e1f-95e6-36dd948579b8 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:23.166292 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52832d-426b-4e1f-95e6-36dd948579b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:23.166770 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52832d-426b-4e1f-95e6-36dd948579b8 None admin] PATH_INFO: `/v3/projects/3f5199ad4b6b4534bfa9c94c6da85f3e` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:23.168503 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc52832d-426b-4e1f-95e6-36dd948579b8 None admin] RBAC: Authorizing `identity:get_project(project_id=3f5199ad4b6b4534bfa9c94c6da85f3e)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:23.170396 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc52832d-426b-4e1f-95e6-36dd948579b8 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:23.172663 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 95/206] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 2 15:15:22 2022] GET /identity/v3/projects/3f5199ad4b6b4534bfa9c94c6da85f3e => generated 298 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:23.179504 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc52832d-426b-4e1f-95e6-36dd948579b8 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:23.211231 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:23.287402 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:23.290747 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc52832d-426b-4e1f-95e6-36dd948579b8 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:23.335385 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fdb169-4a80-4f09-88e0-b84a1d8ae095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:23.336536 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fdb169-4a80-4f09-88e0-b84a1d8ae095 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:23.337019 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fdb169-4a80-4f09-88e0-b84a1d8ae095 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:23.337492 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fdb169-4a80-4f09-88e0-b84a1d8ae095 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:23.338526 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fdb169-4a80-4f09-88e0-b84a1d8ae095 None admin] RBAC: Adding query filter params (role.id=f3287619b177442b8bf83cf5f376b897, scope.project.id=3f5199ad4b6b4534bfa9c94c6da85f3e, user.id=8deb58b82f244801b76925e67e60f252) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:23.339040 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fdb169-4a80-4f09-88e0-b84a1d8ae095 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:23.340733 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fdb169-4a80-4f09-88e0-b84a1d8ae095 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:23.347715 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 96/207] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 2 15:15:23 2022] GET /identity/v3/role_assignments?user.id=8deb58b82f244801b76925e67e60f252&scope.project.id=3f5199ad4b6b4534bfa9c94c6da85f3e&role.id=f3287619b177442b8bf83cf5f376b897 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:15:23.360291 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e8a95c-1606-42f1-8ff5-19c2b9c4fc7f None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:23.398648 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397442ca-f913-4edf-b61e-c9bdf3613d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:23.399662 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397442ca-f913-4edf-b61e-c9bdf3613d4b None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:23.400150 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397442ca-f913-4edf-b61e-c9bdf3613d4b None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:23.400736 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397442ca-f913-4edf-b61e-c9bdf3613d4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:23.401778 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397442ca-f913-4edf-b61e-c9bdf3613d4b None admin] RBAC: Adding query filter params (role.id=3e1c8e0567ff4244aef0d6a62fc8b18d, scope.project.id=02cccaf1e1a44792916250e99dc79efa, user.id=c75f6c42ab30436ab529f926fc850408) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:23.402344 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397442ca-f913-4edf-b61e-c9bdf3613d4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:23.404136 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397442ca-f913-4edf-b61e-c9bdf3613d4b None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:23.412531 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 112/208] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 2 15:15:23 2022] GET /identity/v3/role_assignments?user.id=c75f6c42ab30436ab529f926fc850408&scope.project.id=02cccaf1e1a44792916250e99dc79efa&role.id=3e1c8e0567ff4244aef0d6a62fc8b18d => generated 259 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:24.122963 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e62c5-7ed5-4c90-ab74-ef5c7cf73755 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:24.123539 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e62c5-7ed5-4c90-ab74-ef5c7cf73755 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:24.123539 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e62c5-7ed5-4c90-ab74-ef5c7cf73755 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:24.125037 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 97/209] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:15:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:15:24.130338 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2fe99-dda3-496b-841d-b8c40c56e945 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:24.130741 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2fe99-dda3-496b-841d-b8c40c56e945 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:24.130921 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2fe99-dda3-496b-841d-b8c40c56e945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:24.160054 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-e4a2fe99-dda3-496b-841d-b8c40c56e945 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:15:24.161267 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-e4a2fe99-dda3-496b-841d-b8c40c56e945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:15:24.233185 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 113/210] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:15:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:15:24.258528 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e62c5-7ed5-4c90-ab74-ef5c7cf73755 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:24.305770 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4573a2d-38d0-4626-9ffc-5ad9b04cf2c6 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:24.306293 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4573a2d-38d0-4626-9ffc-5ad9b04cf2c6 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:24.306580 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4573a2d-38d0-4626-9ffc-5ad9b04cf2c6 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:24.308004 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 114/211] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:15:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:15:24.313136 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24348563-3617-4eed-a91a-a0c33b8608fb None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:24.313618 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24348563-3617-4eed-a91a-a0c33b8608fb None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:24.314039 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24348563-3617-4eed-a91a-a0c33b8608fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:24.332759 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-24348563-3617-4eed-a91a-a0c33b8608fb None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:15:24.334180 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-24348563-3617-4eed-a91a-a0c33b8608fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:15:24.369398 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:24.382758 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e62c5-7ed5-4c90-ab74-ef5c7cf73755 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:24.399085 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:24.419601 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 115/212] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:15:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 15:15:24.430512 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8e4419-a3a3-490a-adbb-e233d53c6839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:24.431439 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e4419-a3a3-490a-adbb-e233d53c6839 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:24.431867 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e4419-a3a3-490a-adbb-e233d53c6839 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:24.432317 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e4419-a3a3-490a-adbb-e233d53c6839 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:24.443473 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8e4419-a3a3-490a-adbb-e233d53c6839 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:15:24.445208 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24348563-3617-4eed-a91a-a0c33b8608fb None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:24.450203 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-1a8e4419-a3a3-490a-adbb-e233d53c6839 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 15:15:24.450203 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:15:24.450203 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:15:24.450203 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:15:24.450203 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:15:24.450203 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:15:24.450203 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:15:24.450203 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:15:24.450203 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:15:24.450203 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:15:24.450203 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:15:24.450203 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:15:24.450203 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:15:24.450203 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:15:24.450203 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:15:24.450203 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:15:24.451290 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:15:24.451290 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:15:24.451290 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:15:24.451290 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:15:24.451290 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:15:24.451290 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:15:24.451290 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:15:24.451290 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:15:24.451290 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:15:24.451290 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:15:24.451290 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:15:24.451290 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:15:24.451290 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:15:24.451290 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:15:24.451290 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:15:24.451290 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:15:24.452253 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:15:24.452253 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:15:24.452253 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:15:24.452253 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:15:24.452253 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:15:24.452253 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:15:24.452253 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:15:24.452253 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:15:24.452253 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:15:24.452253 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:15:24.452253 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 15:15:24.452253 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:15:24.454547 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 98/213] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 2 15:15:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:15:24.460997 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8e4419-a3a3-490a-adbb-e233d53c6839 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:24.558215 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24348563-3617-4eed-a91a-a0c33b8608fb None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:24.596824 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b93d78c-65a0-439e-b51b-afc2cd8e12dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:24.597671 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93d78c-65a0-439e-b51b-afc2cd8e12dd None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:24.598057 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93d78c-65a0-439e-b51b-afc2cd8e12dd None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:24.598435 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93d78c-65a0-439e-b51b-afc2cd8e12dd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:24.599746 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b93d78c-65a0-439e-b51b-afc2cd8e12dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:24.601345 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b93d78c-65a0-439e-b51b-afc2cd8e12dd None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:24.604101 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8e4419-a3a3-490a-adbb-e233d53c6839 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:24.607657 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 116/214] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:15:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:24.609048 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b93d78c-65a0-439e-b51b-afc2cd8e12dd None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:24.652191 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f99f4-634a-4e95-86cb-eaeb85ea278e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:24.653136 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f99f4-634a-4e95-86cb-eaeb85ea278e None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:24.653436 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f99f4-634a-4e95-86cb-eaeb85ea278e None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:24.653721 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f99f4-634a-4e95-86cb-eaeb85ea278e None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:24.654762 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029f99f4-634a-4e95-86cb-eaeb85ea278e None admin] RBAC: Adding query filter params (name=member) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:24.655077 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029f99f4-634a-4e95-86cb-eaeb85ea278e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:24.656561 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029f99f4-634a-4e95-86cb-eaeb85ea278e None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:24.668741 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 99/215] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 2 15:15:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:15:24.676271 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f99f4-634a-4e95-86cb-eaeb85ea278e None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:24.690034 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:24.694759 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:24.739319 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b93d78c-65a0-439e-b51b-afc2cd8e12dd None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:24.781315 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4e478-8672-4d26-979a-bdeb6021742a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:24.782094 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4e478-8672-4d26-979a-bdeb6021742a None admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:24.782471 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4e478-8672-4d26-979a-bdeb6021742a None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:24.782850 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4e478-8672-4d26-979a-bdeb6021742a None admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:24.783675 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b4e478-8672-4d26-979a-bdeb6021742a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:24.785292 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b4e478-8672-4d26-979a-bdeb6021742a None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:24.804596 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f99f4-634a-4e95-86cb-eaeb85ea278e None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:24.822137 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 117/216] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Aug 2 15:15:24 2022] POST /identity/v3/users => generated 297 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:15:24.850837 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce90573b-0e54-407f-89fa-ce8b4e0ae908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:24.851802 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90573b-0e54-407f-89fa-ce8b4e0ae908 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:24.852167 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90573b-0e54-407f-89fa-ce8b4e0ae908 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:24.852571 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90573b-0e54-407f-89fa-ce8b4e0ae908 None admin] PATH_INFO: `/v3/users/b1bdaa3e7e224590a075038af40805ea` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:24.870103 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce90573b-0e54-407f-89fa-ce8b4e0ae908 None admin] RBAC: Authorizing `identity:get_user(user_id=b1bdaa3e7e224590a075038af40805ea)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:24.871762 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce90573b-0e54-407f-89fa-ce8b4e0ae908 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:24.874008 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 100/217] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 2 15:15:24 2022] GET /identity/v3/users/b1bdaa3e7e224590a075038af40805ea => generated 297 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:24.879716 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4e478-8672-4d26-979a-bdeb6021742a None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:25.006932 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4e478-8672-4d26-979a-bdeb6021742a None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:25.026081 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:25.049529 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e086ce8-a68c-45dc-8d69-f3376f28176a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:25.050336 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e086ce8-a68c-45dc-8d69-f3376f28176a None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:25.050628 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e086ce8-a68c-45dc-8d69-f3376f28176a None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:25.050914 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e086ce8-a68c-45dc-8d69-f3376f28176a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:25.126068 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e086ce8-a68c-45dc-8d69-f3376f28176a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:25.127595 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e086ce8-a68c-45dc-8d69-f3376f28176a None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:25.242647 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 118/218] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 2 15:15:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 02 15:15:25.250318 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce90573b-0e54-407f-89fa-ce8b4e0ae908 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:25.331689 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da386d1-9392-4b49-8c1f-465697353827 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:25.331991 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da386d1-9392-4b49-8c1f-465697353827 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:25.332191 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da386d1-9392-4b49-8c1f-465697353827 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:25.333958 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 119/219] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:15:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 15:15:25.339240 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:25.340863 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7e5cc-c964-4813-b6d9-ba70808d9c01 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:25.341146 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7e5cc-c964-4813-b6d9-ba70808d9c01 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:25.341425 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7e5cc-c964-4813-b6d9-ba70808d9c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:25.362462 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-5bd7e5cc-c964-4813-b6d9-ba70808d9c01 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:15:25.363297 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-5bd7e5cc-c964-4813-b6d9-ba70808d9c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:15:25.377501 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:25.384367 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce90573b-0e54-407f-89fa-ce8b4e0ae908 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:25.440431 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 120/220] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:15:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 15:15:25.450324 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c654a-5aeb-4dbf-ac4c-a75d8bd29657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:25.451344 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c654a-5aeb-4dbf-ac4c-a75d8bd29657 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:25.451844 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c654a-5aeb-4dbf-ac4c-a75d8bd29657 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:25.452336 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c654a-5aeb-4dbf-ac4c-a75d8bd29657 None admin] PATH_INFO: `/v3/projects/02cccaf1e1a44792916250e99dc79efa` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:25.460524 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0c654a-5aeb-4dbf-ac4c-a75d8bd29657 None admin] RBAC: Authorizing `identity:get_project(project_id=02cccaf1e1a44792916250e99dc79efa)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:25.462387 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0c654a-5aeb-4dbf-ac4c-a75d8bd29657 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:25.463410 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd7e5cc-c964-4813-b6d9-ba70808d9c01 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:25.464621 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 101/221] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 2 15:15:25 2022] GET /identity/v3/projects/02cccaf1e1a44792916250e99dc79efa => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:25.482923 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c654a-5aeb-4dbf-ac4c-a75d8bd29657 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:25.576657 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd7e5cc-c964-4813-b6d9-ba70808d9c01 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:25.614620 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1882201a-dd81-4f7d-9706-b320e9e7b510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:25.615376 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1882201a-dd81-4f7d-9706-b320e9e7b510 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:25.616216 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1882201a-dd81-4f7d-9706-b320e9e7b510 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:25.616493 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1882201a-dd81-4f7d-9706-b320e9e7b510 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:25.632097 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1882201a-dd81-4f7d-9706-b320e9e7b510 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:15:25.637906 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-1882201a-dd81-4f7d-9706-b320e9e7b510 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 15:15:25.637906 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:15:25.637906 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:15:25.637906 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:15:25.637906 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:15:25.637906 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:15:25.637906 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:15:25.637906 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:15:25.637906 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:15:25.637906 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:15:25.637906 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:15:25.637906 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:15:25.637906 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:15:25.637906 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:15:25.637906 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:15:25.637906 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:15:25.638824 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:15:25.638824 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:15:25.638824 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:15:25.638824 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:15:25.638824 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:15:25.638824 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:15:25.638824 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:15:25.638824 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:15:25.638824 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:15:25.638824 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:15:25.638824 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:15:25.638824 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:15:25.638824 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:15:25.638824 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:15:25.638824 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:15:25.638824 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:15:25.639658 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:15:25.639658 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:15:25.639658 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:15:25.639658 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:15:25.639658 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:15:25.639658 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:15:25.639658 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:15:25.639658 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:15:25.639658 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:15:25.639658 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:15:25.639658 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 15:15:25.639658 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:15:25.639658 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 121/222] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 2 15:15:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 15:15:25.644670 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2e158-70eb-4f65-a39d-9b0548489334 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:25.644961 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2e158-70eb-4f65-a39d-9b0548489334 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:25.645269 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2e158-70eb-4f65-a39d-9b0548489334 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:25.647367 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 122/223] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:15:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:15:25.647958 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d2e158-70eb-4f65-a39d-9b0548489334 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:25.663791 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:25.683544 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c654a-5aeb-4dbf-ac4c-a75d8bd29657 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:25.731164 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b798c8e7-99a4-4ba4-9a08-9d5c1beeee43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:25.733512 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798c8e7-99a4-4ba4-9a08-9d5c1beeee43 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:25.733868 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798c8e7-99a4-4ba4-9a08-9d5c1beeee43 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:25.734376 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798c8e7-99a4-4ba4-9a08-9d5c1beeee43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:25.735558 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b798c8e7-99a4-4ba4-9a08-9d5c1beeee43 None admin] RBAC: Adding query filter params (role.id=bf4fcdd92d8a4a6d855f3eaa4f542529, scope.project.id=02cccaf1e1a44792916250e99dc79efa, user.id=b1bdaa3e7e224590a075038af40805ea) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:25.735942 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b798c8e7-99a4-4ba4-9a08-9d5c1beeee43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:25.741053 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b798c8e7-99a4-4ba4-9a08-9d5c1beeee43 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:25.755298 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 102/224] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 2 15:15:25 2022] GET /identity/v3/role_assignments?user.id=b1bdaa3e7e224590a075038af40805ea&scope.project.id=02cccaf1e1a44792916250e99dc79efa&role.id=bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 259 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:15:25.757500 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a6437-7999-42b0-8188-4171e2898b0f None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:25.759133 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a6437-7999-42b0-8188-4171e2898b0f None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:25.760524 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a6437-7999-42b0-8188-4171e2898b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:25.775317 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:25.784083 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-435a6437-7999-42b0-8188-4171e2898b0f None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:15:25.785943 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-435a6437-7999-42b0-8188-4171e2898b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:15:25.813121 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d2e158-70eb-4f65-a39d-9b0548489334 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:25.888832 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc82b2e-e97e-4298-8cd5-6ac4e01d6040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:25.891255 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc82b2e-e97e-4298-8cd5-6ac4e01d6040 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:25.891971 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc82b2e-e97e-4298-8cd5-6ac4e01d6040 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:25.893861 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc82b2e-e97e-4298-8cd5-6ac4e01d6040 None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:25.894911 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc82b2e-e97e-4298-8cd5-6ac4e01d6040 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:25.895456 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc82b2e-e97e-4298-8cd5-6ac4e01d6040 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:25.898753 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc82b2e-e97e-4298-8cd5-6ac4e01d6040 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:25.915347 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 123/225] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 2 15:15:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:25.922270 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc82b2e-e97e-4298-8cd5-6ac4e01d6040 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:25.926979 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 103/226] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:15:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:15:25.949977 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a6437-7999-42b0-8188-4171e2898b0f None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:26.006661 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:26.086709 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc82b2e-e97e-4298-8cd5-6ac4e01d6040 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:26.132949 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a6437-7999-42b0-8188-4171e2898b0f None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:26.172940 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92988b64-3308-49ac-b832-ccec19caabf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:26.173939 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92988b64-3308-49ac-b832-ccec19caabf8 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:26.174630 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92988b64-3308-49ac-b832-ccec19caabf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:26.175681 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92988b64-3308-49ac-b832-ccec19caabf8 None admin] PATH_INFO: `/v3/users/c75f6c42ab30436ab529f926fc850408` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:26.177013 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92988b64-3308-49ac-b832-ccec19caabf8 None admin] RBAC: Authorizing `identity:get_user(user_id=c75f6c42ab30436ab529f926fc850408)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:26.178689 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92988b64-3308-49ac-b832-ccec19caabf8 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:26.185369 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 124/227] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 2 15:15:25 2022] GET /identity/v3/users/c75f6c42ab30436ab529f926fc850408 => generated 283 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:15:26.186433 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92988b64-3308-49ac-b832-ccec19caabf8 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:26.198269 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae522b7-19cb-4944-9088-232a6c366c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:26.199208 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae522b7-19cb-4944-9088-232a6c366c21 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:26.199738 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae522b7-19cb-4944-9088-232a6c366c21 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:26.200284 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae522b7-19cb-4944-9088-232a6c366c21 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:26.202627 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:26.219090 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae522b7-19cb-4944-9088-232a6c366c21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:15:26.231566 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-cae522b7-19cb-4944-9088-232a6c366c21 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 15:15:26.231566 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:15:26.231566 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:15:26.231566 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:15:26.231566 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:15:26.231566 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:15:26.231566 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:15:26.231566 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:15:26.231566 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:15:26.231566 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:15:26.231566 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:15:26.231566 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:15:26.231566 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:15:26.231566 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:15:26.231566 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:15:26.231566 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:15:26.233031 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:15:26.233031 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:15:26.233031 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:15:26.233031 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:15:26.233031 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:15:26.233031 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:15:26.233031 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:15:26.233031 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:15:26.233031 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:15:26.233031 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:15:26.233031 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:15:26.233031 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:15:26.233031 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:15:26.233031 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:15:26.233031 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:15:26.233031 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:15:26.234355 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:15:26.234355 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:15:26.234355 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:15:26.234355 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:15:26.234355 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:15:26.234355 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:15:26.234355 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:15:26.234355 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:15:26.234355 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:15:26.234355 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:15:26.234355 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 15:15:26.234355 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:15:26.239267 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 104/228] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Aug 2 15:15:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 15:15:26.245894 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae522b7-19cb-4944-9088-232a6c366c21 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:26.421093 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92988b64-3308-49ac-b832-ccec19caabf8 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:26.428913 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae522b7-19cb-4944-9088-232a6c366c21 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:26.473548 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb2ec16-9179-4ef9-8f8e-bcd1fbf66418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:26.474191 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2ec16-9179-4ef9-8f8e-bcd1fbf66418 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:26.474476 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2ec16-9179-4ef9-8f8e-bcd1fbf66418 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:26.474754 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2ec16-9179-4ef9-8f8e-bcd1fbf66418 None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:26.476077 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb2ec16-9179-4ef9-8f8e-bcd1fbf66418 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:26.476388 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb2ec16-9179-4ef9-8f8e-bcd1fbf66418 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:26.477788 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb2ec16-9179-4ef9-8f8e-bcd1fbf66418 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:26.499982 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 105/229] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 2 15:15:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:26.505906 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb2ec16-9179-4ef9-8f8e-bcd1fbf66418 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:26.511505 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f8d5a-f829-465a-a17d-fbb64b3add1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:26.512179 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f8d5a-f829-465a-a17d-fbb64b3add1a None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:26.512467 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f8d5a-f829-465a-a17d-fbb64b3add1a None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:26.512748 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f8d5a-f829-465a-a17d-fbb64b3add1a None admin] PATH_INFO: `/v3/projects/02cccaf1e1a44792916250e99dc79efa` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:26.516654 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f8d5a-f829-465a-a17d-fbb64b3add1a None admin] RBAC: Authorizing `identity:get_project(project_id=02cccaf1e1a44792916250e99dc79efa)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:26.518667 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f8d5a-f829-465a-a17d-fbb64b3add1a None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:26.521164 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 125/230] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 2 15:15:26 2022] GET /identity/v3/projects/02cccaf1e1a44792916250e99dc79efa => generated 302 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:15:26.527466 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f8d5a-f829-465a-a17d-fbb64b3add1a None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:26.543578 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:26.594801 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:26.671677 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb2ec16-9179-4ef9-8f8e-bcd1fbf66418 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:26.716564 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f8d5a-f829-465a-a17d-fbb64b3add1a None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:26.754739 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6739c7c-8421-4aac-bd8d-f0fd645067de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:26.755593 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6739c7c-8421-4aac-bd8d-f0fd645067de None admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:26.755887 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6739c7c-8421-4aac-bd8d-f0fd645067de None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:26.756706 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6739c7c-8421-4aac-bd8d-f0fd645067de None admin] PATH_INFO: `/v3/projects/02cccaf1e1a44792916250e99dc79efa/users/c75f6c42ab30436ab529f926fc850408/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:26.758772 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6739c7c-8421-4aac-bd8d-f0fd645067de None admin] RBAC: Authorizing `identity:create_grant(project_id=02cccaf1e1a44792916250e99dc79efa, user_id=c75f6c42ab30436ab529f926fc850408, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:26.760391 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6739c7c-8421-4aac-bd8d-f0fd645067de None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:26.773068 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99327593-566d-45f6-8ef9-c39f0e9aa539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:26.774079 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99327593-566d-45f6-8ef9-c39f0e9aa539 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:26.774574 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99327593-566d-45f6-8ef9-c39f0e9aa539 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:26.775063 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99327593-566d-45f6-8ef9-c39f0e9aa539 None admin] PATH_INFO: `/v3/users/c75f6c42ab30436ab529f926fc850408` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:26.775512 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 126/231] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 2 15:15:26 2022] PUT /identity/v3/projects/02cccaf1e1a44792916250e99dc79efa/users/c75f6c42ab30436ab529f926fc850408/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:15:26.780318 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99327593-566d-45f6-8ef9-c39f0e9aa539 None admin] RBAC: Authorizing `identity:get_user(user_id=c75f6c42ab30436ab529f926fc850408)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:26.782214 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99327593-566d-45f6-8ef9-c39f0e9aa539 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:26.784371 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 106/232] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 2 15:15:26 2022] GET /identity/v3/users/c75f6c42ab30436ab529f926fc850408 => generated 283 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:15:26.791547 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6739c7c-8421-4aac-bd8d-f0fd645067de None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:26.894280 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:26.942392 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6739c7c-8421-4aac-bd8d-f0fd645067de None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:26.985353 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379720ac-dc82-4b12-a713-1d97f8d1a203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:26.986032 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379720ac-dc82-4b12-a713-1d97f8d1a203 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:26.986319 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379720ac-dc82-4b12-a713-1d97f8d1a203 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:26.986606 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379720ac-dc82-4b12-a713-1d97f8d1a203 None admin] PATH_INFO: `/v3/projects/02cccaf1e1a44792916250e99dc79efa` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:26.987938 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379720ac-dc82-4b12-a713-1d97f8d1a203 None admin] RBAC: Authorizing `identity:get_project(project_id=02cccaf1e1a44792916250e99dc79efa)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:26.989460 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379720ac-dc82-4b12-a713-1d97f8d1a203 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:26.991850 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 127/233] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 2 15:15:26 2022] GET /identity/v3/projects/02cccaf1e1a44792916250e99dc79efa => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:26.998060 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99327593-566d-45f6-8ef9-c39f0e9aa539 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:27.139308 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99327593-566d-45f6-8ef9-c39f0e9aa539 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:27.176330 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:27.189105 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e927a8-a88e-4101-afb4-f0b40dd91db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:27.189803 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e927a8-a88e-4101-afb4-f0b40dd91db4 None admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:27.190087 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e927a8-a88e-4101-afb4-f0b40dd91db4 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:27.190360 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e927a8-a88e-4101-afb4-f0b40dd91db4 None admin] PATH_INFO: `/v3/projects/02cccaf1e1a44792916250e99dc79efa/users/c75f6c42ab30436ab529f926fc850408/roles/3e1c8e0567ff4244aef0d6a62fc8b18d` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:27.192709 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e927a8-a88e-4101-afb4-f0b40dd91db4 None admin] RBAC: Authorizing `identity:create_grant(project_id=02cccaf1e1a44792916250e99dc79efa, user_id=c75f6c42ab30436ab529f926fc850408, role_id=3e1c8e0567ff4244aef0d6a62fc8b18d)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:27.194692 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e927a8-a88e-4101-afb4-f0b40dd91db4 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:27.218065 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 107/234] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 2 15:15:26 2022] PUT /identity/v3/projects/02cccaf1e1a44792916250e99dc79efa/users/c75f6c42ab30436ab529f926fc850408/roles/3e1c8e0567ff4244aef0d6a62fc8b18d => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:15:27.402273 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf12eb-2774-437c-bf15-95d5464c1f40 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:27.402626 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf12eb-2774-437c-bf15-95d5464c1f40 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:27.402841 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf12eb-2774-437c-bf15-95d5464c1f40 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:27.404588 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 128/235] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:15:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:15:27.410317 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7db4b-d659-483a-8a93-39fa460ba1d6 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:27.410613 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7db4b-d659-483a-8a93-39fa460ba1d6 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:27.410889 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7db4b-d659-483a-8a93-39fa460ba1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:27.442411 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-9dd7db4b-d659-483a-8a93-39fa460ba1d6 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:15:27.444364 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-9dd7db4b-d659-483a-8a93-39fa460ba1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:15:27.520494 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 108/236] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:15:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 15:15:27.544260 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf12eb-2774-437c-bf15-95d5464c1f40 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:27.639381 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b6995-a821-469d-a2ce-056085eecfba None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:27.639699 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b6995-a821-469d-a2ce-056085eecfba None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:27.639953 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b6995-a821-469d-a2ce-056085eecfba None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:27.642578 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 109/237] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:15:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:15:27.650574 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9b996-5cec-4451-8c19-1b1e5ef9258e None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:27.650865 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9b996-5cec-4451-8c19-1b1e5ef9258e None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:27.651127 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9b996-5cec-4451-8c19-1b1e5ef9258e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:27.675046 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-38b9b996-5cec-4451-8c19-1b1e5ef9258e None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:15:27.676302 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-38b9b996-5cec-4451-8c19-1b1e5ef9258e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:15:27.709194 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf12eb-2774-437c-bf15-95d5464c1f40 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:27.762828 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 110/238] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:15:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 15:15:27.768505 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:27.779254 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a31e34-7517-4d96-af5f-63c65e5c7b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:27.780350 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a31e34-7517-4d96-af5f-63c65e5c7b06 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:27.780802 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a31e34-7517-4d96-af5f-63c65e5c7b06 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:27.781296 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a31e34-7517-4d96-af5f-63c65e5c7b06 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:27.796429 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a31e34-7517-4d96-af5f-63c65e5c7b06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:15:27.804173 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-f0a31e34-7517-4d96-af5f-63c65e5c7b06 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 15:15:27.804173 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:15:27.804173 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:15:27.804173 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:15:27.804173 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:15:27.804173 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:15:27.804173 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:15:27.804173 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:15:27.804173 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:15:27.804173 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:15:27.804173 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:15:27.804173 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:15:27.804173 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:15:27.804173 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:15:27.804173 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:15:27.804173 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:15:27.805084 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:15:27.805084 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:15:27.805084 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:15:27.805084 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:15:27.805084 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:15:27.805084 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:15:27.805084 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:15:27.805084 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:15:27.805084 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:15:27.805084 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:15:27.805084 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:15:27.805084 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:15:27.805084 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:15:27.805084 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:15:27.805084 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:15:27.805084 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:15:27.805853 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:15:27.805853 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:15:27.805853 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:15:27.805853 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:15:27.805853 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:15:27.805853 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:15:27.805853 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:15:27.805853 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:15:27.805853 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:15:27.805853 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:15:27.805853 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 15:15:27.805853 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:15:27.805853 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 129/239] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 2 15:15:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 15:15:27.811522 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9b996-5cec-4451-8c19-1b1e5ef9258e None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:27.825700 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a31e34-7517-4d96-af5f-63c65e5c7b06 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:27.918685 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:28.008402 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a31e34-7517-4d96-af5f-63c65e5c7b06 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:28.045807 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9165774-8533-4ff5-85b3-20dca69771bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:28.046467 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9165774-8533-4ff5-85b3-20dca69771bc None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:28.046753 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9165774-8533-4ff5-85b3-20dca69771bc None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:28.047030 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9165774-8533-4ff5-85b3-20dca69771bc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:28.048295 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9165774-8533-4ff5-85b3-20dca69771bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:28.050099 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9165774-8533-4ff5-85b3-20dca69771bc None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:28.052122 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 130/240] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:15:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:28.057753 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9165774-8533-4ff5-85b3-20dca69771bc None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:28.064811 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9b996-5cec-4451-8c19-1b1e5ef9258e None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:28.142802 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355db522-944e-4bea-98ce-3da832d396a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:28.143560 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355db522-944e-4bea-98ce-3da832d396a0 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:28.143884 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355db522-944e-4bea-98ce-3da832d396a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:28.144189 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355db522-944e-4bea-98ce-3da832d396a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:28.144972 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355db522-944e-4bea-98ce-3da832d396a0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:28.145284 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355db522-944e-4bea-98ce-3da832d396a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:28.147278 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355db522-944e-4bea-98ce-3da832d396a0 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:28.159014 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 111/241] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 2 15:15:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:28.181973 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355db522-944e-4bea-98ce-3da832d396a0 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:28.196840 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:28.280336 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9165774-8533-4ff5-85b3-20dca69771bc None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:28.342421 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f27341a-c6f8-45ed-8614-231a99c45abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:28.343474 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27341a-c6f8-45ed-8614-231a99c45abd None admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:28.344168 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27341a-c6f8-45ed-8614-231a99c45abd None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:28.344595 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27341a-c6f8-45ed-8614-231a99c45abd None admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:28.346032 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f27341a-c6f8-45ed-8614-231a99c45abd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:28.347803 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f27341a-c6f8-45ed-8614-231a99c45abd None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:28.348206 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355db522-944e-4bea-98ce-3da832d396a0 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:28.356398 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:28.385700 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 131/242] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Aug 2 15:15:28 2022] POST /identity/v3/users => generated 293 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:15:28.387280 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa750b-b159-4a97-baa7-0348d0496eb0 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:28.388014 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa750b-b159-4a97-baa7-0348d0496eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:28.388428 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa750b-b159-4a97-baa7-0348d0496eb0 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:28.390008 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 132/243] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:15:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:15:28.396356 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb0128-a287-4096-af6f-ce5c3ac98f5b None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:28.397527 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb0128-a287-4096-af6f-ce5c3ac98f5b None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:28.397958 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb0128-a287-4096-af6f-ce5c3ac98f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:28.407696 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208662b3-d685-4761-9932-da04dceff21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:28.407945 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208662b3-d685-4761-9932-da04dceff21d None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:28.408338 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208662b3-d685-4761-9932-da04dceff21d None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:28.408744 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208662b3-d685-4761-9932-da04dceff21d None admin] PATH_INFO: `/v3/users/1bb7de14f26c43feb2595e4174820bcc` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:28.422646 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-55bb0128-a287-4096-af6f-ce5c3ac98f5b None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:15:28.424210 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-55bb0128-a287-4096-af6f-ce5c3ac98f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:15:28.445413 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208662b3-d685-4761-9932-da04dceff21d None admin] RBAC: Authorizing `identity:get_user(user_id=1bb7de14f26c43feb2595e4174820bcc)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:28.447151 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208662b3-d685-4761-9932-da04dceff21d None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:28.450933 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 112/244] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 2 15:15:28 2022] GET /identity/v3/users/1bb7de14f26c43feb2595e4174820bcc => generated 297 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:15:28.467563 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208662b3-d685-4761-9932-da04dceff21d None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:28.529160 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 133/245] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:15:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:15:28.556390 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb0128-a287-4096-af6f-ce5c3ac98f5b None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:28.615967 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:28.687140 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208662b3-d685-4761-9932-da04dceff21d None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:28.690453 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb0128-a287-4096-af6f-ce5c3ac98f5b None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:28.745815 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd88ca-cb93-48fb-94fe-3342620212ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:28.747036 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd88ca-cb93-48fb-94fe-3342620212ff None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:28.747542 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd88ca-cb93-48fb-94fe-3342620212ff None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:28.748038 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd88ca-cb93-48fb-94fe-3342620212ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:28.748946 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d9c803-d6bd-40cc-807f-d3a6cd33dac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:28.749702 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d9c803-d6bd-40cc-807f-d3a6cd33dac7 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:28.750053 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d9c803-d6bd-40cc-807f-d3a6cd33dac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:28.750422 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d9c803-d6bd-40cc-807f-d3a6cd33dac7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:28.765645 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d9c803-d6bd-40cc-807f-d3a6cd33dac7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:15:28.770902 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-30d9c803-d6bd-40cc-807f-d3a6cd33dac7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 15:15:28.770902 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:15:28.770902 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:15:28.770902 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:15:28.770902 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:15:28.770902 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:15:28.770902 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:15:28.770902 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:15:28.770902 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:15:28.770902 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:15:28.770902 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:15:28.770902 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:15:28.770902 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:15:28.770902 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:15:28.770902 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:15:28.770902 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:15:28.771896 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:15:28.771896 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:15:28.771896 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:15:28.771896 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:15:28.771896 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:15:28.771896 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:15:28.771896 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:15:28.771896 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:15:28.771896 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:15:28.771896 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:15:28.771896 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:15:28.771896 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:15:28.771896 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:15:28.771896 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:15:28.771896 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:15:28.771896 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:15:28.772769 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:15:28.772769 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:15:28.772769 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:15:28.772769 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:15:28.772769 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:15:28.772769 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:15:28.772769 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:15:28.772769 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:15:28.772769 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:15:28.772769 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:15:28.772769 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 15:15:28.772769 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:15:28.772769 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 134/246] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 2 15:15:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 15:15:28.778284 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d9c803-d6bd-40cc-807f-d3a6cd33dac7 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:28.796729 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:28.853211 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cd88ca-cb93-48fb-94fe-3342620212ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:28.855034 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cd88ca-cb93-48fb-94fe-3342620212ff None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:28.910537 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d9c803-d6bd-40cc-807f-d3a6cd33dac7 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:28.920841 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:28.956650 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17d6b62-593b-4840-b1e6-5ffe4b7a505b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:28.957577 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d6b62-593b-4840-b1e6-5ffe4b7a505b None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:28.958035 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d6b62-593b-4840-b1e6-5ffe4b7a505b None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:28.958483 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d6b62-593b-4840-b1e6-5ffe4b7a505b None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:28.959533 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17d6b62-593b-4840-b1e6-5ffe4b7a505b None admin] RBAC: Adding query filter params (name=member) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:28.960017 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17d6b62-593b-4840-b1e6-5ffe4b7a505b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:28.961591 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17d6b62-593b-4840-b1e6-5ffe4b7a505b None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:28.971645 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 135/247] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 2 15:15:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:15:28.979581 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17d6b62-593b-4840-b1e6-5ffe4b7a505b None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:28.984646 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 113/248] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 2 15:15:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 02 15:15:28.992023 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd88ca-cb93-48fb-94fe-3342620212ff None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:29.058660 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:29.101294 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd88ca-cb93-48fb-94fe-3342620212ff None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:29.101989 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17d6b62-593b-4840-b1e6-5ffe4b7a505b None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:29.141993 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e0ecd-5967-40bc-80ac-fe070094bf96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:29.142682 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e0ecd-5967-40bc-80ac-fe070094bf96 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:29.145964 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e0ecd-5967-40bc-80ac-fe070094bf96 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:29.145964 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e0ecd-5967-40bc-80ac-fe070094bf96 None admin] PATH_INFO: `/v3/projects/02cccaf1e1a44792916250e99dc79efa` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:29.147912 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3e0ecd-5967-40bc-80ac-fe070094bf96 None admin] RBAC: Authorizing `identity:get_project(project_id=02cccaf1e1a44792916250e99dc79efa)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:29.149391 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3e0ecd-5967-40bc-80ac-fe070094bf96 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:29.151303 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 114/249] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 2 15:15:28 2022] GET /identity/v3/projects/02cccaf1e1a44792916250e99dc79efa => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:29.157883 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b386da-bf6b-449f-b155-ff9584b36cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:29.157883 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b386da-bf6b-449f-b155-ff9584b36cc8 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:29.157883 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b386da-bf6b-449f-b155-ff9584b36cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:29.157883 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b386da-bf6b-449f-b155-ff9584b36cc8 None admin] PATH_INFO: `/v3/users/b1bdaa3e7e224590a075038af40805ea` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:29.158245 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b386da-bf6b-449f-b155-ff9584b36cc8 None admin] RBAC: Authorizing `identity:get_user(user_id=b1bdaa3e7e224590a075038af40805ea)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:29.158245 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b386da-bf6b-449f-b155-ff9584b36cc8 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:29.158364 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 136/250] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 2 15:15:28 2022] GET /identity/v3/users/b1bdaa3e7e224590a075038af40805ea => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:29.165645 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e0ecd-5967-40bc-80ac-fe070094bf96 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:29.168614 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b386da-bf6b-449f-b155-ff9584b36cc8 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:29.218274 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:29.295876 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e0ecd-5967-40bc-80ac-fe070094bf96 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:29.314914 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b386da-bf6b-449f-b155-ff9584b36cc8 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:29.364028 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:29.374788 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acc00b7-8898-4d89-9abc-b618f7b5dc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:29.375485 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc00b7-8898-4d89-9abc-b618f7b5dc1f None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:29.375768 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc00b7-8898-4d89-9abc-b618f7b5dc1f None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:29.376046 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc00b7-8898-4d89-9abc-b618f7b5dc1f None admin] PATH_INFO: `/v3/projects/02cccaf1e1a44792916250e99dc79efa` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:29.378738 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acc00b7-8898-4d89-9abc-b618f7b5dc1f None admin] RBAC: Authorizing `identity:get_project(project_id=02cccaf1e1a44792916250e99dc79efa)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:29.380666 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acc00b7-8898-4d89-9abc-b618f7b5dc1f None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:29.382842 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 115/251] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 2 15:15:29 2022] GET /identity/v3/projects/02cccaf1e1a44792916250e99dc79efa => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:29.384811 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72faa891-1e96-421d-8e85-7caaa9c2ec8f None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:29.385099 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72faa891-1e96-421d-8e85-7caaa9c2ec8f None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:29.385374 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72faa891-1e96-421d-8e85-7caaa9c2ec8f None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:29.397682 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 116/252] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:15:29 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:15:29.397682 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72faa891-1e96-421d-8e85-7caaa9c2ec8f None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:29.408370 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31d3e9-e643-424f-a705-13e5793aecf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:29.409375 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31d3e9-e643-424f-a705-13e5793aecf5 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:29.409882 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31d3e9-e643-424f-a705-13e5793aecf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:29.410376 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31d3e9-e643-424f-a705-13e5793aecf5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:29.411422 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31d3e9-e643-424f-a705-13e5793aecf5 None admin] RBAC: Adding query filter params (role.id=f3287619b177442b8bf83cf5f376b897, scope.project.id=02cccaf1e1a44792916250e99dc79efa, user.id=1bb7de14f26c43feb2595e4174820bcc) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:29.411960 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31d3e9-e643-424f-a705-13e5793aecf5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:29.414464 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31d3e9-e643-424f-a705-13e5793aecf5 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:29.435055 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 137/253] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 2 15:15:29 2022] GET /identity/v3/role_assignments?user.id=1bb7de14f26c43feb2595e4174820bcc&scope.project.id=02cccaf1e1a44792916250e99dc79efa&role.id=f3287619b177442b8bf83cf5f376b897 => generated 259 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:29.436358 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd381c9-ae06-4733-863a-2346547e7e0a None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:29.436649 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd381c9-ae06-4733-863a-2346547e7e0a None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:29.436929 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd381c9-ae06-4733-863a-2346547e7e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:29.486267 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-0cd381c9-ae06-4733-863a-2346547e7e0a None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:15:29.487530 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-0cd381c9-ae06-4733-863a-2346547e7e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:15:29.561384 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72faa891-1e96-421d-8e85-7caaa9c2ec8f None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:29.624693 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df001e3-4b5a-4b16-a6b3-5407a4fee876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:29.625410 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df001e3-4b5a-4b16-a6b3-5407a4fee876 None admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:29.625697 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df001e3-4b5a-4b16-a6b3-5407a4fee876 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:29.625984 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df001e3-4b5a-4b16-a6b3-5407a4fee876 None admin] PATH_INFO: `/v3/projects/02cccaf1e1a44792916250e99dc79efa/users/b1bdaa3e7e224590a075038af40805ea/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:29.628149 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df001e3-4b5a-4b16-a6b3-5407a4fee876 None admin] RBAC: Authorizing `identity:create_grant(project_id=02cccaf1e1a44792916250e99dc79efa, user_id=b1bdaa3e7e224590a075038af40805ea, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:29.629622 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df001e3-4b5a-4b16-a6b3-5407a4fee876 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:29.654470 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 117/254] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 2 15:15:29 2022] PUT /identity/v3/projects/02cccaf1e1a44792916250e99dc79efa/users/b1bdaa3e7e224590a075038af40805ea/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:15:29.678443 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 138/255] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:15:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:15:29.702527 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df001e3-4b5a-4b16-a6b3-5407a4fee876 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:29.807160 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:29.860268 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df001e3-4b5a-4b16-a6b3-5407a4fee876 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:29.910932 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7949135-db9f-4592-ae59-939513aeddc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:29.911539 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7949135-db9f-4592-ae59-939513aeddc3 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:29.911821 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7949135-db9f-4592-ae59-939513aeddc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:29.912095 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7949135-db9f-4592-ae59-939513aeddc3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:29.932440 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7949135-db9f-4592-ae59-939513aeddc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:15:29.937605 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-d7949135-db9f-4592-ae59-939513aeddc3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 15:15:29.937605 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:15:29.937605 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:15:29.937605 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:15:29.937605 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:15:29.937605 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:15:29.937605 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:15:29.937605 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:15:29.937605 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:15:29.937605 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:15:29.937605 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:15:29.937605 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:15:29.937605 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:15:29.937605 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:15:29.937605 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:15:29.937605 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:15:29.938466 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:15:29.938466 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:15:29.938466 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:15:29.938466 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:15:29.938466 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:15:29.938466 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:15:29.938466 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:15:29.938466 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:15:29.938466 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:15:29.938466 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:15:29.938466 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:15:29.938466 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:15:29.938466 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:15:29.938466 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:15:29.938466 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:15:29.938466 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:15:29.939293 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:15:29.939293 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:15:29.939293 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:15:29.939293 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:15:29.939293 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:15:29.939293 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:15:29.939293 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:15:29.939293 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:15:29.939293 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:15:29.939293 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:15:29.939293 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 15:15:29.939293 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:15:29.939293 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 118/256] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 2 15:15:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:15:29.948400 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd381c9-ae06-4733-863a-2346547e7e0a None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:30.005675 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:30.054041 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04171f4a-1af2-4171-93ac-9d6f4f18085d None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:30.054353 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04171f4a-1af2-4171-93ac-9d6f4f18085d None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:30.054603 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04171f4a-1af2-4171-93ac-9d6f4f18085d None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:30.056162 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 119/257] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:15:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:15:30.064571 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff78558-ec73-422c-9a17-0de5bb8c3687 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:30.064861 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff78558-ec73-422c-9a17-0de5bb8c3687 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:30.065147 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff78558-ec73-422c-9a17-0de5bb8c3687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:30.099877 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd381c9-ae06-4733-863a-2346547e7e0a None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:30.103987 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-9ff78558-ec73-422c-9a17-0de5bb8c3687 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:15:30.105190 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-9ff78558-ec73-422c-9a17-0de5bb8c3687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:15:30.166165 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd1bbe-3f43-4c5f-8693-5214f84e4b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:30.166734 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd1bbe-3f43-4c5f-8693-5214f84e4b3d None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:30.167019 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd1bbe-3f43-4c5f-8693-5214f84e4b3d None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:30.167320 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd1bbe-3f43-4c5f-8693-5214f84e4b3d None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:30.168045 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fd1bbe-3f43-4c5f-8693-5214f84e4b3d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:30.168376 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fd1bbe-3f43-4c5f-8693-5214f84e4b3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:30.169821 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fd1bbe-3f43-4c5f-8693-5214f84e4b3d None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:30.191924 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 139/258] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 2 15:15:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:30.198120 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd1bbe-3f43-4c5f-8693-5214f84e4b3d None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:30.237932 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 120/259] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:15:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:15:30.270187 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff78558-ec73-422c-9a17-0de5bb8c3687 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:30.352950 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:30.366994 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd1bbe-3f43-4c5f-8693-5214f84e4b3d None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:30.405846 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:30.432037 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0f42ec-a6cb-4d5a-94a3-1b4c224dfafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:30.432615 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f42ec-a6cb-4d5a-94a3-1b4c224dfafe None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:30.432895 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f42ec-a6cb-4d5a-94a3-1b4c224dfafe None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:30.433173 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f42ec-a6cb-4d5a-94a3-1b4c224dfafe None admin] PATH_INFO: `/v3/users/c75f6c42ab30436ab529f926fc850408` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:30.434466 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0f42ec-a6cb-4d5a-94a3-1b4c224dfafe None admin] RBAC: Authorizing `identity:get_user(user_id=c75f6c42ab30436ab529f926fc850408)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:30.436009 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0f42ec-a6cb-4d5a-94a3-1b4c224dfafe None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:30.437640 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 140/260] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 2 15:15:30 2022] GET /identity/v3/users/c75f6c42ab30436ab529f926fc850408 => generated 283 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:30.447115 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0f42ec-a6cb-4d5a-94a3-1b4c224dfafe None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:30.520548 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff78558-ec73-422c-9a17-0de5bb8c3687 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:30.596151 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fbe10f-687b-4509-8460-3389b613f061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:30.596831 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fbe10f-687b-4509-8460-3389b613f061 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:30.597116 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fbe10f-687b-4509-8460-3389b613f061 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:30.597397 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fbe10f-687b-4509-8460-3389b613f061 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:30.617523 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fbe10f-687b-4509-8460-3389b613f061 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:15:30.628966 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-65fbe10f-687b-4509-8460-3389b613f061 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 15:15:30.628966 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:15:30.628966 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:15:30.628966 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:15:30.628966 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:15:30.628966 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:15:30.628966 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:15:30.628966 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:15:30.628966 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:15:30.628966 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:15:30.628966 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:15:30.628966 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:15:30.628966 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:15:30.628966 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:15:30.628966 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:15:30.628966 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:15:30.629971 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:15:30.629971 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:15:30.629971 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:15:30.629971 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:15:30.629971 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:15:30.629971 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:15:30.629971 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:15:30.629971 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:15:30.629971 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:15:30.629971 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:15:30.629971 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:15:30.629971 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:15:30.629971 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:15:30.629971 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:15:30.629971 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:15:30.629971 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:15:30.630766 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:15:30.630766 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:15:30.630766 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:15:30.630766 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:15:30.630766 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:15:30.630766 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:15:30.630766 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:15:30.630766 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:15:30.630766 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:15:30.630766 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:15:30.630766 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 15:15:30.630766 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:15:30.635415 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 121/261] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Aug 2 15:15:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 15:15:30.636296 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fbe10f-687b-4509-8460-3389b613f061 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:30.680641 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0f42ec-a6cb-4d5a-94a3-1b4c224dfafe None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:30.751548 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fbe10f-687b-4509-8460-3389b613f061 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:30.762369 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:30.768495 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff187c22-08ed-49de-8f6d-13421a422af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:30.769179 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff187c22-08ed-49de-8f6d-13421a422af4 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:30.769483 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff187c22-08ed-49de-8f6d-13421a422af4 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:30.769741 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff187c22-08ed-49de-8f6d-13421a422af4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:30.786982 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb882889-4804-4441-8fd0-3037dfdca9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:30.788500 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb882889-4804-4441-8fd0-3037dfdca9eb None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:30.788866 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb882889-4804-4441-8fd0-3037dfdca9eb None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:30.789218 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb882889-4804-4441-8fd0-3037dfdca9eb None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:30.790022 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb882889-4804-4441-8fd0-3037dfdca9eb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:30.790409 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb882889-4804-4441-8fd0-3037dfdca9eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:30.791923 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb882889-4804-4441-8fd0-3037dfdca9eb None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:30.801320 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 122/262] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 2 15:15:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:15:30.807239 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb882889-4804-4441-8fd0-3037dfdca9eb None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:30.835601 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:30.913138 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb882889-4804-4441-8fd0-3037dfdca9eb None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:30.928788 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff187c22-08ed-49de-8f6d-13421a422af4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:30.930354 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff187c22-08ed-49de-8f6d-13421a422af4 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:30.980496 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afcb5fb-ac8b-4756-ab4c-87b3a30b3b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:30.981159 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afcb5fb-ac8b-4756-ab4c-87b3a30b3b5e None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:30.981449 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afcb5fb-ac8b-4756-ab4c-87b3a30b3b5e None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:30.981733 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afcb5fb-ac8b-4756-ab4c-87b3a30b3b5e None admin] PATH_INFO: `/v3/users/c75f6c42ab30436ab529f926fc850408` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:30.987929 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afcb5fb-ac8b-4756-ab4c-87b3a30b3b5e None admin] RBAC: Authorizing `identity:get_user(user_id=c75f6c42ab30436ab529f926fc850408)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:30.989387 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afcb5fb-ac8b-4756-ab4c-87b3a30b3b5e None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:30.991054 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 123/263] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 2 15:15:30 2022] GET /identity/v3/users/c75f6c42ab30436ab529f926fc850408 => generated 283 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:15:30.996457 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afcb5fb-ac8b-4756-ab4c-87b3a30b3b5e None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:31.077363 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:31.178373 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 141/264] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 2 15:15:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 731 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 02 15:15:31.183859 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff187c22-08ed-49de-8f6d-13421a422af4 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:31.226340 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afcb5fb-ac8b-4756-ab4c-87b3a30b3b5e None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:31.299588 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d8370e-0a91-4eca-b706-22925073e80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:31.300507 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8370e-0a91-4eca-b706-22925073e80b None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:31.300991 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8370e-0a91-4eca-b706-22925073e80b None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:31.301409 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8370e-0a91-4eca-b706-22925073e80b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:31.319909 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:31.417709 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff187c22-08ed-49de-8f6d-13421a422af4 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:31.465351 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d8370e-0a91-4eca-b706-22925073e80b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:31.467089 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d8370e-0a91-4eca-b706-22925073e80b None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:31.486984 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb492709-4e3c-4934-9944-3850af56e9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:31.487683 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb492709-4e3c-4934-9944-3850af56e9f6 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:31.489043 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb492709-4e3c-4934-9944-3850af56e9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:31.489043 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb492709-4e3c-4934-9944-3850af56e9f6 None admin] PATH_INFO: `/v3/projects/02cccaf1e1a44792916250e99dc79efa` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:31.491399 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb492709-4e3c-4934-9944-3850af56e9f6 None admin] RBAC: Authorizing `identity:get_project(project_id=02cccaf1e1a44792916250e99dc79efa)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:31.493060 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb492709-4e3c-4934-9944-3850af56e9f6 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:31.495136 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 142/265] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 2 15:15:31 2022] GET /identity/v3/projects/02cccaf1e1a44792916250e99dc79efa => generated 302 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:15:31.502492 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb492709-4e3c-4934-9944-3850af56e9f6 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:31.572572 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:31.689098 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 124/266] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 2 15:15:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 693 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 02 15:15:31.696546 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d8370e-0a91-4eca-b706-22925073e80b None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:31.726132 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb492709-4e3c-4934-9944-3850af56e9f6 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:31.785152 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:31.805655 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e34533c-e466-46d6-89fb-11ffeb9bc3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:31.806281 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34533c-e466-46d6-89fb-11ffeb9bc3ac None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:31.807679 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34533c-e466-46d6-89fb-11ffeb9bc3ac None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:31.807979 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34533c-e466-46d6-89fb-11ffeb9bc3ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:31.808880 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e34533c-e466-46d6-89fb-11ffeb9bc3ac None admin] RBAC: Adding query filter params (role.id=d75c9572cb294caeb8eb456521ff6f57, scope.project.id=02cccaf1e1a44792916250e99dc79efa, user.id=c75f6c42ab30436ab529f926fc850408) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:31.809105 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e34533c-e466-46d6-89fb-11ffeb9bc3ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:31.810594 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e34533c-e466-46d6-89fb-11ffeb9bc3ac None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:31.818044 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 143/267] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 2 15:15:31 2022] GET /identity/v3/role_assignments?user.id=c75f6c42ab30436ab529f926fc850408&scope.project.id=02cccaf1e1a44792916250e99dc79efa&role.id=d75c9572cb294caeb8eb456521ff6f57 => generated 608 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:15:31.894020 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d8370e-0a91-4eca-b706-22925073e80b None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:31.920237 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381eeb81-e90a-49aa-b5b8-9414d8fd74ba None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:31.920690 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381eeb81-e90a-49aa-b5b8-9414d8fd74ba None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:31.921070 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381eeb81-e90a-49aa-b5b8-9414d8fd74ba None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:31.922769 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 144/268] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:15:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:15:31.936973 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df9766-1239-4efd-bf6e-342e017ec77a None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:31.937253 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df9766-1239-4efd-bf6e-342e017ec77a None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:31.937528 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df9766-1239-4efd-bf6e-342e017ec77a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:31.947273 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612f51da-c9f3-4f2f-9691-07382bf75edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:31.948347 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f51da-c9f3-4f2f-9691-07382bf75edd None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:31.948806 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f51da-c9f3-4f2f-9691-07382bf75edd None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:31.949345 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f51da-c9f3-4f2f-9691-07382bf75edd None admin] PATH_INFO: `/v3/projects/02cccaf1e1a44792916250e99dc79efa` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:31.952064 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612f51da-c9f3-4f2f-9691-07382bf75edd None admin] RBAC: Authorizing `identity:get_project(project_id=02cccaf1e1a44792916250e99dc79efa)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:31.953562 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612f51da-c9f3-4f2f-9691-07382bf75edd None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:31.955481 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 125/269] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 2 15:15:31 2022] GET /identity/v3/projects/02cccaf1e1a44792916250e99dc79efa => generated 302 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:31.964525 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612f51da-c9f3-4f2f-9691-07382bf75edd None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:31.976804 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:31.984285 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-a1df9766-1239-4efd-bf6e-342e017ec77a None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:15:31.985501 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-a1df9766-1239-4efd-bf6e-342e017ec77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:15:32.109444 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 145/270] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:15:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:15:32.111444 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0691b0-68f7-4208-81e0-539e675dd362 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:32.111742 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0691b0-68f7-4208-81e0-539e675dd362 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:32.112023 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0691b0-68f7-4208-81e0-539e675dd362 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:32.113656 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 146/271] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:15:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:15:32.121071 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f71512-5128-478f-85be-c7006cb2cb73 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:32.121628 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f71512-5128-478f-85be-c7006cb2cb73 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:32.121922 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f71512-5128-478f-85be-c7006cb2cb73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:32.126973 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612f51da-c9f3-4f2f-9691-07382bf75edd None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:32.149349 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-c1f71512-5128-478f-85be-c7006cb2cb73 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:15:32.150565 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-c1f71512-5128-478f-85be-c7006cb2cb73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:15:32.171129 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bacabe-c931-46ec-a3ed-30ccd428f629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:32.171781 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bacabe-c931-46ec-a3ed-30ccd428f629 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:32.172064 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bacabe-c931-46ec-a3ed-30ccd428f629 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:32.172339 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bacabe-c931-46ec-a3ed-30ccd428f629 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:32.173126 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bacabe-c931-46ec-a3ed-30ccd428f629 None admin] RBAC: Adding query filter params (role.id=3e1c8e0567ff4244aef0d6a62fc8b18d, scope.project.id=02cccaf1e1a44792916250e99dc79efa, user.id=c75f6c42ab30436ab529f926fc850408) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:32.173433 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bacabe-c931-46ec-a3ed-30ccd428f629 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:32.174867 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bacabe-c931-46ec-a3ed-30ccd428f629 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:32.184463 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 126/272] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 2 15:15:31 2022] GET /identity/v3/role_assignments?user.id=c75f6c42ab30436ab529f926fc850408&scope.project.id=02cccaf1e1a44792916250e99dc79efa&role.id=3e1c8e0567ff4244aef0d6a62fc8b18d => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:32.185302 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bacabe-c931-46ec-a3ed-30ccd428f629 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:32.284492 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 147/273] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:15:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 15:15:32.335238 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:32.335565 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f71512-5128-478f-85be-c7006cb2cb73 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:32.408559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bacabe-c931-46ec-a3ed-30ccd428f629 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:32.461284 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:32.488577 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d0409-c1a0-4ff1-9890-7bbf586d19e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:32.488952 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d0409-c1a0-4ff1-9890-7bbf586d19e4 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:32.489240 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d0409-c1a0-4ff1-9890-7bbf586d19e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:32.489517 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d0409-c1a0-4ff1-9890-7bbf586d19e4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:32.491976 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d0409-c1a0-4ff1-9890-7bbf586d19e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:32.493502 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d0409-c1a0-4ff1-9890-7bbf586d19e4 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:32.496112 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 127/274] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:15:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:32.502257 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a0d0e-7e33-4509-9ca2-d4bed966ea44 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:32.502257 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a0d0e-7e33-4509-9ca2-d4bed966ea44 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:32.502257 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a0d0e-7e33-4509-9ca2-d4bed966ea44 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:32.502257 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 128/275] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:15:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:15:32.502765 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a0d0e-7e33-4509-9ca2-d4bed966ea44 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:32.561658 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f71512-5128-478f-85be-c7006cb2cb73 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:32.622694 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78bb4e3-2a77-4af3-a020-9766d1f3493c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:32.623473 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78bb4e3-2a77-4af3-a020-9766d1f3493c None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:32.623832 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78bb4e3-2a77-4af3-a020-9766d1f3493c None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:32.624268 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78bb4e3-2a77-4af3-a020-9766d1f3493c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:32.640104 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78bb4e3-2a77-4af3-a020-9766d1f3493c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:15:32.645884 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-d78bb4e3-2a77-4af3-a020-9766d1f3493c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 15:15:32.645884 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:15:32.645884 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:15:32.645884 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:15:32.645884 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:15:32.645884 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:15:32.645884 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:15:32.645884 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:15:32.645884 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:15:32.645884 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:15:32.645884 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:15:32.645884 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:15:32.645884 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:15:32.645884 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:15:32.645884 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:15:32.645884 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:15:32.647778 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:15:32.647778 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:15:32.647778 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:15:32.647778 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:15:32.647778 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:15:32.647778 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:15:32.647778 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:15:32.647778 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:15:32.647778 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:15:32.647778 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:15:32.647778 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:15:32.647778 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:15:32.647778 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:15:32.647778 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:15:32.647778 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:15:32.647778 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:15:32.648599 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:15:32.648599 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:15:32.648599 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:15:32.648599 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:15:32.648599 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:15:32.648599 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:15:32.648599 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:15:32.648599 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:15:32.648599 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:15:32.648599 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:15:32.648599 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 15:15:32.648599 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:15:32.648599 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 148/276] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 2 15:15:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:15:32.649316 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1536b17-8268-468a-9cee-765af4e450da None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:32.649316 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1536b17-8268-468a-9cee-765af4e450da None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:32.649815 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1536b17-8268-468a-9cee-765af4e450da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:32.661105 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a0d0e-7e33-4509-9ca2-d4bed966ea44 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:32.669667 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-f1536b17-8268-468a-9cee-765af4e450da None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:15:32.671455 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-f1536b17-8268-468a-9cee-765af4e450da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:15:32.705401 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ad9c8-3d71-470c-8aed-6e669571f95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:32.706084 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ad9c8-3d71-470c-8aed-6e669571f95d None admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:32.706301 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ad9c8-3d71-470c-8aed-6e669571f95d None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:32.706581 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ad9c8-3d71-470c-8aed-6e669571f95d None admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:32.707567 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218ad9c8-3d71-470c-8aed-6e669571f95d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:32.709761 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218ad9c8-3d71-470c-8aed-6e669571f95d None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:32.724782 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:32.744169 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 129/277] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Aug 2 15:15:32 2022] POST /identity/v3/users => generated 293 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:15:32.744169 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ad9c8-3d71-470c-8aed-6e669571f95d None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:32.813036 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 149/278] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:15:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:15:32.840587 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1536b17-8268-468a-9cee-765af4e450da None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:32.911998 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:32.924662 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ad9c8-3d71-470c-8aed-6e669571f95d None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:32.966712 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b956e-ecbd-4fd2-96ba-7e814f77d906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:32.967369 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b956e-ecbd-4fd2-96ba-7e814f77d906 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:32.967653 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b956e-ecbd-4fd2-96ba-7e814f77d906 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:32.967926 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b956e-ecbd-4fd2-96ba-7e814f77d906 None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:32.968645 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3b956e-ecbd-4fd2-96ba-7e814f77d906 None admin] RBAC: Adding query filter params (name=member) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:32.969640 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3b956e-ecbd-4fd2-96ba-7e814f77d906 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:32.970315 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3b956e-ecbd-4fd2-96ba-7e814f77d906 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:32.981042 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 130/279] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 2 15:15:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:32.982190 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1307e65d-2c50-4a28-98a8-24be95ecc89e None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:32.982475 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1307e65d-2c50-4a28-98a8-24be95ecc89e None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:32.982751 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1307e65d-2c50-4a28-98a8-24be95ecc89e None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:32.984116 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 131/280] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:15:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:15:32.987912 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1307e65d-2c50-4a28-98a8-24be95ecc89e None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:32.989017 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1536b17-8268-468a-9cee-765af4e450da None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:33.036280 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711bbf9-f713-46ff-877f-795f9593b6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:33.036928 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711bbf9-f713-46ff-877f-795f9593b6ef None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:33.037247 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711bbf9-f713-46ff-877f-795f9593b6ef None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:33.037524 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711bbf9-f713-46ff-877f-795f9593b6ef None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:33.050939 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9711bbf9-f713-46ff-877f-795f9593b6ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:15:33.058563 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-9711bbf9-f713-46ff-877f-795f9593b6ef None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 15:15:33.058563 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:15:33.058563 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:15:33.058563 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:15:33.058563 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:15:33.058563 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:15:33.058563 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:15:33.058563 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:15:33.058563 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:15:33.058563 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:15:33.058563 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:15:33.058563 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:15:33.058563 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:15:33.058563 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:15:33.058563 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:15:33.058563 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:15:33.059574 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:15:33.059574 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:15:33.059574 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:15:33.059574 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:15:33.059574 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:15:33.059574 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:15:33.059574 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:15:33.059574 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:15:33.059574 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:15:33.059574 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:15:33.059574 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:15:33.059574 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:15:33.059574 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:15:33.059574 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:15:33.059574 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:15:33.059574 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:15:33.060376 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:15:33.060376 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:15:33.060376 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:15:33.060376 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:15:33.060376 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:15:33.060376 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:15:33.060376 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:15:33.060376 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:15:33.060376 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:15:33.060376 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:15:33.060376 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 15:15:33.060376 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:15:33.060376 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 150/281] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 2 15:15:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:15:33.061692 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8bcc7-e72e-4a3b-98b0-64ac8f60b07b None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:33.061692 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8bcc7-e72e-4a3b-98b0-64ac8f60b07b None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:33.061846 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8bcc7-e72e-4a3b-98b0-64ac8f60b07b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:33.079052 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:33.083786 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-3bc8bcc7-e72e-4a3b-98b0-64ac8f60b07b None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:15:33.085039 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-3bc8bcc7-e72e-4a3b-98b0-64ac8f60b07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:15:33.128248 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1307e65d-2c50-4a28-98a8-24be95ecc89e None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:33.174543 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e9c15-e009-4b46-8068-2b9ca2d6bc6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:33.175582 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 151/282] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:15:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:15:33.175916 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e9c15-e009-4b46-8068-2b9ca2d6bc6e None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:33.176417 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e9c15-e009-4b46-8068-2b9ca2d6bc6e None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:33.176539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8bcc7-e72e-4a3b-98b0-64ac8f60b07b None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:33.177103 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e9c15-e009-4b46-8068-2b9ca2d6bc6e None admin] PATH_INFO: `/v3/users/b44af8b0317d4150be26924bf8f8a489` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:33.193143 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866e9c15-e009-4b46-8068-2b9ca2d6bc6e None admin] RBAC: Authorizing `identity:get_user(user_id=b44af8b0317d4150be26924bf8f8a489)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:33.195776 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866e9c15-e009-4b46-8068-2b9ca2d6bc6e None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:33.198364 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 132/283] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 2 15:15:32 2022] GET /identity/v3/users/b44af8b0317d4150be26924bf8f8a489 => generated 293 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:33.203919 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e9c15-e009-4b46-8068-2b9ca2d6bc6e None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:33.214788 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:33.308953 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8bcc7-e72e-4a3b-98b0-64ac8f60b07b None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:33.330885 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e9c15-e009-4b46-8068-2b9ca2d6bc6e None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:33.347579 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e738e0af-e45c-4564-a7b3-a18db0e39baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:33.348216 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738e0af-e45c-4564-a7b3-a18db0e39baa None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:33.348496 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738e0af-e45c-4564-a7b3-a18db0e39baa None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:33.348772 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738e0af-e45c-4564-a7b3-a18db0e39baa None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:33.349516 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e738e0af-e45c-4564-a7b3-a18db0e39baa None admin] RBAC: Adding query filter params (name=reader) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:33.350570 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:33.350766 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e738e0af-e45c-4564-a7b3-a18db0e39baa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:33.353073 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e738e0af-e45c-4564-a7b3-a18db0e39baa None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:33.363765 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 152/284] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 2 15:15:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:33.364668 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e738e0af-e45c-4564-a7b3-a18db0e39baa None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:33.371728 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab728d2-bf7d-4008-98ec-aa8b905da5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:33.372681 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab728d2-bf7d-4008-98ec-aa8b905da5c4 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:33.373154 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab728d2-bf7d-4008-98ec-aa8b905da5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:33.373678 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab728d2-bf7d-4008-98ec-aa8b905da5c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:33.374719 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab728d2-bf7d-4008-98ec-aa8b905da5c4 None admin] RBAC: Adding query filter params (role.id=bf4fcdd92d8a4a6d855f3eaa4f542529, user.id=b44af8b0317d4150be26924bf8f8a489, scope.system=all) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:33.375251 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab728d2-bf7d-4008-98ec-aa8b905da5c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:33.377197 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab728d2-bf7d-4008-98ec-aa8b905da5c4 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:33.383365 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 133/285] 10.222.0.42 () {56 vars in 1308 bytes} [Tue Aug 2 15:15:33 2022] GET /identity/v3/role_assignments?user.id=b44af8b0317d4150be26924bf8f8a489&scope.system=all&role.id=bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:33.384539 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab728d2-bf7d-4008-98ec-aa8b905da5c4 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:33.475427 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:33.484364 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e738e0af-e45c-4564-a7b3-a18db0e39baa None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:33.498562 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab728d2-bf7d-4008-98ec-aa8b905da5c4 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:33.527368 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab05a2c8-39d2-4146-8edf-916e0de8b550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:33.528114 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05a2c8-39d2-4146-8edf-916e0de8b550 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:33.528402 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05a2c8-39d2-4146-8edf-916e0de8b550 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:33.528679 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05a2c8-39d2-4146-8edf-916e0de8b550 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:33.538037 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a66acb8-87f2-4650-bdde-7a4d28aa13f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:33.539459 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66acb8-87f2-4650-bdde-7a4d28aa13f1 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:33.539970 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66acb8-87f2-4650-bdde-7a4d28aa13f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:33.540440 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66acb8-87f2-4650-bdde-7a4d28aa13f1 None admin] PATH_INFO: `/v3/users/1bb7de14f26c43feb2595e4174820bcc` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:33.541873 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab05a2c8-39d2-4146-8edf-916e0de8b550 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:15:33.542184 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a66acb8-87f2-4650-bdde-7a4d28aa13f1 None admin] RBAC: Authorizing `identity:get_user(user_id=1bb7de14f26c43feb2595e4174820bcc)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:33.544079 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a66acb8-87f2-4650-bdde-7a4d28aa13f1 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:33.546423 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 134/286] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 2 15:15:33 2022] GET /identity/v3/users/1bb7de14f26c43feb2595e4174820bcc => generated 297 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:33.550726 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-ab05a2c8-39d2-4146-8edf-916e0de8b550 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 15:15:33.550726 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:15:33.550726 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:15:33.550726 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:15:33.550726 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:15:33.550726 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:15:33.550726 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:15:33.550726 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:15:33.550726 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:15:33.550726 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:15:33.550726 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:15:33.550726 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:15:33.550726 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:15:33.550726 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:15:33.550726 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:15:33.550726 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:15:33.551702 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:15:33.551702 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:15:33.551702 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:15:33.551702 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:15:33.551702 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:15:33.551702 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:15:33.551702 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:15:33.551702 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:15:33.551702 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:15:33.551702 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:15:33.551702 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:15:33.551702 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:15:33.551702 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:15:33.551702 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:15:33.551702 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:15:33.551702 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:15:33.552481 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:15:33.552481 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:15:33.552481 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:15:33.552481 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:15:33.552481 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:15:33.552481 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:15:33.552481 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:15:33.552481 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:15:33.552481 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:15:33.552481 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:15:33.552481 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 15:15:33.552481 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:15:33.552481 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 153/287] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 2 15:15:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:15:33.557464 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab05a2c8-39d2-4146-8edf-916e0de8b550 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:33.558314 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a66acb8-87f2-4650-bdde-7a4d28aa13f1 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:33.661967 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:33.723433 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab05a2c8-39d2-4146-8edf-916e0de8b550 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:33.735269 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a66acb8-87f2-4650-bdde-7a4d28aa13f1 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:33.774431 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed0a05-dd9b-4bcd-902d-e1cd80947174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:33.775075 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed0a05-dd9b-4bcd-902d-e1cd80947174 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:33.775378 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed0a05-dd9b-4bcd-902d-e1cd80947174 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:33.775708 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed0a05-dd9b-4bcd-902d-e1cd80947174 None admin] PATH_INFO: `/v3/projects/02cccaf1e1a44792916250e99dc79efa` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:33.778189 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ed0a05-dd9b-4bcd-902d-e1cd80947174 None admin] RBAC: Authorizing `identity:get_project(project_id=02cccaf1e1a44792916250e99dc79efa)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:33.779677 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ed0a05-dd9b-4bcd-902d-e1cd80947174 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:33.783673 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 135/288] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 2 15:15:33 2022] GET /identity/v3/projects/02cccaf1e1a44792916250e99dc79efa => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:33.790662 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed0a05-dd9b-4bcd-902d-e1cd80947174 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:33.796337 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d566f2d-2bb4-4293-850e-b53de508f9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:33.796972 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d566f2d-2bb4-4293-850e-b53de508f9c3 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:33.797251 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d566f2d-2bb4-4293-850e-b53de508f9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:33.797523 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d566f2d-2bb4-4293-850e-b53de508f9c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:33.798236 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d566f2d-2bb4-4293-850e-b53de508f9c3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:33.798534 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d566f2d-2bb4-4293-850e-b53de508f9c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:33.805071 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d566f2d-2bb4-4293-850e-b53de508f9c3 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:33.822026 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 154/289] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 2 15:15:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:33.829495 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d566f2d-2bb4-4293-850e-b53de508f9c3 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:33.877580 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:33.924150 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed0a05-dd9b-4bcd-902d-e1cd80947174 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:33.945545 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:33.963282 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb4571e-6043-4395-8b87-d3fb7388b5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:33.964012 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb4571e-6043-4395-8b87-d3fb7388b5a8 None admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:33.964322 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb4571e-6043-4395-8b87-d3fb7388b5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:33.964703 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb4571e-6043-4395-8b87-d3fb7388b5a8 None admin] PATH_INFO: `/v3/projects/02cccaf1e1a44792916250e99dc79efa/users/1bb7de14f26c43feb2595e4174820bcc/roles/f3287619b177442b8bf83cf5f376b897` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:33.966991 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb4571e-6043-4395-8b87-d3fb7388b5a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=02cccaf1e1a44792916250e99dc79efa, user_id=1bb7de14f26c43feb2595e4174820bcc, role_id=f3287619b177442b8bf83cf5f376b897)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:33.968539 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb4571e-6043-4395-8b87-d3fb7388b5a8 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:33.984779 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 136/290] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 2 15:15:33 2022] PUT /identity/v3/projects/02cccaf1e1a44792916250e99dc79efa/users/1bb7de14f26c43feb2595e4174820bcc/roles/f3287619b177442b8bf83cf5f376b897 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:15:34.129065 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d566f2d-2bb4-4293-850e-b53de508f9c3 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:34.177235 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed604e-c8de-4c79-b292-627bc45ebb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:34.177851 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed604e-c8de-4c79-b292-627bc45ebb36 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:34.178115 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed604e-c8de-4c79-b292-627bc45ebb36 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:34.178387 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed604e-c8de-4c79-b292-627bc45ebb36 None admin] PATH_INFO: `/v3/users/b1bdaa3e7e224590a075038af40805ea` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:34.179603 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed604e-c8de-4c79-b292-627bc45ebb36 None admin] RBAC: Authorizing `identity:get_user(user_id=b1bdaa3e7e224590a075038af40805ea)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:34.181068 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed604e-c8de-4c79-b292-627bc45ebb36 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:34.184997 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 155/291] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 2 15:15:33 2022] GET /identity/v3/users/b1bdaa3e7e224590a075038af40805ea => generated 297 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:34.188160 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb4571e-6043-4395-8b87-d3fb7388b5a8 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:34.320025 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb4571e-6043-4395-8b87-d3fb7388b5a8 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:34.365305 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac17c1-da14-47f7-b318-6c5baefccbbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:34.366230 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac17c1-da14-47f7-b318-6c5baefccbbf None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:34.366682 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac17c1-da14-47f7-b318-6c5baefccbbf None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:34.367124 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac17c1-da14-47f7-b318-6c5baefccbbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:34.435324 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:34.468418 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ac17c1-da14-47f7-b318-6c5baefccbbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:34.470337 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ac17c1-da14-47f7-b318-6c5baefccbbf None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:34.592278 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 137/292] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 2 15:15:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 02 15:15:34.597400 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed604e-c8de-4c79-b292-627bc45ebb36 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:34.719749 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:34.739659 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed604e-c8de-4c79-b292-627bc45ebb36 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:34.786732 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e1e508-bca4-4558-b905-19e30fdec449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:34.788059 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1e508-bca4-4558-b905-19e30fdec449 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:34.788620 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1e508-bca4-4558-b905-19e30fdec449 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:34.788933 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1e508-bca4-4558-b905-19e30fdec449 None admin] PATH_INFO: `/v3/projects/02cccaf1e1a44792916250e99dc79efa` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:34.790285 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e1e508-bca4-4558-b905-19e30fdec449 None admin] RBAC: Authorizing `identity:get_project(project_id=02cccaf1e1a44792916250e99dc79efa)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:34.792122 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e1e508-bca4-4558-b905-19e30fdec449 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:34.794236 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 156/293] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 2 15:15:34 2022] GET /identity/v3/projects/02cccaf1e1a44792916250e99dc79efa => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:34.799724 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac17c1-da14-47f7-b318-6c5baefccbbf None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:34.927838 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:34.959669 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac17c1-da14-47f7-b318-6c5baefccbbf None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:35.028115 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a3f54b-f261-4584-ab92-91e6b923416c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:35.028670 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a3f54b-f261-4584-ab92-91e6b923416c None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:35.028954 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a3f54b-f261-4584-ab92-91e6b923416c None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:35.029234 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a3f54b-f261-4584-ab92-91e6b923416c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:35.030027 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a3f54b-f261-4584-ab92-91e6b923416c None admin] RBAC: Adding query filter params (role.id=bf4fcdd92d8a4a6d855f3eaa4f542529, scope.project.id=02cccaf1e1a44792916250e99dc79efa, user.id=b1bdaa3e7e224590a075038af40805ea) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:35.030339 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a3f54b-f261-4584-ab92-91e6b923416c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:35.031813 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a3f54b-f261-4584-ab92-91e6b923416c None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:35.040778 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 138/294] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 2 15:15:34 2022] GET /identity/v3/role_assignments?user.id=b1bdaa3e7e224590a075038af40805ea&scope.project.id=02cccaf1e1a44792916250e99dc79efa&role.id=bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 608 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:35.265158 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ff01e-e578-49e5-8784-93d9f5ee2473 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:35.265698 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ff01e-e578-49e5-8784-93d9f5ee2473 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:35.265698 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ff01e-e578-49e5-8784-93d9f5ee2473 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:35.267368 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 157/295] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:15:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:15:35.273228 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c774dd9-09a2-4824-8bf8-625c2d1052b9 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:35.273759 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c774dd9-09a2-4824-8bf8-625c2d1052b9 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:35.274255 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c774dd9-09a2-4824-8bf8-625c2d1052b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:35.304379 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-3c774dd9-09a2-4824-8bf8-625c2d1052b9 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:15:35.305946 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-3c774dd9-09a2-4824-8bf8-625c2d1052b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:15:35.386630 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 139/296] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:15:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 15:15:35.411455 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ff01e-e578-49e5-8784-93d9f5ee2473 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:35.497171 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81499b34-8307-4013-abd6-48273c6e83df None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:35.497458 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81499b34-8307-4013-abd6-48273c6e83df None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:35.498471 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81499b34-8307-4013-abd6-48273c6e83df None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:35.501124 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 140/297] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:15:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:15:35.505776 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed5933-d9b3-48b0-81a0-b0a00156a028 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:35.506214 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed5933-d9b3-48b0-81a0-b0a00156a028 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:35.507298 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed5933-d9b3-48b0-81a0-b0a00156a028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:35.530174 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-27ed5933-d9b3-48b0-81a0-b0a00156a028 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:15:35.531772 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-27ed5933-d9b3-48b0-81a0-b0a00156a028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:15:35.563682 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ff01e-e578-49e5-8784-93d9f5ee2473 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:35.603985 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:35.611009 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 141/298] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:15:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 15:15:35.611909 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0938e-4f4d-4b6b-b69e-9d9218842e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:35.612780 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0938e-4f4d-4b6b-b69e-9d9218842e81 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:35.613261 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0938e-4f4d-4b6b-b69e-9d9218842e81 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:35.613729 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0938e-4f4d-4b6b-b69e-9d9218842e81 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:35.616517 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab0938e-4f4d-4b6b-b69e-9d9218842e81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:35.618235 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab0938e-4f4d-4b6b-b69e-9d9218842e81 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:35.620305 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 158/299] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:15:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:35.626061 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed5933-d9b3-48b0-81a0-b0a00156a028 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:35.636961 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0938e-4f4d-4b6b-b69e-9d9218842e81 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:35.668532 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:35.738178 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed5933-d9b3-48b0-81a0-b0a00156a028 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:35.776628 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0938e-4f4d-4b6b-b69e-9d9218842e81 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:35.780373 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87439c4d-3657-4d47-9466-dac2c258b16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:35.781015 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87439c4d-3657-4d47-9466-dac2c258b16b None admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:35.781312 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87439c4d-3657-4d47-9466-dac2c258b16b None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:35.781593 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87439c4d-3657-4d47-9466-dac2c258b16b None admin] PATH_INFO: `/v3/groups` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:35.782283 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87439c4d-3657-4d47-9466-dac2c258b16b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:35.783776 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87439c4d-3657-4d47-9466-dac2c258b16b None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:35.815330 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 142/300] 10.222.0.42 () {60 vars in 1134 bytes} [Tue Aug 2 15:15:35 2022] POST /identity/v3/groups => generated 229 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:15:35.826708 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf2572-a45b-42d7-9869-0ba8f942bcd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:35.827427 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf2572-a45b-42d7-9869-0ba8f942bcd5 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:35.827717 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf2572-a45b-42d7-9869-0ba8f942bcd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:35.827996 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf2572-a45b-42d7-9869-0ba8f942bcd5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:35.841517 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bf2572-a45b-42d7-9869-0ba8f942bcd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:15:35.847603 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-a4bf2572-a45b-42d7-9869-0ba8f942bcd5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 15:15:35.847603 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:15:35.847603 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:15:35.847603 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:15:35.847603 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:15:35.847603 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:15:35.847603 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:15:35.847603 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:15:35.847603 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:15:35.847603 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:15:35.847603 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:15:35.847603 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:15:35.847603 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:15:35.847603 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:15:35.847603 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:15:35.847603 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:15:35.848529 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:15:35.848529 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:15:35.848529 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:15:35.848529 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:15:35.848529 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:15:35.848529 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:15:35.848529 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:15:35.848529 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:15:35.848529 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:15:35.848529 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:15:35.848529 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:15:35.848529 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:15:35.848529 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:15:35.848529 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:15:35.848529 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:15:35.848529 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:15:35.849319 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:15:35.849319 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:15:35.849319 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:15:35.849319 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:15:35.849319 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:15:35.849319 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:15:35.849319 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:15:35.849319 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:15:35.849319 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:15:35.849319 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:15:35.849319 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 15:15:35.849319 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:15:35.849319 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 159/301] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 2 15:15:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 15:15:35.855654 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87439c4d-3657-4d47-9466-dac2c258b16b None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:35.931379 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:35.977772 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87439c4d-3657-4d47-9466-dac2c258b16b None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:35.981530 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e464804b-1ed9-4404-8020-182d1a740f93 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:35.982082 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e464804b-1ed9-4404-8020-182d1a740f93 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:35.982516 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e464804b-1ed9-4404-8020-182d1a740f93 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:35.984084 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 160/302] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:15:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 15:15:35.989749 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3552adbc-0093-4b3f-9578-1bed85ebee72 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:35.990891 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3552adbc-0093-4b3f-9578-1bed85ebee72 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:35.991471 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3552adbc-0093-4b3f-9578-1bed85ebee72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:36.012117 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-3552adbc-0093-4b3f-9578-1bed85ebee72 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:15:36.014259 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-3552adbc-0093-4b3f-9578-1bed85ebee72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:15:36.017341 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269573c5-26d5-45a3-b25b-49fddc3ed814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:36.018221 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269573c5-26d5-45a3-b25b-49fddc3ed814 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:36.018508 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269573c5-26d5-45a3-b25b-49fddc3ed814 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:36.018789 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269573c5-26d5-45a3-b25b-49fddc3ed814 None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:36.019554 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269573c5-26d5-45a3-b25b-49fddc3ed814 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:36.019864 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269573c5-26d5-45a3-b25b-49fddc3ed814 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:36.021243 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269573c5-26d5-45a3-b25b-49fddc3ed814 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:36.030485 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 143/303] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 2 15:15:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:36.035813 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269573c5-26d5-45a3-b25b-49fddc3ed814 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:36.095299 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 161/304] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:15:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:15:36.124067 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3552adbc-0093-4b3f-9578-1bed85ebee72 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:36.139364 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:36.161426 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269573c5-26d5-45a3-b25b-49fddc3ed814 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:36.199816 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:36.216090 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f5892d-bef4-464b-99ae-aa0fb836b108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:36.216896 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5892d-bef4-464b-99ae-aa0fb836b108 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:36.217283 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5892d-bef4-464b-99ae-aa0fb836b108 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:36.217781 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5892d-bef4-464b-99ae-aa0fb836b108 None admin] PATH_INFO: `/v3/users/b6324662e93946969fe09eac8962c9b3` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:36.233701 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f5892d-bef4-464b-99ae-aa0fb836b108 None admin] RBAC: Authorizing `identity:get_user(user_id=b6324662e93946969fe09eac8962c9b3)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:36.235555 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f5892d-bef4-464b-99ae-aa0fb836b108 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:36.243352 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 144/305] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 2 15:15:36 2022] GET /identity/v3/users/b6324662e93946969fe09eac8962c9b3 => generated 293 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:15:36.244534 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f5892d-bef4-464b-99ae-aa0fb836b108 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:36.255600 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3552adbc-0093-4b3f-9578-1bed85ebee72 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:36.291782 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301e0ff-2c2d-4ebd-bd97-a23ae4cc3700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:36.293148 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301e0ff-2c2d-4ebd-bd97-a23ae4cc3700 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:36.293605 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301e0ff-2c2d-4ebd-bd97-a23ae4cc3700 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:36.294068 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301e0ff-2c2d-4ebd-bd97-a23ae4cc3700 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:36.305400 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3301e0ff-2c2d-4ebd-bd97-a23ae4cc3700 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:15:36.310982 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-3301e0ff-2c2d-4ebd-bd97-a23ae4cc3700 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 15:15:36.310982 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:15:36.310982 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:15:36.310982 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:15:36.310982 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:15:36.310982 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:15:36.310982 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:15:36.310982 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:15:36.310982 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:15:36.310982 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:15:36.310982 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:15:36.310982 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:15:36.310982 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:15:36.310982 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:15:36.310982 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:15:36.310982 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:15:36.311962 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:15:36.311962 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:15:36.311962 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:15:36.311962 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:15:36.311962 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:15:36.311962 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:15:36.311962 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:15:36.311962 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:15:36.311962 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:15:36.311962 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:15:36.311962 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:15:36.311962 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:15:36.311962 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:15:36.311962 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:15:36.311962 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:15:36.311962 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:15:36.312730 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:15:36.312730 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:15:36.312730 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:15:36.312730 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:15:36.312730 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:15:36.312730 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:15:36.312730 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:15:36.312730 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:15:36.312730 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:15:36.312730 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:15:36.312730 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 15:15:36.312730 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:15:36.315042 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 162/306] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 2 15:15:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 15:15:36.321709 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301e0ff-2c2d-4ebd-bd97-a23ae4cc3700 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:36.364993 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f5892d-bef4-464b-99ae-aa0fb836b108 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:36.409901 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a485d72-c512-4326-bbde-b1f79617089b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:36.410533 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a485d72-c512-4326-bbde-b1f79617089b None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:36.410819 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a485d72-c512-4326-bbde-b1f79617089b None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:36.411099 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a485d72-c512-4326-bbde-b1f79617089b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:36.411954 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a485d72-c512-4326-bbde-b1f79617089b None admin] RBAC: Adding query filter params (role.id=f3287619b177442b8bf83cf5f376b897, user.id=b6324662e93946969fe09eac8962c9b3, scope.system=all) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:36.412799 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a485d72-c512-4326-bbde-b1f79617089b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:36.414491 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a485d72-c512-4326-bbde-b1f79617089b None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:36.416756 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:36.420263 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 145/307] 10.222.0.42 () {56 vars in 1308 bytes} [Tue Aug 2 15:15:36 2022] GET /identity/v3/role_assignments?user.id=b6324662e93946969fe09eac8962c9b3&scope.system=all&role.id=f3287619b177442b8bf83cf5f376b897 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:36.425551 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2675ce52-9e16-4060-82cf-ea8d3e7b6571 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:36.426167 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2675ce52-9e16-4060-82cf-ea8d3e7b6571 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:36.427409 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2675ce52-9e16-4060-82cf-ea8d3e7b6571 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:36.429948 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 146/308] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:15:36 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:15:36.435771 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade39957-ad7a-41a0-a7f4-966affd3b7cd None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:36.436129 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade39957-ad7a-41a0-a7f4-966affd3b7cd None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:36.436474 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade39957-ad7a-41a0-a7f4-966affd3b7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:36.455864 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-ade39957-ad7a-41a0-a7f4-966affd3b7cd None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:15:36.457366 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-ade39957-ad7a-41a0-a7f4-966affd3b7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:15:36.461379 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301e0ff-2c2d-4ebd-bd97-a23ae4cc3700 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:36.501625 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2134c2f-df10-4d4b-94ab-e942fc50e2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:36.502618 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2134c2f-df10-4d4b-94ab-e942fc50e2a3 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:36.503119 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2134c2f-df10-4d4b-94ab-e942fc50e2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:36.503621 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2134c2f-df10-4d4b-94ab-e942fc50e2a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:36.504572 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2134c2f-df10-4d4b-94ab-e942fc50e2a3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:36.505122 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2134c2f-df10-4d4b-94ab-e942fc50e2a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:36.507004 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:36.507611 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2134c2f-df10-4d4b-94ab-e942fc50e2a3 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:36.518138 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 163/309] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 2 15:15:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:15:36.524091 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2134c2f-df10-4d4b-94ab-e942fc50e2a3 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:36.543350 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 147/310] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:15:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:15:36.571136 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade39957-ad7a-41a0-a7f4-966affd3b7cd None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:36.667185 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2134c2f-df10-4d4b-94ab-e942fc50e2a3 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:36.715103 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:36.721510 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a119cf8-8b59-4bdb-b1a2-49b709f4bd19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:36.722061 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade39957-ad7a-41a0-a7f4-966affd3b7cd None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:36.722382 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a119cf8-8b59-4bdb-b1a2-49b709f4bd19 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:36.722764 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a119cf8-8b59-4bdb-b1a2-49b709f4bd19 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:36.723202 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a119cf8-8b59-4bdb-b1a2-49b709f4bd19 None admin] PATH_INFO: `/v3/users/b44af8b0317d4150be26924bf8f8a489` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:36.726272 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a119cf8-8b59-4bdb-b1a2-49b709f4bd19 None admin] RBAC: Authorizing `identity:get_user(user_id=b44af8b0317d4150be26924bf8f8a489)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:36.727878 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a119cf8-8b59-4bdb-b1a2-49b709f4bd19 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:36.731297 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 164/311] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 2 15:15:36 2022] GET /identity/v3/users/b44af8b0317d4150be26924bf8f8a489 => generated 293 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:15:36.735330 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a119cf8-8b59-4bdb-b1a2-49b709f4bd19 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:36.764628 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8b9a24-2cd0-41ae-b0cf-5a51b490c56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:36.765460 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b9a24-2cd0-41ae-b0cf-5a51b490c56e None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:36.765845 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b9a24-2cd0-41ae-b0cf-5a51b490c56e None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:36.766226 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b9a24-2cd0-41ae-b0cf-5a51b490c56e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:36.777387 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8b9a24-2cd0-41ae-b0cf-5a51b490c56e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:15:36.782793 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-ca8b9a24-2cd0-41ae-b0cf-5a51b490c56e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 15:15:36.782793 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:15:36.782793 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:15:36.782793 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:15:36.782793 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:15:36.782793 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:15:36.782793 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:15:36.782793 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:15:36.782793 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:15:36.782793 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:15:36.782793 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:15:36.782793 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:15:36.782793 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:15:36.782793 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:15:36.782793 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:15:36.782793 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:15:36.783917 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:15:36.783917 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:15:36.783917 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:15:36.783917 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:15:36.783917 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:15:36.783917 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:15:36.783917 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:15:36.783917 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:15:36.783917 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:15:36.783917 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:15:36.783917 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:15:36.783917 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:15:36.783917 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:15:36.783917 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:15:36.783917 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:15:36.783917 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:15:36.785213 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:15:36.785213 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:15:36.785213 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:15:36.785213 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:15:36.785213 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:15:36.785213 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:15:36.785213 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:15:36.785213 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:15:36.785213 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:15:36.785213 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:15:36.785213 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 15:15:36.785213 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:15:36.787487 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 148/312] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 2 15:15:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:15:36.793456 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8b9a24-2cd0-41ae-b0cf-5a51b490c56e None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:36.831686 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:36.851712 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a119cf8-8b59-4bdb-b1a2-49b709f4bd19 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:36.891076 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec84454c-01eb-4f57-bc3c-0f5cce57a2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:36.891869 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec84454c-01eb-4f57-bc3c-0f5cce57a2a2 None admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:36.892171 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec84454c-01eb-4f57-bc3c-0f5cce57a2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:36.892463 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec84454c-01eb-4f57-bc3c-0f5cce57a2a2 None admin] PATH_INFO: `/v3/system/users/b44af8b0317d4150be26924bf8f8a489/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:36.894112 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec84454c-01eb-4f57-bc3c-0f5cce57a2a2 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b44af8b0317d4150be26924bf8f8a489, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:36.895586 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec84454c-01eb-4f57-bc3c-0f5cce57a2a2 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:36.907252 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 165/313] 10.222.0.42 () {58 vars in 1334 bytes} [Tue Aug 2 15:15:36 2022] PUT /identity/v3/system/users/b44af8b0317d4150be26924bf8f8a489/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 15:15:36.919883 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8b9a24-2cd0-41ae-b0cf-5a51b490c56e None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:36.961550 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d670bcee-791a-4dff-8b02-6258bade12f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:36.962455 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670bcee-791a-4dff-8b02-6258bade12f4 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:36.962887 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670bcee-791a-4dff-8b02-6258bade12f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:36.963387 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670bcee-791a-4dff-8b02-6258bade12f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:36.964363 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d670bcee-791a-4dff-8b02-6258bade12f4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:36.964830 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d670bcee-791a-4dff-8b02-6258bade12f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:36.966569 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d670bcee-791a-4dff-8b02-6258bade12f4 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:36.977987 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 149/314] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 2 15:15:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:15:36.984624 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec84454c-01eb-4f57-bc3c-0f5cce57a2a2 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:37.062735 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:37.107818 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec84454c-01eb-4f57-bc3c-0f5cce57a2a2 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:37.157278 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c9e38a-ab79-4d8b-abdc-2186a35e7fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:37.157962 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9e38a-ab79-4d8b-abdc-2186a35e7fb5 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:37.158251 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9e38a-ab79-4d8b-abdc-2186a35e7fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:37.158535 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9e38a-ab79-4d8b-abdc-2186a35e7fb5 None admin] PATH_INFO: `/v3/users/1bb7de14f26c43feb2595e4174820bcc` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:37.159896 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c9e38a-ab79-4d8b-abdc-2186a35e7fb5 None admin] RBAC: Authorizing `identity:get_user(user_id=1bb7de14f26c43feb2595e4174820bcc)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:37.161373 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c9e38a-ab79-4d8b-abdc-2186a35e7fb5 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:37.164278 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 166/315] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 2 15:15:36 2022] GET /identity/v3/users/1bb7de14f26c43feb2595e4174820bcc => generated 297 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:37.169784 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d670bcee-791a-4dff-8b02-6258bade12f4 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:37.282238 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:37.289038 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d670bcee-791a-4dff-8b02-6258bade12f4 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:37.325098 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3659d6f8-2119-4f22-9fa4-5de50818196b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:37.325730 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659d6f8-2119-4f22-9fa4-5de50818196b None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:37.326017 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659d6f8-2119-4f22-9fa4-5de50818196b None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:37.326301 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659d6f8-2119-4f22-9fa4-5de50818196b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:37.401331 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3659d6f8-2119-4f22-9fa4-5de50818196b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:37.403626 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3659d6f8-2119-4f22-9fa4-5de50818196b None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:37.502465 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:37.509852 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 150/316] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 2 15:15:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 15:15:37.515707 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c9e38a-ab79-4d8b-abdc-2186a35e7fb5 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:37.627817 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c9e38a-ab79-4d8b-abdc-2186a35e7fb5 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:37.664610 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:37.670844 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd3dde-1887-4cb8-b813-ad33f53e7cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:37.671784 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd3dde-1887-4cb8-b813-ad33f53e7cfc None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:37.672281 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd3dde-1887-4cb8-b813-ad33f53e7cfc None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:37.672747 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd3dde-1887-4cb8-b813-ad33f53e7cfc None admin] PATH_INFO: `/v3/projects/02cccaf1e1a44792916250e99dc79efa` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:37.674110 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acd3dde-1887-4cb8-b813-ad33f53e7cfc None admin] RBAC: Authorizing `identity:get_project(project_id=02cccaf1e1a44792916250e99dc79efa)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:37.675807 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acd3dde-1887-4cb8-b813-ad33f53e7cfc None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:37.678573 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 167/317] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 2 15:15:37 2022] GET /identity/v3/projects/02cccaf1e1a44792916250e99dc79efa => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:37.684548 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3659d6f8-2119-4f22-9fa4-5de50818196b None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:37.806388 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3659d6f8-2119-4f22-9fa4-5de50818196b None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:37.842110 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8880fa8c-5cb6-4553-9082-eecdb87da9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:37.842735 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880fa8c-5cb6-4553-9082-eecdb87da9e3 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:37.843003 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880fa8c-5cb6-4553-9082-eecdb87da9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:37.843312 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880fa8c-5cb6-4553-9082-eecdb87da9e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:37.844107 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8880fa8c-5cb6-4553-9082-eecdb87da9e3 None admin] RBAC: Adding query filter params (role.id=f3287619b177442b8bf83cf5f376b897, scope.project.id=02cccaf1e1a44792916250e99dc79efa, user.id=1bb7de14f26c43feb2595e4174820bcc) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:37.844420 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8880fa8c-5cb6-4553-9082-eecdb87da9e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:37.845853 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8880fa8c-5cb6-4553-9082-eecdb87da9e3 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:37.852842 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 151/318] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 2 15:15:37 2022] GET /identity/v3/role_assignments?user.id=1bb7de14f26c43feb2595e4174820bcc&scope.project.id=02cccaf1e1a44792916250e99dc79efa&role.id=f3287619b177442b8bf83cf5f376b897 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:37.979868 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a2844-f410-4dff-a93a-45bdce6caf26 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:37.980522 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a2844-f410-4dff-a93a-45bdce6caf26 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:37.981018 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a2844-f410-4dff-a93a-45bdce6caf26 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:37.982654 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 168/319] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:15:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:15:37.988472 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08cb2e7-d85c-4a50-b6d6-818628e05e5d None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:37.988781 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08cb2e7-d85c-4a50-b6d6-818628e05e5d None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:37.989041 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08cb2e7-d85c-4a50-b6d6-818628e05e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:38.008506 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-b08cb2e7-d85c-4a50-b6d6-818628e05e5d None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:15:38.009704 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-b08cb2e7-d85c-4a50-b6d6-818628e05e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:15:38.077000 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:38.090110 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 152/320] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:15:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:15:38.112823 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43a2844-f410-4dff-a93a-45bdce6caf26 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:38.228847 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43a2844-f410-4dff-a93a-45bdce6caf26 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:38.268133 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed2c84-1439-4670-85a3-386ec4ced3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:38.268692 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed2c84-1439-4670-85a3-386ec4ced3b3 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:38.268978 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed2c84-1439-4670-85a3-386ec4ced3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:38.269251 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed2c84-1439-4670-85a3-386ec4ced3b3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:38.270388 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ed2c84-1439-4670-85a3-386ec4ced3b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:38.272488 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ed2c84-1439-4670-85a3-386ec4ced3b3 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:38.274247 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 169/321] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:15:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:38.279652 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08cb2e7-d85c-4a50-b6d6-818628e05e5d None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:38.384608 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08cb2e7-d85c-4a50-b6d6-818628e05e5d None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:38.419420 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82b1d50-a2bc-4f25-88af-179372f8f6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:38.420036 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b1d50-a2bc-4f25-88af-179372f8f6a2 None admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:38.420320 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b1d50-a2bc-4f25-88af-179372f8f6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:38.420599 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b1d50-a2bc-4f25-88af-179372f8f6a2 None admin] PATH_INFO: `/v3/groups` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:38.421294 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82b1d50-a2bc-4f25-88af-179372f8f6a2 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:38.422719 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82b1d50-a2bc-4f25-88af-179372f8f6a2 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:38.439246 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 153/322] 10.222.0.42 () {60 vars in 1134 bytes} [Tue Aug 2 15:15:38 2022] POST /identity/v3/groups => generated 226 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:15:38.609551 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c0ba75-7ea1-46e2-bb98-3c76212e7277 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:38.610036 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c0ba75-7ea1-46e2-bb98-3c76212e7277 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:38.610036 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c0ba75-7ea1-46e2-bb98-3c76212e7277 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:38.611653 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 170/323] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:15:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:15:38.618752 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98202a0d-ee0e-474b-9337-a6ced67ef0b8 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:38.619355 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98202a0d-ee0e-474b-9337-a6ced67ef0b8 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:38.619636 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98202a0d-ee0e-474b-9337-a6ced67ef0b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:38.645241 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-98202a0d-ee0e-474b-9337-a6ced67ef0b8 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:15:38.646820 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-98202a0d-ee0e-474b-9337-a6ced67ef0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:15:38.715405 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:38.746815 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 154/324] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:15:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:15:38.769499 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c0ba75-7ea1-46e2-bb98-3c76212e7277 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:38.859775 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:38.905981 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c0ba75-7ea1-46e2-bb98-3c76212e7277 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:38.946451 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90805b99-bdfb-4299-b510-6ef20d70c9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:38.947486 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90805b99-bdfb-4299-b510-6ef20d70c9df None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:38.947989 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90805b99-bdfb-4299-b510-6ef20d70c9df None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:38.948455 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90805b99-bdfb-4299-b510-6ef20d70c9df None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:38.959654 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90805b99-bdfb-4299-b510-6ef20d70c9df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:15:38.965898 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-90805b99-bdfb-4299-b510-6ef20d70c9df None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 15:15:38.965898 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:15:38.965898 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:15:38.965898 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:15:38.965898 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:15:38.965898 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:15:38.965898 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:15:38.965898 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:15:38.965898 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:15:38.965898 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:15:38.965898 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:15:38.965898 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:15:38.965898 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:15:38.965898 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:15:38.965898 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:15:38.965898 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:15:38.966787 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:15:38.966787 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:15:38.966787 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:15:38.966787 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:15:38.966787 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:15:38.966787 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:15:38.966787 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:15:38.966787 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:15:38.966787 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:15:38.966787 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:15:38.966787 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:15:38.966787 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:15:38.966787 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:15:38.966787 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:15:38.966787 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:15:38.966787 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:15:38.967600 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:15:38.967600 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:15:38.967600 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:15:38.967600 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:15:38.967600 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:15:38.967600 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:15:38.967600 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:15:38.967600 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:15:38.967600 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:15:38.967600 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:15:38.967600 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 15:15:38.967600 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:15:38.970301 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 171/325] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 2 15:15:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:15:38.976072 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98202a0d-ee0e-474b-9337-a6ced67ef0b8 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:39.090530 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98202a0d-ee0e-474b-9337-a6ced67ef0b8 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:39.132381 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eeefe2-33a7-44d6-9689-fe8b85ed31a2 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:39.132654 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc36fd54-942e-496a-954b-5820915533ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:39.133161 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eeefe2-33a7-44d6-9689-fe8b85ed31a2 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:39.133263 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36fd54-942e-496a-954b-5820915533ef None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:39.133529 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36fd54-942e-496a-954b-5820915533ef None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:39.133805 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36fd54-942e-496a-954b-5820915533ef None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:39.134116 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eeefe2-33a7-44d6-9689-fe8b85ed31a2 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:39.134533 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc36fd54-942e-496a-954b-5820915533ef None admin] RBAC: Adding query filter params (name=reader) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:39.134838 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc36fd54-942e-496a-954b-5820915533ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:39.136359 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc36fd54-942e-496a-954b-5820915533ef None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:39.136465 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 172/326] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:15:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:15:39.142296 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad54a70-f542-47a5-af41-5cf09ce9b87b None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:39.142803 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad54a70-f542-47a5-af41-5cf09ce9b87b None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:39.146002 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad54a70-f542-47a5-af41-5cf09ce9b87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:39.153365 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 155/327] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 2 15:15:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:15:39.162959 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc36fd54-942e-496a-954b-5820915533ef None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:39.191517 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-dad54a70-f542-47a5-af41-5cf09ce9b87b None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:15:39.195030 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-dad54a70-f542-47a5-af41-5cf09ce9b87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:15:39.225234 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:39.306560 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc36fd54-942e-496a-954b-5820915533ef None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:39.312617 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 173/328] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:15:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:15:39.350773 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad54a70-f542-47a5-af41-5cf09ce9b87b None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:39.376105 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c7f43-4b1f-4d12-ad3d-33816c54b269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:39.379122 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c7f43-4b1f-4d12-ad3d-33816c54b269 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:39.379689 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c7f43-4b1f-4d12-ad3d-33816c54b269 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:39.380173 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c7f43-4b1f-4d12-ad3d-33816c54b269 None admin] PATH_INFO: `/v3/users/b6324662e93946969fe09eac8962c9b3` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:39.384654 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892c7f43-4b1f-4d12-ad3d-33816c54b269 None admin] RBAC: Authorizing `identity:get_user(user_id=b6324662e93946969fe09eac8962c9b3)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:39.386431 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892c7f43-4b1f-4d12-ad3d-33816c54b269 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:39.395265 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 156/329] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 2 15:15:39 2022] GET /identity/v3/users/b6324662e93946969fe09eac8962c9b3 => generated 293 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:39.396519 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c7f43-4b1f-4d12-ad3d-33816c54b269 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:39.486150 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:39.599827 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c7f43-4b1f-4d12-ad3d-33816c54b269 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:39.600033 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad54a70-f542-47a5-af41-5cf09ce9b87b None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:39.611699 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:39.652600 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18300014-c346-44fb-b858-79a765daa5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:39.653291 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18300014-c346-44fb-b858-79a765daa5f2 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:39.653573 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18300014-c346-44fb-b858-79a765daa5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:39.653847 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18300014-c346-44fb-b858-79a765daa5f2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:39.657793 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d472bac8-dd9f-4e92-850b-695814dffbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:39.658471 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d472bac8-dd9f-4e92-850b-695814dffbdb None admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:39.658751 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d472bac8-dd9f-4e92-850b-695814dffbdb None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:39.659024 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d472bac8-dd9f-4e92-850b-695814dffbdb None admin] PATH_INFO: `/v3/system/users/b6324662e93946969fe09eac8962c9b3/roles/f3287619b177442b8bf83cf5f376b897` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:39.664550 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d472bac8-dd9f-4e92-850b-695814dffbdb None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b6324662e93946969fe09eac8962c9b3, role_id=f3287619b177442b8bf83cf5f376b897)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:39.665960 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d472bac8-dd9f-4e92-850b-695814dffbdb None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:39.680081 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 157/330] 10.222.0.42 () {58 vars in 1334 bytes} [Tue Aug 2 15:15:39 2022] PUT /identity/v3/system/users/b6324662e93946969fe09eac8962c9b3/roles/f3287619b177442b8bf83cf5f376b897 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:15:39.686119 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18300014-c346-44fb-b858-79a765daa5f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:15:39.696971 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-18300014-c346-44fb-b858-79a765daa5f2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 15:15:39.696971 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:15:39.696971 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:15:39.696971 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:15:39.696971 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:15:39.696971 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:15:39.696971 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:15:39.696971 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:15:39.696971 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:15:39.696971 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:15:39.696971 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:15:39.696971 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:15:39.696971 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:15:39.696971 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:15:39.696971 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:15:39.696971 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:15:39.697966 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:15:39.697966 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:15:39.697966 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:15:39.697966 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:15:39.697966 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:15:39.697966 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:15:39.697966 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:15:39.697966 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:15:39.697966 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:15:39.697966 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:15:39.697966 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:15:39.697966 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:15:39.697966 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:15:39.697966 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:15:39.697966 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:15:39.697966 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:15:39.698766 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:15:39.698766 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:15:39.698766 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:15:39.698766 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:15:39.698766 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:15:39.698766 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:15:39.698766 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:15:39.698766 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:15:39.698766 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:15:39.698766 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:15:39.698766 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 15:15:39.698766 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:15:39.700957 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 174/331] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 2 15:15:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:15:39.712476 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d472bac8-dd9f-4e92-850b-695814dffbdb None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:39.866872 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d472bac8-dd9f-4e92-850b-695814dffbdb None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:39.915750 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8adf193-07e8-4612-b316-e6a7a464db85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:39.916305 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8adf193-07e8-4612-b316-e6a7a464db85 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:39.916585 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8adf193-07e8-4612-b316-e6a7a464db85 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:39.916924 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8adf193-07e8-4612-b316-e6a7a464db85 None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:39.917578 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8adf193-07e8-4612-b316-e6a7a464db85 None admin] RBAC: Adding query filter params (name=member) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:39.917874 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8adf193-07e8-4612-b316-e6a7a464db85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:39.919311 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8adf193-07e8-4612-b316-e6a7a464db85 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:39.929660 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 158/332] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 2 15:15:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:39.935318 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18300014-c346-44fb-b858-79a765daa5f2 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:40.069490 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18300014-c346-44fb-b858-79a765daa5f2 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:40.095186 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:40.114419 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f3910-33d3-4366-b62e-a0badad12f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:40.115632 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f3910-33d3-4366-b62e-a0badad12f7a None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:40.115919 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f3910-33d3-4366-b62e-a0badad12f7a None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:40.116200 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f3910-33d3-4366-b62e-a0badad12f7a None admin] PATH_INFO: `/v3/users/b44af8b0317d4150be26924bf8f8a489` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:40.117487 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6f3910-33d3-4366-b62e-a0badad12f7a None admin] RBAC: Authorizing `identity:get_user(user_id=b44af8b0317d4150be26924bf8f8a489)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:40.118954 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6f3910-33d3-4366-b62e-a0badad12f7a None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:40.121046 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 175/333] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 2 15:15:39 2022] GET /identity/v3/users/b44af8b0317d4150be26924bf8f8a489 => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:40.126655 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8adf193-07e8-4612-b316-e6a7a464db85 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:40.189213 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:40.275207 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8adf193-07e8-4612-b316-e6a7a464db85 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:40.317737 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd79f85-3fd5-4df5-8b88-0fc9b668ef1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:40.318396 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd79f85-3fd5-4df5-8b88-0fc9b668ef1c None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:40.318678 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd79f85-3fd5-4df5-8b88-0fc9b668ef1c None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:40.318952 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd79f85-3fd5-4df5-8b88-0fc9b668ef1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:40.319775 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd79f85-3fd5-4df5-8b88-0fc9b668ef1c None admin] RBAC: Adding query filter params (role.id=bf4fcdd92d8a4a6d855f3eaa4f542529, user.id=b44af8b0317d4150be26924bf8f8a489, scope.system=all) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:40.320078 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd79f85-3fd5-4df5-8b88-0fc9b668ef1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:40.321508 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd79f85-3fd5-4df5-8b88-0fc9b668ef1c None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:40.338676 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 159/334] 10.222.0.42 () {56 vars in 1308 bytes} [Tue Aug 2 15:15:40 2022] GET /identity/v3/role_assignments?user.id=b44af8b0317d4150be26924bf8f8a489&scope.system=all&role.id=bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 510 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:41.439628 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729db42b-992d-4151-9e4b-3d22ca5e38e1 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:41.440650 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729db42b-992d-4151-9e4b-3d22ca5e38e1 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:41.441163 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729db42b-992d-4151-9e4b-3d22ca5e38e1 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:41.443185 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 176/335] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:15:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:15:41.449560 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798bd0a0-8fa5-4226-9da8-927b774fd998 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:41.450517 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798bd0a0-8fa5-4226-9da8-927b774fd998 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:41.450994 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798bd0a0-8fa5-4226-9da8-927b774fd998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:41.471354 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-798bd0a0-8fa5-4226-9da8-927b774fd998 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:15:41.472957 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-798bd0a0-8fa5-4226-9da8-927b774fd998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:15:41.554237 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 160/336] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:15:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:15:41.580119 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729db42b-992d-4151-9e4b-3d22ca5e38e1 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:41.641244 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc121e-6cf2-416a-bda0-cc0b5a7e2819 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:41.641892 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc121e-6cf2-416a-bda0-cc0b5a7e2819 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:41.642369 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc121e-6cf2-416a-bda0-cc0b5a7e2819 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:41.643952 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 161/337] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:15:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 15:15:41.650128 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f75b39-60f0-4500-bf5f-d42734b41585 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:41.650281 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f75b39-60f0-4500-bf5f-d42734b41585 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:41.650466 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f75b39-60f0-4500-bf5f-d42734b41585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:41.685954 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-67f75b39-60f0-4500-bf5f-d42734b41585 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:15:41.687133 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-67f75b39-60f0-4500-bf5f-d42734b41585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:15:41.725171 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729db42b-992d-4151-9e4b-3d22ca5e38e1 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:41.732035 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:41.772375 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cdadc2-a7aa-48b8-8c43-d1bf49be5eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:41.773475 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cdadc2-a7aa-48b8-8c43-d1bf49be5eae None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:41.773974 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cdadc2-a7aa-48b8-8c43-d1bf49be5eae None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:41.774450 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cdadc2-a7aa-48b8-8c43-d1bf49be5eae None admin] PATH_INFO: `/v3/roles/member` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:41.789802 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cdadc2-a7aa-48b8-8c43-d1bf49be5eae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:15:41.796588 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-e7cdadc2-a7aa-48b8-8c43-d1bf49be5eae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 15:15:41.796588 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:15:41.796588 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:15:41.796588 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:15:41.796588 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:15:41.796588 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:15:41.796588 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:15:41.796588 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:15:41.796588 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:15:41.796588 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:15:41.796588 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:15:41.796588 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:15:41.796588 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:15:41.796588 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:15:41.796588 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:15:41.796588 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:15:41.797525 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:15:41.797525 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:15:41.797525 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:15:41.797525 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:15:41.797525 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:15:41.797525 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:15:41.797525 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:15:41.797525 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:15:41.797525 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:15:41.797525 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:15:41.797525 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:15:41.797525 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:15:41.797525 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:15:41.797525 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:15:41.797525 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:15:41.797525 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:15:41.798306 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:15:41.798306 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:15:41.798306 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:15:41.798306 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:15:41.798306 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:15:41.798306 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:15:41.798306 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:15:41.798306 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:15:41.798306 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:15:41.798306 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:15:41.798306 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 15:15:41.798306 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:15:41.801136 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 177/338] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 2 15:15:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:15:41.808105 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cdadc2-a7aa-48b8-8c43-d1bf49be5eae None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:41.866140 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:41.897587 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 162/339] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:15:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:15:41.912422 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924d860-4ae6-49e1-94e1-4674ce549ffe None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:41.912422 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924d860-4ae6-49e1-94e1-4674ce549ffe None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:41.912422 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924d860-4ae6-49e1-94e1-4674ce549ffe None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:41.913586 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 163/340] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:15:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:15:41.919586 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b2199-f807-476e-85da-11d9c02655d4 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:41.919866 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b2199-f807-476e-85da-11d9c02655d4 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:41.920141 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b2199-f807-476e-85da-11d9c02655d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:41.952968 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cdadc2-a7aa-48b8-8c43-d1bf49be5eae None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:41.963412 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-244b2199-f807-476e-85da-11d9c02655d4 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:15:41.964618 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-244b2199-f807-476e-85da-11d9c02655d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:15:42.002559 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d61fa-a5c2-4f2f-9127-6595c8fd24ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:42.003167 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d61fa-a5c2-4f2f-9127-6595c8fd24ca None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:42.003487 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d61fa-a5c2-4f2f-9127-6595c8fd24ca None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:42.003769 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d61fa-a5c2-4f2f-9127-6595c8fd24ca None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:42.004629 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8d61fa-a5c2-4f2f-9127-6595c8fd24ca None admin] RBAC: Adding query filter params (name=member) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:42.004952 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8d61fa-a5c2-4f2f-9127-6595c8fd24ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:42.006938 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8d61fa-a5c2-4f2f-9127-6595c8fd24ca None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:42.016788 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 178/341] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 2 15:15:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:42.017681 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d61fa-a5c2-4f2f-9127-6595c8fd24ca None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:42.136919 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 164/342] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:15:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:15:42.137819 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244b2199-f807-476e-85da-11d9c02655d4 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:42.140068 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d61fa-a5c2-4f2f-9127-6595c8fd24ca None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:42.153266 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:42.184676 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc35fe-affc-4478-bb05-f7de5d7fd6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:42.185581 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc35fe-affc-4478-bb05-f7de5d7fd6ae None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:42.186330 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc35fe-affc-4478-bb05-f7de5d7fd6ae None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:42.186756 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc35fe-affc-4478-bb05-f7de5d7fd6ae None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:42.200070 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccc35fe-affc-4478-bb05-f7de5d7fd6ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:15:42.206254 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-3ccc35fe-affc-4478-bb05-f7de5d7fd6ae None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 15:15:42.206254 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:15:42.206254 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:15:42.206254 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:15:42.206254 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:15:42.206254 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:15:42.206254 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:15:42.206254 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:15:42.206254 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:15:42.206254 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:15:42.206254 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:15:42.206254 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:15:42.206254 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:15:42.206254 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:15:42.206254 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:15:42.206254 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:15:42.207354 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:15:42.207354 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:15:42.207354 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:15:42.207354 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:15:42.207354 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:15:42.207354 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:15:42.207354 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:15:42.207354 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:15:42.207354 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:15:42.207354 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:15:42.207354 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:15:42.207354 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:15:42.207354 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:15:42.207354 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:15:42.207354 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:15:42.207354 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:15:42.208347 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:15:42.208347 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:15:42.208347 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:15:42.208347 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:15:42.208347 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:15:42.208347 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:15:42.208347 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:15:42.208347 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:15:42.208347 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:15:42.208347 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:15:42.208347 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 15:15:42.208347 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:15:42.210714 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 179/343] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Aug 2 15:15:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:15:42.211743 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc35fe-affc-4478-bb05-f7de5d7fd6ae None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:42.274110 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:42.301117 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244b2199-f807-476e-85da-11d9c02655d4 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:42.335349 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc35fe-affc-4478-bb05-f7de5d7fd6ae None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:42.371985 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb1d6d3-3c13-4abf-90da-cbcd74c0bea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:42.372632 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1d6d3-3c13-4abf-90da-cbcd74c0bea7 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:42.372915 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1d6d3-3c13-4abf-90da-cbcd74c0bea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:42.373195 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1d6d3-3c13-4abf-90da-cbcd74c0bea7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:42.373906 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a928d-c932-4ee9-a074-fb93f871bdc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:42.374719 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a928d-c932-4ee9-a074-fb93f871bdc9 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:42.375155 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a928d-c932-4ee9-a074-fb93f871bdc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:42.375596 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a928d-c932-4ee9-a074-fb93f871bdc9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:42.387914 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2a928d-c932-4ee9-a074-fb93f871bdc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:15:42.394251 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-fe2a928d-c932-4ee9-a074-fb93f871bdc9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 15:15:42.394251 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:15:42.394251 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:15:42.394251 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:15:42.394251 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:15:42.394251 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:15:42.394251 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:15:42.394251 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:15:42.394251 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:15:42.394251 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:15:42.394251 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:15:42.394251 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:15:42.394251 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:15:42.394251 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:15:42.394251 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:15:42.394251 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:15:42.395444 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:15:42.395444 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:15:42.395444 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:15:42.395444 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:15:42.395444 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:15:42.395444 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:15:42.395444 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:15:42.395444 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:15:42.395444 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:15:42.395444 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:15:42.395444 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:15:42.395444 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:15:42.395444 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:15:42.395444 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:15:42.395444 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:15:42.395444 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:15:42.396940 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:15:42.396940 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:15:42.396940 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:15:42.396940 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:15:42.396940 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:15:42.396940 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:15:42.396940 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:15:42.396940 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:15:42.396940 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:15:42.396940 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:15:42.396940 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 15:15:42.396940 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:15:42.399136 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 180/344] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 2 15:15:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:15:42.400155 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a928d-c932-4ee9-a074-fb93f871bdc9 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:42.437052 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:42.481616 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb1d6d3-3c13-4abf-90da-cbcd74c0bea7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:42.483113 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb1d6d3-3c13-4abf-90da-cbcd74c0bea7 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:42.520498 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a928d-c932-4ee9-a074-fb93f871bdc9 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:42.561175 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dc652e-5176-4a44-a76f-cd1d4647c30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:42.562132 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc652e-5176-4a44-a76f-cd1d4647c30e None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:42.562575 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc652e-5176-4a44-a76f-cd1d4647c30e None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:42.563088 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc652e-5176-4a44-a76f-cd1d4647c30e None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:42.563986 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dc652e-5176-4a44-a76f-cd1d4647c30e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:42.564438 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dc652e-5176-4a44-a76f-cd1d4647c30e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:42.566080 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dc652e-5176-4a44-a76f-cd1d4647c30e None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:42.577500 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 181/345] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 2 15:15:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:42.578691 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dc652e-5176-4a44-a76f-cd1d4647c30e None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:42.600467 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:42.621939 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 165/346] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 2 15:15:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 15:15:42.628347 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb1d6d3-3c13-4abf-90da-cbcd74c0bea7 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:42.698315 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:42.711581 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dc652e-5176-4a44-a76f-cd1d4647c30e None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:42.744058 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb1d6d3-3c13-4abf-90da-cbcd74c0bea7 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:42.751283 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a218d7ad-4ef2-4291-b16c-09a9b7569c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:42.752273 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218d7ad-4ef2-4291-b16c-09a9b7569c22 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:42.752868 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218d7ad-4ef2-4291-b16c-09a9b7569c22 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:42.753302 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218d7ad-4ef2-4291-b16c-09a9b7569c22 None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:42.754270 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a218d7ad-4ef2-4291-b16c-09a9b7569c22 None admin] RBAC: Adding query filter params (name=member) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:42.754720 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a218d7ad-4ef2-4291-b16c-09a9b7569c22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:42.756946 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a218d7ad-4ef2-4291-b16c-09a9b7569c22 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:42.766807 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 182/347] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 2 15:15:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:42.768027 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a218d7ad-4ef2-4291-b16c-09a9b7569c22 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:42.783169 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1bed34-ce4a-406a-9cea-df7ab15bbe48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:42.783592 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1bed34-ce4a-406a-9cea-df7ab15bbe48 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:42.783877 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1bed34-ce4a-406a-9cea-df7ab15bbe48 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:42.784152 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1bed34-ce4a-406a-9cea-df7ab15bbe48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:42.843678 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:42.861786 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1bed34-ce4a-406a-9cea-df7ab15bbe48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:42.863067 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1bed34-ce4a-406a-9cea-df7ab15bbe48 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:42.897045 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a218d7ad-4ef2-4291-b16c-09a9b7569c22 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:42.941042 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b5944-9c4e-412d-a18c-9e0d92de9836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:42.942075 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b5944-9c4e-412d-a18c-9e0d92de9836 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:42.942553 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b5944-9c4e-412d-a18c-9e0d92de9836 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:42.943063 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b5944-9c4e-412d-a18c-9e0d92de9836 None admin] PATH_INFO: `/v3/projects/3f5199ad4b6b4534bfa9c94c6da85f3e` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:42.945154 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b5944-9c4e-412d-a18c-9e0d92de9836 None admin] RBAC: Authorizing `identity:get_project(project_id=3f5199ad4b6b4534bfa9c94c6da85f3e)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:42.946945 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b5944-9c4e-412d-a18c-9e0d92de9836 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:42.949336 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 183/348] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 2 15:15:42 2022] GET /identity/v3/projects/3f5199ad4b6b4534bfa9c94c6da85f3e => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:42.950420 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b5944-9c4e-412d-a18c-9e0d92de9836 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:42.978305 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 166/349] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 2 15:15:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 15:15:42.979172 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1bed34-ce4a-406a-9cea-df7ab15bbe48 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:43.019576 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:43.094975 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:43.105435 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b5944-9c4e-412d-a18c-9e0d92de9836 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:43.145236 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d7ba03-0449-4c24-8fa6-04bbbfd42ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:43.145877 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d7ba03-0449-4c24-8fa6-04bbbfd42ee9 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:43.146683 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d7ba03-0449-4c24-8fa6-04bbbfd42ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:43.146973 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d7ba03-0449-4c24-8fa6-04bbbfd42ee9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:43.149213 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1bed34-ce4a-406a-9cea-df7ab15bbe48 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:43.222547 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c5af1b-db4a-43a6-a18c-915daf300229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:43.223825 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c5af1b-db4a-43a6-a18c-915daf300229 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:43.224297 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c5af1b-db4a-43a6-a18c-915daf300229 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:43.225228 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c5af1b-db4a-43a6-a18c-915daf300229 None admin] PATH_INFO: `/v3/groups/277bd059474947a5a783a7fc06ee88db` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:43.233853 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c5af1b-db4a-43a6-a18c-915daf300229 None admin] RBAC: Authorizing `identity:get_group(group_id=277bd059474947a5a783a7fc06ee88db)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:43.236093 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c5af1b-db4a-43a6-a18c-915daf300229 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:43.238692 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 167/350] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Aug 2 15:15:42 2022] GET /identity/v3/groups/277bd059474947a5a783a7fc06ee88db => generated 226 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:43.239938 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c5af1b-db4a-43a6-a18c-915daf300229 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:43.255663 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d7ba03-0449-4c24-8fa6-04bbbfd42ee9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:43.256339 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d7ba03-0449-4c24-8fa6-04bbbfd42ee9 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:43.287710 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:43.387787 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 184/351] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 2 15:15:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 15:15:43.387983 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c5af1b-db4a-43a6-a18c-915daf300229 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:43.389629 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a9ffc-8620-4de1-b8e3-de2b45ccb874 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:43.390143 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a9ffc-8620-4de1-b8e3-de2b45ccb874 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:43.390637 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a9ffc-8620-4de1-b8e3-de2b45ccb874 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:43.392611 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 185/352] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:15:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:15:43.393636 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145a9ffc-8620-4de1-b8e3-de2b45ccb874 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:43.429882 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d2894a-8ab1-441d-9277-caa98294b0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:43.430906 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d2894a-8ab1-441d-9277-caa98294b0e6 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:43.432471 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d2894a-8ab1-441d-9277-caa98294b0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:43.432471 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d2894a-8ab1-441d-9277-caa98294b0e6 None admin] PATH_INFO: `/v3/projects/3f5199ad4b6b4534bfa9c94c6da85f3e` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:43.433138 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d2894a-8ab1-441d-9277-caa98294b0e6 None admin] RBAC: Authorizing `identity:get_project(project_id=3f5199ad4b6b4534bfa9c94c6da85f3e)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:43.442597 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d2894a-8ab1-441d-9277-caa98294b0e6 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:43.442597 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 168/353] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 2 15:15:43 2022] GET /identity/v3/projects/3f5199ad4b6b4534bfa9c94c6da85f3e => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:43.442597 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61849418-20c7-425d-a3eb-e23d96aa3e9d None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:43.442597 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61849418-20c7-425d-a3eb-e23d96aa3e9d None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:43.442597 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61849418-20c7-425d-a3eb-e23d96aa3e9d None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:43.442597 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 169/354] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:15:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:15:43.443159 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61849418-20c7-425d-a3eb-e23d96aa3e9d None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:43.466681 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:43.536879 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145a9ffc-8620-4de1-b8e3-de2b45ccb874 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:43.564677 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:43.588864 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5cec45-cba3-42e1-a16d-b9e115091e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:43.589462 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5cec45-cba3-42e1-a16d-b9e115091e6f None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:43.589816 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5cec45-cba3-42e1-a16d-b9e115091e6f None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:43.590162 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5cec45-cba3-42e1-a16d-b9e115091e6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:43.591029 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5cec45-cba3-42e1-a16d-b9e115091e6f None admin] RBAC: Adding query filter params (group.id=277bd059474947a5a783a7fc06ee88db, role.id=bf4fcdd92d8a4a6d855f3eaa4f542529, scope.project.id=3f5199ad4b6b4534bfa9c94c6da85f3e) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:43.591447 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5cec45-cba3-42e1-a16d-b9e115091e6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:43.592992 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5cec45-cba3-42e1-a16d-b9e115091e6f None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:43.599399 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 186/355] 10.222.0.42 () {56 vars in 1376 bytes} [Tue Aug 2 15:15:43 2022] GET /identity/v3/role_assignments?group.id=277bd059474947a5a783a7fc06ee88db&scope.project.id=3f5199ad4b6b4534bfa9c94c6da85f3e&role.id=bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 260 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:43.600459 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c49143-be1b-4575-8f59-66f1076b34d5 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:43.600745 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c49143-be1b-4575-8f59-66f1076b34d5 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:43.601021 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c49143-be1b-4575-8f59-66f1076b34d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:43.610888 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61849418-20c7-425d-a3eb-e23d96aa3e9d None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:43.625874 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-64c49143-be1b-4575-8f59-66f1076b34d5 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:15:43.628639 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-64c49143-be1b-4575-8f59-66f1076b34d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:15:43.670045 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bbe80e-32f2-4212-839a-41d2b8864ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:43.670593 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bbe80e-32f2-4212-839a-41d2b8864ae4 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:43.670941 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bbe80e-32f2-4212-839a-41d2b8864ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:43.671348 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bbe80e-32f2-4212-839a-41d2b8864ae4 None admin] PATH_INFO: `/v3/projects/02cccaf1e1a44792916250e99dc79efa` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:43.673211 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bbe80e-32f2-4212-839a-41d2b8864ae4 None admin] RBAC: Authorizing `identity:get_project(project_id=02cccaf1e1a44792916250e99dc79efa)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:43.678309 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bbe80e-32f2-4212-839a-41d2b8864ae4 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:43.682170 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 170/356] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 2 15:15:43 2022] GET /identity/v3/projects/02cccaf1e1a44792916250e99dc79efa => generated 302 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:43.683622 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bbe80e-32f2-4212-839a-41d2b8864ae4 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:43.737152 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 187/357] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:15:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:15:43.739172 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b347df-680b-4783-b3fd-892ab605f1a1 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:43.740815 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b347df-680b-4783-b3fd-892ab605f1a1 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:43.741362 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b347df-680b-4783-b3fd-892ab605f1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:43.766434 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-27b347df-680b-4783-b3fd-892ab605f1a1 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:15:43.768359 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-27b347df-680b-4783-b3fd-892ab605f1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:15:43.813793 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:43.837835 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bbe80e-32f2-4212-839a-41d2b8864ae4 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:43.860443 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 188/358] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:15:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:15:43.860687 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b347df-680b-4783-b3fd-892ab605f1a1 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:43.895255 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fde8ae-b11b-4b1d-b541-038a6470ce60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:43.895255 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fde8ae-b11b-4b1d-b541-038a6470ce60 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:43.895255 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fde8ae-b11b-4b1d-b541-038a6470ce60 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:43.895255 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fde8ae-b11b-4b1d-b541-038a6470ce60 None admin] PATH_INFO: `/v3/groups/277bd059474947a5a783a7fc06ee88db` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:43.895823 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fde8ae-b11b-4b1d-b541-038a6470ce60 None admin] RBAC: Authorizing `identity:get_group(group_id=277bd059474947a5a783a7fc06ee88db)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:43.898602 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fde8ae-b11b-4b1d-b541-038a6470ce60 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:43.901448 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 171/359] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Aug 2 15:15:43 2022] GET /identity/v3/groups/277bd059474947a5a783a7fc06ee88db => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:43.901448 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fde8ae-b11b-4b1d-b541-038a6470ce60 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:43.929338 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:44.020493 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b347df-680b-4783-b3fd-892ab605f1a1 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:44.043343 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fde8ae-b11b-4b1d-b541-038a6470ce60 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:44.066579 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad802ee-47c0-4394-9d1f-05994b79b947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:44.067329 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad802ee-47c0-4394-9d1f-05994b79b947 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:44.067623 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad802ee-47c0-4394-9d1f-05994b79b947 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:44.067907 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad802ee-47c0-4394-9d1f-05994b79b947 None admin] PATH_INFO: `/v3/groups/277bd059474947a5a783a7fc06ee88db` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:44.070230 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad802ee-47c0-4394-9d1f-05994b79b947 None admin] RBAC: Authorizing `identity:get_group(group_id=277bd059474947a5a783a7fc06ee88db)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:44.071141 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad802ee-47c0-4394-9d1f-05994b79b947 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:44.076720 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 189/360] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Aug 2 15:15:43 2022] GET /identity/v3/groups/277bd059474947a5a783a7fc06ee88db => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:44.076720 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab27a0-d35a-4095-befb-9f36aaba0d7b None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:44.076720 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab27a0-d35a-4095-befb-9f36aaba0d7b None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:44.076720 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab27a0-d35a-4095-befb-9f36aaba0d7b None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:44.076720 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 190/361] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:15:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:15:44.077917 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab27a0-d35a-4095-befb-9f36aaba0d7b None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:44.101864 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01571037-37eb-4d06-8c40-499de4e67abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:44.102536 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01571037-37eb-4d06-8c40-499de4e67abf None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:44.103623 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01571037-37eb-4d06-8c40-499de4e67abf None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:44.103976 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01571037-37eb-4d06-8c40-499de4e67abf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:44.120653 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01571037-37eb-4d06-8c40-499de4e67abf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:15:44.128888 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-01571037-37eb-4d06-8c40-499de4e67abf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 15:15:44.128888 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:15:44.128888 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:15:44.128888 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:15:44.128888 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:15:44.128888 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:15:44.128888 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:15:44.128888 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:15:44.128888 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:15:44.128888 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:15:44.128888 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:15:44.128888 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:15:44.128888 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:15:44.128888 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:15:44.128888 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:15:44.128888 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:15:44.129892 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:15:44.129892 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:15:44.129892 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:15:44.129892 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:15:44.129892 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:15:44.129892 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:15:44.129892 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:15:44.129892 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:15:44.129892 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:15:44.129892 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:15:44.129892 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:15:44.129892 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:15:44.129892 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:15:44.129892 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:15:44.129892 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:15:44.129892 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:15:44.131646 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:15:44.131646 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:15:44.131646 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:15:44.131646 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:15:44.131646 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:15:44.131646 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:15:44.131646 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:15:44.131646 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:15:44.131646 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:15:44.131646 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:15:44.131646 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 15:15:44.131646 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:15:44.131646 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 172/362] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 2 15:15:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:15:44.132583 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01571037-37eb-4d06-8c40-499de4e67abf None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:44.150916 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:44.229929 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab27a0-d35a-4095-befb-9f36aaba0d7b None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:44.249408 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:44.261291 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01571037-37eb-4d06-8c40-499de4e67abf None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:44.283608 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91c901-2fe6-4f2a-a968-51c926fd6349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:44.284268 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91c901-2fe6-4f2a-a968-51c926fd6349 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:44.284555 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91c901-2fe6-4f2a-a968-51c926fd6349 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:44.284834 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91c901-2fe6-4f2a-a968-51c926fd6349 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:44.303471 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b91c901-2fe6-4f2a-a968-51c926fd6349 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:15:44.304349 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61486cc-aed4-4c30-986e-ec031e2fb680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:44.305285 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61486cc-aed4-4c30-986e-ec031e2fb680 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:44.305714 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61486cc-aed4-4c30-986e-ec031e2fb680 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:44.306134 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61486cc-aed4-4c30-986e-ec031e2fb680 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:44.307097 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61486cc-aed4-4c30-986e-ec031e2fb680 None admin] RBAC: Adding query filter params (group.id=277bd059474947a5a783a7fc06ee88db, role.id=3e1c8e0567ff4244aef0d6a62fc8b18d, scope.project.id=3f5199ad4b6b4534bfa9c94c6da85f3e) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:44.307575 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61486cc-aed4-4c30-986e-ec031e2fb680 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:44.309220 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-0b91c901-2fe6-4f2a-a968-51c926fd6349 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 15:15:44.309220 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:15:44.309220 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:15:44.309220 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:15:44.309220 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:15:44.309220 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:15:44.309220 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:15:44.309220 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:15:44.309220 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:15:44.309220 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:15:44.309220 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:15:44.309220 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:15:44.309220 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:15:44.309220 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:15:44.309220 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:15:44.309220 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:15:44.310217 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:15:44.310217 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:15:44.310217 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:15:44.310217 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:15:44.310217 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:15:44.310217 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:15:44.310217 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:15:44.310217 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:15:44.310217 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:15:44.310217 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:15:44.310217 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:15:44.310217 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:15:44.310217 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:15:44.310217 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:15:44.310217 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:15:44.310217 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:15:44.311017 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:15:44.311017 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:15:44.311017 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:15:44.311017 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:15:44.311017 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:15:44.311017 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:15:44.311017 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:15:44.311017 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:15:44.311017 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:15:44.311017 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:15:44.311017 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 15:15:44.311017 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:15:44.311017 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 191/363] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Aug 2 15:15:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:15:44.311761 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91c901-2fe6-4f2a-a968-51c926fd6349 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:44.311833 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61486cc-aed4-4c30-986e-ec031e2fb680 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:44.327467 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 173/364] 10.222.0.42 () {56 vars in 1376 bytes} [Tue Aug 2 15:15:44 2022] GET /identity/v3/role_assignments?group.id=277bd059474947a5a783a7fc06ee88db&scope.project.id=3f5199ad4b6b4534bfa9c94c6da85f3e&role.id=3e1c8e0567ff4244aef0d6a62fc8b18d => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:44.329014 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fce79d-3b5d-41f0-8251-998856271ec7 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:44.329307 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fce79d-3b5d-41f0-8251-998856271ec7 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:44.329588 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fce79d-3b5d-41f0-8251-998856271ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:44.359391 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-e0fce79d-3b5d-41f0-8251-998856271ec7 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:15:44.360622 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-e0fce79d-3b5d-41f0-8251-998856271ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:15:44.466526 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 174/365] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:15:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:15:44.467628 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fce79d-3b5d-41f0-8251-998856271ec7 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:44.481577 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:44.485010 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91c901-2fe6-4f2a-a968-51c926fd6349 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:44.538534 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b274f2d4-0825-4f5b-ad7d-a3782b25159c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:44.540114 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274f2d4-0825-4f5b-ad7d-a3782b25159c None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:44.540588 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274f2d4-0825-4f5b-ad7d-a3782b25159c None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:44.541200 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274f2d4-0825-4f5b-ad7d-a3782b25159c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:44.542485 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b274f2d4-0825-4f5b-ad7d-a3782b25159c None admin] RBAC: Adding query filter params (group.id=277bd059474947a5a783a7fc06ee88db, role.id=bf4fcdd92d8a4a6d855f3eaa4f542529, scope.project.id=02cccaf1e1a44792916250e99dc79efa) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:44.542975 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b274f2d4-0825-4f5b-ad7d-a3782b25159c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:44.544708 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b274f2d4-0825-4f5b-ad7d-a3782b25159c None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:44.554761 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 192/366] 10.222.0.42 () {56 vars in 1376 bytes} [Tue Aug 2 15:15:44 2022] GET /identity/v3/role_assignments?group.id=277bd059474947a5a783a7fc06ee88db&scope.project.id=02cccaf1e1a44792916250e99dc79efa&role.id=bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 260 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:44.555950 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b274f2d4-0825-4f5b-ad7d-a3782b25159c None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:44.607627 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:44.622094 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fce79d-3b5d-41f0-8251-998856271ec7 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:44.699239 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff62ecb-fc59-4823-82da-38bdf8faa07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:44.700051 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b274f2d4-0825-4f5b-ad7d-a3782b25159c None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:44.700487 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff62ecb-fc59-4823-82da-38bdf8faa07d None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:44.700967 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff62ecb-fc59-4823-82da-38bdf8faa07d None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:44.701437 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff62ecb-fc59-4823-82da-38bdf8faa07d None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:44.702359 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff62ecb-fc59-4823-82da-38bdf8faa07d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:44.702883 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff62ecb-fc59-4823-82da-38bdf8faa07d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:44.704515 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff62ecb-fc59-4823-82da-38bdf8faa07d None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:44.722650 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 175/367] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 2 15:15:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:44.723889 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff62ecb-fc59-4823-82da-38bdf8faa07d None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:44.744587 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c8fc36-925d-40df-8f6f-91656814039f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:44.745146 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c8fc36-925d-40df-8f6f-91656814039f None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:44.745488 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c8fc36-925d-40df-8f6f-91656814039f None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:44.745769 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c8fc36-925d-40df-8f6f-91656814039f None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:44.746590 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c8fc36-925d-40df-8f6f-91656814039f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:44.746938 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c8fc36-925d-40df-8f6f-91656814039f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:44.749022 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c8fc36-925d-40df-8f6f-91656814039f None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:44.760144 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 193/368] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 2 15:15:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:44.761034 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c8fc36-925d-40df-8f6f-91656814039f None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:44.842868 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:44.885155 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff62ecb-fc59-4823-82da-38bdf8faa07d None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:44.902064 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:44.908440 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c8fc36-925d-40df-8f6f-91656814039f None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:44.935776 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38957f33-8334-4619-833c-7baeb4e6ec48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:44.936707 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38957f33-8334-4619-833c-7baeb4e6ec48 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:44.937150 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38957f33-8334-4619-833c-7baeb4e6ec48 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:44.937583 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38957f33-8334-4619-833c-7baeb4e6ec48 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:44.954517 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38957f33-8334-4619-833c-7baeb4e6ec48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:15:44.956238 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaf1d4f-2c42-4c8e-a8d1-bb96e992a089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:44.956984 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf1d4f-2c42-4c8e-a8d1-bb96e992a089 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:44.957361 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf1d4f-2c42-4c8e-a8d1-bb96e992a089 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:44.957732 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf1d4f-2c42-4c8e-a8d1-bb96e992a089 None admin] PATH_INFO: `/v3/users/b6324662e93946969fe09eac8962c9b3` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:44.959612 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaf1d4f-2c42-4c8e-a8d1-bb96e992a089 None admin] RBAC: Authorizing `identity:get_user(user_id=b6324662e93946969fe09eac8962c9b3)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:44.961200 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaf1d4f-2c42-4c8e-a8d1-bb96e992a089 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:44.961989 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-38957f33-8334-4619-833c-7baeb4e6ec48 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 15:15:44.961989 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:15:44.961989 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:15:44.961989 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:15:44.961989 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:15:44.961989 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:15:44.961989 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:15:44.961989 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:15:44.961989 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:15:44.961989 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:15:44.961989 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:15:44.961989 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:15:44.961989 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:15:44.961989 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:15:44.961989 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:15:44.961989 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:15:44.963062 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:15:44.963062 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:15:44.963062 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:15:44.963062 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:15:44.963062 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:15:44.963062 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:15:44.963062 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:15:44.963062 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:15:44.963062 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:15:44.963062 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:15:44.963062 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:15:44.963062 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:15:44.963062 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:15:44.963062 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:15:44.963062 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:15:44.963062 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:15:44.963909 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:15:44.963909 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:15:44.963909 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:15:44.963909 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:15:44.963909 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:15:44.963909 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:15:44.963909 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:15:44.963909 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:15:44.963909 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:15:44.963909 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:15:44.963909 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 15:15:44.963909 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:15:44.964508 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 194/369] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 2 15:15:44 2022] GET /identity/v3/users/b6324662e93946969fe09eac8962c9b3 => generated 293 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:44.965248 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaf1d4f-2c42-4c8e-a8d1-bb96e992a089 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:44.966592 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 176/370] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 2 15:15:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:15:44.975050 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38957f33-8334-4619-833c-7baeb4e6ec48 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:45.109318 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaf1d4f-2c42-4c8e-a8d1-bb96e992a089 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:45.115186 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38957f33-8334-4619-833c-7baeb4e6ec48 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:45.157840 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:45.166844 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b39de98-1e1c-4534-9509-555f7490810e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:45.168186 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39de98-1e1c-4534-9509-555f7490810e None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:45.168946 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39de98-1e1c-4534-9509-555f7490810e None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:45.169420 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39de98-1e1c-4534-9509-555f7490810e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:45.187637 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b7db6-5a60-49f0-8c7a-20ee668a312e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:45.188699 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b7db6-5a60-49f0-8c7a-20ee668a312e None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:45.188996 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b7db6-5a60-49f0-8c7a-20ee668a312e None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:45.189280 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b7db6-5a60-49f0-8c7a-20ee668a312e None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:45.190300 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b7db6-5a60-49f0-8c7a-20ee668a312e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:45.190616 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b7db6-5a60-49f0-8c7a-20ee668a312e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:45.192220 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b7db6-5a60-49f0-8c7a-20ee668a312e None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:45.206536 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 177/371] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 2 15:15:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:45.208585 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b7db6-5a60-49f0-8c7a-20ee668a312e None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:45.218378 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:45.292505 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b39de98-1e1c-4534-9509-555f7490810e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:45.292960 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b39de98-1e1c-4534-9509-555f7490810e None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:45.394648 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b7db6-5a60-49f0-8c7a-20ee668a312e None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:45.460145 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7691ed-44d2-47bd-9d24-49e69d19ef3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:45.461156 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7691ed-44d2-47bd-9d24-49e69d19ef3d None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:45.461767 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7691ed-44d2-47bd-9d24-49e69d19ef3d None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:45.462237 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7691ed-44d2-47bd-9d24-49e69d19ef3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:45.463249 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7691ed-44d2-47bd-9d24-49e69d19ef3d None admin] RBAC: Adding query filter params (role.id=f3287619b177442b8bf83cf5f376b897, user.id=b6324662e93946969fe09eac8962c9b3, scope.system=all) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:45.463777 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7691ed-44d2-47bd-9d24-49e69d19ef3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:45.465619 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7691ed-44d2-47bd-9d24-49e69d19ef3d None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:45.476937 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 195/372] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 2 15:15:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 15:15:45.477818 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b39de98-1e1c-4534-9509-555f7490810e None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:45.481225 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 178/373] 10.222.0.42 () {56 vars in 1308 bytes} [Tue Aug 2 15:15:45 2022] GET /identity/v3/role_assignments?user.id=b6324662e93946969fe09eac8962c9b3&scope.system=all&role.id=f3287619b177442b8bf83cf5f376b897 => generated 510 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:45.489519 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7691ed-44d2-47bd-9d24-49e69d19ef3d None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:45.558787 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:45.573336 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:45.604400 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b39de98-1e1c-4534-9509-555f7490810e None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:45.643610 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3299fbce-c6f2-41b1-82f6-dac5aa3c1f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:45.644284 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299fbce-c6f2-41b1-82f6-dac5aa3c1f87 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:45.644845 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299fbce-c6f2-41b1-82f6-dac5aa3c1f87 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:45.645224 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299fbce-c6f2-41b1-82f6-dac5aa3c1f87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:45.659233 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7691ed-44d2-47bd-9d24-49e69d19ef3d None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:45.701412 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450fb236-758d-4ae4-a025-c750c6d35bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:45.702531 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450fb236-758d-4ae4-a025-c750c6d35bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:45.703082 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450fb236-758d-4ae4-a025-c750c6d35bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:45.704161 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450fb236-758d-4ae4-a025-c750c6d35bf5 None admin] PATH_INFO: `/v3/projects/02cccaf1e1a44792916250e99dc79efa` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:45.705746 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450fb236-758d-4ae4-a025-c750c6d35bf5 None admin] RBAC: Authorizing `identity:get_project(project_id=02cccaf1e1a44792916250e99dc79efa)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:45.707569 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450fb236-758d-4ae4-a025-c750c6d35bf5 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:45.710583 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 179/374] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 2 15:15:45 2022] GET /identity/v3/projects/02cccaf1e1a44792916250e99dc79efa => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:15:45.715878 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450fb236-758d-4ae4-a025-c750c6d35bf5 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:45.737069 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3299fbce-c6f2-41b1-82f6-dac5aa3c1f87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:45.738568 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3299fbce-c6f2-41b1-82f6-dac5aa3c1f87 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:45.837423 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:45.870270 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450fb236-758d-4ae4-a025-c750c6d35bf5 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:45.890176 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 196/375] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 2 15:15:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 15:15:45.894454 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:45.898297 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3299fbce-c6f2-41b1-82f6-dac5aa3c1f87 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:45.924802 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4062ea36-5c08-4f28-9119-0139a2a1f0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:45.925517 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062ea36-5c08-4f28-9119-0139a2a1f0ab None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:45.925721 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062ea36-5c08-4f28-9119-0139a2a1f0ab None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:45.925999 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062ea36-5c08-4f28-9119-0139a2a1f0ab None admin] PATH_INFO: `/v3/groups/277bd059474947a5a783a7fc06ee88db` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:45.927184 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4062ea36-5c08-4f28-9119-0139a2a1f0ab None admin] RBAC: Authorizing `identity:get_group(group_id=277bd059474947a5a783a7fc06ee88db)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:45.929228 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4062ea36-5c08-4f28-9119-0139a2a1f0ab None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:45.931274 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 180/376] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Aug 2 15:15:45 2022] GET /identity/v3/groups/277bd059474947a5a783a7fc06ee88db => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:15:45.937274 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4062ea36-5c08-4f28-9119-0139a2a1f0ab None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:46.035920 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3299fbce-c6f2-41b1-82f6-dac5aa3c1f87 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:46.069057 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4062ea36-5c08-4f28-9119-0139a2a1f0ab None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:46.074430 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc7fd1-9b24-4064-977d-e46928996bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:46.075181 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc7fd1-9b24-4064-977d-e46928996bf8 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:46.075581 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc7fd1-9b24-4064-977d-e46928996bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:46.075935 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc7fd1-9b24-4064-977d-e46928996bf8 None admin] PATH_INFO: `/v3/projects/e01cd4e1a6a040d99206efa57fc6e2e1` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:46.077207 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cc7fd1-9b24-4064-977d-e46928996bf8 None admin] RBAC: Authorizing `identity:get_project(project_id=e01cd4e1a6a040d99206efa57fc6e2e1)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:46.079103 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cc7fd1-9b24-4064-977d-e46928996bf8 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:46.080887 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 197/377] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 2 15:15:45 2022] GET /identity/v3/projects/e01cd4e1a6a040d99206efa57fc6e2e1 => generated 344 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:15:46.086838 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc7fd1-9b24-4064-977d-e46928996bf8 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:46.125913 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f091c372-42f4-4315-a929-963fcfbd577a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:46.126865 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091c372-42f4-4315-a929-963fcfbd577a None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:46.127429 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091c372-42f4-4315-a929-963fcfbd577a None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:46.127923 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091c372-42f4-4315-a929-963fcfbd577a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:46.128975 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f091c372-42f4-4315-a929-963fcfbd577a None admin] RBAC: Adding query filter params (group.id=277bd059474947a5a783a7fc06ee88db, role.id=3e1c8e0567ff4244aef0d6a62fc8b18d, scope.project.id=02cccaf1e1a44792916250e99dc79efa) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:46.129466 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f091c372-42f4-4315-a929-963fcfbd577a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:46.130671 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:46.131408 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f091c372-42f4-4315-a929-963fcfbd577a None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:46.147269 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 181/378] 10.222.0.42 () {56 vars in 1376 bytes} [Tue Aug 2 15:15:45 2022] GET /identity/v3/role_assignments?group.id=277bd059474947a5a783a7fc06ee88db&scope.project.id=02cccaf1e1a44792916250e99dc79efa&role.id=3e1c8e0567ff4244aef0d6a62fc8b18d => generated 260 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:15:46.217757 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc7fd1-9b24-4064-977d-e46928996bf8 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:46.262415 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b73e36e-5b9b-47cd-a365-a0d4709e4392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:46.263096 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73e36e-5b9b-47cd-a365-a0d4709e4392 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:46.263447 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73e36e-5b9b-47cd-a365-a0d4709e4392 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:46.263733 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73e36e-5b9b-47cd-a365-a0d4709e4392 None admin] PATH_INFO: `/v3/groups/f9e764c109714519b71fb4cccac770c5` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:46.272007 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b73e36e-5b9b-47cd-a365-a0d4709e4392 None admin] RBAC: Authorizing `identity:get_group(group_id=f9e764c109714519b71fb4cccac770c5)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:46.273602 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b73e36e-5b9b-47cd-a365-a0d4709e4392 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:46.275769 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 198/379] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Aug 2 15:15:46 2022] GET /identity/v3/groups/f9e764c109714519b71fb4cccac770c5 => generated 229 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:46.281473 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f091c372-42f4-4315-a929-963fcfbd577a None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:46.343199 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:46.383927 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1a8f6-5932-44a4-8f67-47248f899bde None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:46.384330 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1a8f6-5932-44a4-8f67-47248f899bde None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:46.384501 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1a8f6-5932-44a4-8f67-47248f899bde None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:46.391486 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 199/380] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:15:46 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:15:46.392833 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc5026-a39f-4fd4-8e34-537e940e2539 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:46.393130 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc5026-a39f-4fd4-8e34-537e940e2539 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:46.393407 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc5026-a39f-4fd4-8e34-537e940e2539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:46.410299 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f091c372-42f4-4315-a929-963fcfbd577a None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:46.420077 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-7ccc5026-a39f-4fd4-8e34-537e940e2539 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:15:46.421365 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-7ccc5026-a39f-4fd4-8e34-537e940e2539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:15:46.456831 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab613b-f0ba-472c-91ce-b01aefbcd488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:46.459721 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab613b-f0ba-472c-91ce-b01aefbcd488 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:46.462648 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab613b-f0ba-472c-91ce-b01aefbcd488 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:46.463162 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab613b-f0ba-472c-91ce-b01aefbcd488 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:46.464243 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ab613b-f0ba-472c-91ce-b01aefbcd488 None admin] RBAC: Adding query filter params (group.id=f9e764c109714519b71fb4cccac770c5, role.id=d75c9572cb294caeb8eb456521ff6f57, scope.project.id=e01cd4e1a6a040d99206efa57fc6e2e1) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:46.465676 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ab613b-f0ba-472c-91ce-b01aefbcd488 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:46.472514 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ab613b-f0ba-472c-91ce-b01aefbcd488 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:46.491533 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 182/381] 10.222.0.42 () {56 vars in 1376 bytes} [Tue Aug 2 15:15:46 2022] GET /identity/v3/role_assignments?group.id=f9e764c109714519b71fb4cccac770c5&scope.project.id=e01cd4e1a6a040d99206efa57fc6e2e1&role.id=d75c9572cb294caeb8eb456521ff6f57 => generated 260 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:15:46.539800 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 200/382] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:15:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:15:46.573053 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab613b-f0ba-472c-91ce-b01aefbcd488 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:46.704977 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab613b-f0ba-472c-91ce-b01aefbcd488 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:46.725306 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:46.757091 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b757f20-9ac4-409a-9b6f-0c4a5b03591a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:46.757756 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b757f20-9ac4-409a-9b6f-0c4a5b03591a None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:46.758043 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b757f20-9ac4-409a-9b6f-0c4a5b03591a None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:46.758320 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b757f20-9ac4-409a-9b6f-0c4a5b03591a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:46.778238 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b757f20-9ac4-409a-9b6f-0c4a5b03591a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:15:46.784450 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-6b757f20-9ac4-409a-9b6f-0c4a5b03591a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 15:15:46.784450 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:15:46.784450 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:15:46.784450 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:15:46.784450 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:15:46.784450 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:15:46.784450 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:15:46.784450 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:15:46.784450 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:15:46.784450 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:15:46.784450 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:15:46.784450 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:15:46.784450 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:15:46.784450 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:15:46.784450 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:15:46.784450 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:15:46.785401 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:15:46.785401 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:15:46.785401 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:15:46.785401 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:15:46.785401 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:15:46.785401 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:15:46.785401 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:15:46.785401 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:15:46.785401 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:15:46.785401 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:15:46.785401 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:15:46.785401 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:15:46.785401 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:15:46.785401 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:15:46.785401 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:15:46.785401 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:15:46.786813 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:15:46.786813 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:15:46.786813 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:15:46.786813 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:15:46.786813 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:15:46.786813 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:15:46.786813 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:15:46.786813 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:15:46.786813 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:15:46.786813 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:15:46.786813 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 15:15:46.786813 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:15:46.786813 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 183/383] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 2 15:15:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:15:46.791925 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc5026-a39f-4fd4-8e34-537e940e2539 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:46.824869 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:46.933473 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc5026-a39f-4fd4-8e34-537e940e2539 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:46.981336 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd32a8-71f0-4a33-8729-7d527e55e4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:46.981888 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd32a8-71f0-4a33-8729-7d527e55e4aa None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:46.982342 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd32a8-71f0-4a33-8729-7d527e55e4aa None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:46.982626 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd32a8-71f0-4a33-8729-7d527e55e4aa None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:46.983390 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edd32a8-71f0-4a33-8729-7d527e55e4aa None admin] RBAC: Adding query filter params (name=member) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:46.983698 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edd32a8-71f0-4a33-8729-7d527e55e4aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:46.985197 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edd32a8-71f0-4a33-8729-7d527e55e4aa None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:46.999993 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 201/384] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 2 15:15:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:47.005848 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b757f20-9ac4-409a-9b6f-0c4a5b03591a None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:47.157435 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b757f20-9ac4-409a-9b6f-0c4a5b03591a None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:47.210385 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcda98a-1b58-4cf2-9b50-4449922a0f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:47.211105 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcda98a-1b58-4cf2-9b50-4449922a0f8f None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:47.211417 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcda98a-1b58-4cf2-9b50-4449922a0f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:47.211741 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcda98a-1b58-4cf2-9b50-4449922a0f8f None admin] PATH_INFO: `/v3/groups/277bd059474947a5a783a7fc06ee88db` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:47.214384 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcda98a-1b58-4cf2-9b50-4449922a0f8f None admin] RBAC: Authorizing `identity:get_group(group_id=277bd059474947a5a783a7fc06ee88db)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:47.215926 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcda98a-1b58-4cf2-9b50-4449922a0f8f None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:47.218555 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 184/385] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Aug 2 15:15:47 2022] GET /identity/v3/groups/277bd059474947a5a783a7fc06ee88db => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:47.223354 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd32a8-71f0-4a33-8729-7d527e55e4aa None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:47.378841 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:47.390456 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd32a8-71f0-4a33-8729-7d527e55e4aa None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:47.449493 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f7211-32af-4236-b220-8834171f8da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:47.450150 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f7211-32af-4236-b220-8834171f8da6 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:47.450438 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f7211-32af-4236-b220-8834171f8da6 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:47.450713 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f7211-32af-4236-b220-8834171f8da6 None admin] PATH_INFO: `/v3/projects/3f5199ad4b6b4534bfa9c94c6da85f3e` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:47.456029 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7f7211-32af-4236-b220-8834171f8da6 None admin] RBAC: Authorizing `identity:get_project(project_id=3f5199ad4b6b4534bfa9c94c6da85f3e)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:47.457521 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7f7211-32af-4236-b220-8834171f8da6 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:47.460221 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 202/386] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 2 15:15:47 2022] GET /identity/v3/projects/3f5199ad4b6b4534bfa9c94c6da85f3e => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:47.465975 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcda98a-1b58-4cf2-9b50-4449922a0f8f None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:47.536952 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:47.609614 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcda98a-1b58-4cf2-9b50-4449922a0f8f None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:47.632900 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b298923-3da7-484b-9711-fa121fdb2fdd None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:47.633089 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b298923-3da7-484b-9711-fa121fdb2fdd None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:47.633371 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b298923-3da7-484b-9711-fa121fdb2fdd None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:47.635038 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 203/387] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:15:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:15:47.654740 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f391b5-f041-4a29-8004-db5661829e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:47.655507 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f391b5-f041-4a29-8004-db5661829e81 None admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:47.655791 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f391b5-f041-4a29-8004-db5661829e81 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:47.656070 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f391b5-f041-4a29-8004-db5661829e81 None admin] PATH_INFO: `/v3/projects/3f5199ad4b6b4534bfa9c94c6da85f3e/groups/277bd059474947a5a783a7fc06ee88db/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:47.656720 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5bf828-da1b-4191-9561-3fc53946db10 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:47.657006 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5bf828-da1b-4191-9561-3fc53946db10 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:47.657282 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5bf828-da1b-4191-9561-3fc53946db10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:47.658808 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f391b5-f041-4a29-8004-db5661829e81 None admin] RBAC: Authorizing `identity:create_grant(project_id=3f5199ad4b6b4534bfa9c94c6da85f3e, group_id=277bd059474947a5a783a7fc06ee88db, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:47.660290 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f391b5-f041-4a29-8004-db5661829e81 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:47.678941 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 185/388] 10.222.0.42 () {58 vars in 1442 bytes} [Tue Aug 2 15:15:47 2022] PUT /identity/v3/projects/3f5199ad4b6b4534bfa9c94c6da85f3e/groups/277bd059474947a5a783a7fc06ee88db/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:15:47.692318 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-3e5bf828-da1b-4191-9561-3fc53946db10 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:15:47.694092 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-3e5bf828-da1b-4191-9561-3fc53946db10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:15:47.805120 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 204/389] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:15:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:15:47.844636 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f391b5-f041-4a29-8004-db5661829e81 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:47.975454 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:47.978936 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f391b5-f041-4a29-8004-db5661829e81 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:48.017390 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b206011-8770-44dc-9485-574a10e9fd3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:48.018043 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b206011-8770-44dc-9485-574a10e9fd3c None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:48.018328 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b206011-8770-44dc-9485-574a10e9fd3c None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:48.018606 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b206011-8770-44dc-9485-574a10e9fd3c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:48.030674 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b206011-8770-44dc-9485-574a10e9fd3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:15:48.032879 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aaa096-273b-4986-95d8-0bd68aea927a None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:48.033177 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aaa096-273b-4986-95d8-0bd68aea927a None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:48.033456 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aaa096-273b-4986-95d8-0bd68aea927a None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:48.035117 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 205/390] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:15:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:15:48.036493 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-8b206011-8770-44dc-9485-574a10e9fd3c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 15:15:48.036493 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:15:48.036493 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:15:48.036493 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:15:48.036493 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:15:48.036493 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:15:48.036493 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:15:48.036493 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:15:48.036493 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:15:48.036493 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:15:48.036493 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:15:48.036493 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:15:48.036493 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:15:48.036493 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:15:48.036493 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:15:48.036493 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:15:48.037626 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:15:48.037626 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:15:48.037626 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:15:48.037626 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:15:48.037626 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:15:48.037626 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:15:48.037626 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:15:48.037626 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:15:48.037626 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:15:48.037626 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:15:48.037626 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:15:48.037626 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:15:48.037626 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:15:48.037626 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:15:48.037626 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:15:48.037626 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:15:48.038750 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:15:48.038750 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:15:48.038750 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:15:48.038750 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:15:48.038750 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:15:48.038750 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:15:48.038750 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:15:48.038750 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:15:48.038750 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:15:48.038750 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:15:48.038750 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 15:15:48.038750 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:15:48.038750 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 186/391] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Aug 2 15:15:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:15:48.041883 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d4162-7af9-49ab-9099-4530827cdbed None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:48.041883 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d4162-7af9-49ab-9099-4530827cdbed None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:48.042217 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d4162-7af9-49ab-9099-4530827cdbed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:48.046224 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b206011-8770-44dc-9485-574a10e9fd3c None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:48.071615 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-ac4d4162-7af9-49ab-9099-4530827cdbed None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:15:48.072878 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-ac4d4162-7af9-49ab-9099-4530827cdbed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:15:48.162779 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 206/392] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:15:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 15:15:48.166930 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b206011-8770-44dc-9485-574a10e9fd3c None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:48.188152 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4d4162-7af9-49ab-9099-4530827cdbed None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:48.219650 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:48.236731 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f007973-e734-4eff-9911-50b66ef739da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:48.237394 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f007973-e734-4eff-9911-50b66ef739da None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:48.237749 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f007973-e734-4eff-9911-50b66ef739da None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:48.238095 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f007973-e734-4eff-9911-50b66ef739da None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:48.238894 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f007973-e734-4eff-9911-50b66ef739da None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:48.239337 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f007973-e734-4eff-9911-50b66ef739da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:48.240998 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f007973-e734-4eff-9911-50b66ef739da None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:48.261847 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 187/393] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 2 15:15:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:15:48.266995 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f007973-e734-4eff-9911-50b66ef739da None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:48.311648 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4d4162-7af9-49ab-9099-4530827cdbed None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:48.343615 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:48.352590 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd8781-2600-4e0a-be86-59def3170ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:48.353243 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd8781-2600-4e0a-be86-59def3170ad8 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:48.353527 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd8781-2600-4e0a-be86-59def3170ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:48.353803 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd8781-2600-4e0a-be86-59def3170ad8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:48.367247 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd8781-2600-4e0a-be86-59def3170ad8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:15:48.380978 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-5bbd8781-2600-4e0a-be86-59def3170ad8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 15:15:48.380978 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:15:48.380978 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:15:48.380978 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:15:48.380978 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:15:48.380978 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:15:48.380978 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:15:48.380978 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:15:48.380978 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:15:48.380978 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:15:48.380978 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:15:48.380978 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:15:48.380978 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:15:48.380978 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:15:48.380978 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:15:48.380978 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:15:48.381904 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:15:48.381904 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:15:48.381904 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:15:48.381904 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:15:48.381904 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:15:48.381904 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:15:48.381904 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:15:48.381904 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:15:48.381904 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:15:48.381904 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:15:48.381904 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:15:48.381904 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:15:48.381904 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:15:48.381904 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:15:48.381904 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:15:48.381904 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:15:48.382678 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:15:48.382678 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:15:48.382678 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:15:48.382678 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:15:48.382678 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:15:48.382678 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:15:48.382678 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:15:48.382678 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:15:48.382678 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:15:48.382678 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:15:48.382678 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 15:15:48.382678 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:15:48.389316 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 207/394] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 2 15:15:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:15:48.397588 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd8781-2600-4e0a-be86-59def3170ad8 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:48.446420 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f007973-e734-4eff-9911-50b66ef739da None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:48.502420 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:48.543337 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a3423-fd7d-45ac-a1bd-f51389618f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:48.544140 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a3423-fd7d-45ac-a1bd-f51389618f47 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:48.544425 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a3423-fd7d-45ac-a1bd-f51389618f47 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:48.544707 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a3423-fd7d-45ac-a1bd-f51389618f47 None admin] PATH_INFO: `/v3/groups/277bd059474947a5a783a7fc06ee88db` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:48.547172 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36a3423-fd7d-45ac-a1bd-f51389618f47 None admin] RBAC: Authorizing `identity:get_group(group_id=277bd059474947a5a783a7fc06ee88db)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:48.548679 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36a3423-fd7d-45ac-a1bd-f51389618f47 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:48.556423 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 188/395] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Aug 2 15:15:48 2022] GET /identity/v3/groups/277bd059474947a5a783a7fc06ee88db => generated 226 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:15:48.558338 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd8781-2600-4e0a-be86-59def3170ad8 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:48.562676 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a3423-fd7d-45ac-a1bd-f51389618f47 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:48.644488 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3759098-bb5a-499f-a528-7290aea73d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:48.645126 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3759098-bb5a-499f-a528-7290aea73d65 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:48.645405 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3759098-bb5a-499f-a528-7290aea73d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:48.645677 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3759098-bb5a-499f-a528-7290aea73d65 None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:48.646957 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3759098-bb5a-499f-a528-7290aea73d65 None admin] RBAC: Adding query filter params (name=member) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:48.647282 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3759098-bb5a-499f-a528-7290aea73d65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:48.648705 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3759098-bb5a-499f-a528-7290aea73d65 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:48.668789 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 208/396] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 2 15:15:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:48.675311 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3759098-bb5a-499f-a528-7290aea73d65 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:48.736304 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:48.753475 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a3423-fd7d-45ac-a1bd-f51389618f47 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:48.793179 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df86a109-2394-4d85-8951-6943852c3c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:48.794215 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df86a109-2394-4d85-8951-6943852c3c13 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:48.794727 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df86a109-2394-4d85-8951-6943852c3c13 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:48.795208 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df86a109-2394-4d85-8951-6943852c3c13 None admin] PATH_INFO: `/v3/projects/3f5199ad4b6b4534bfa9c94c6da85f3e` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:48.796724 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df86a109-2394-4d85-8951-6943852c3c13 None admin] RBAC: Authorizing `identity:get_project(project_id=3f5199ad4b6b4534bfa9c94c6da85f3e)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:48.798406 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df86a109-2394-4d85-8951-6943852c3c13 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:48.800750 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 189/397] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 2 15:15:48 2022] GET /identity/v3/projects/3f5199ad4b6b4534bfa9c94c6da85f3e => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:48.806667 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748114c3-28ce-4b41-b344-92bdd610f268 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:48.807366 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748114c3-28ce-4b41-b344-92bdd610f268 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:48.807883 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748114c3-28ce-4b41-b344-92bdd610f268 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:48.809483 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 190/398] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:15:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:15:48.810415 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748114c3-28ce-4b41-b344-92bdd610f268 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:48.821562 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3759098-bb5a-499f-a528-7290aea73d65 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:48.859538 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f52b3-35d7-46dc-93a1-44d08cddfb3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:48.860226 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f52b3-35d7-46dc-93a1-44d08cddfb3e None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:48.860753 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f52b3-35d7-46dc-93a1-44d08cddfb3e None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:48.860862 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f52b3-35d7-46dc-93a1-44d08cddfb3e None admin] PATH_INFO: `/v3/groups/277bd059474947a5a783a7fc06ee88db` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:48.862207 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6f52b3-35d7-46dc-93a1-44d08cddfb3e None admin] RBAC: Authorizing `identity:get_group(group_id=277bd059474947a5a783a7fc06ee88db)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:48.864355 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6f52b3-35d7-46dc-93a1-44d08cddfb3e None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:48.867466 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 209/399] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Aug 2 15:15:48 2022] GET /identity/v3/groups/277bd059474947a5a783a7fc06ee88db => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:48.868780 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0cb0a1-1e84-4121-b25e-969d94684fff None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:48.869062 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0cb0a1-1e84-4121-b25e-969d94684fff None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:48.869329 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0cb0a1-1e84-4121-b25e-969d94684fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:48.889340 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-cd0cb0a1-1e84-4121-b25e-969d94684fff None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:15:48.890560 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-cd0cb0a1-1e84-4121-b25e-969d94684fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:15:48.892858 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:48.925481 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748114c3-28ce-4b41-b344-92bdd610f268 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:48.961652 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf619c5-a1e2-467c-b742-74c052f3d9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:48.962681 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf619c5-a1e2-467c-b742-74c052f3d9c3 None admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:48.963208 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf619c5-a1e2-467c-b742-74c052f3d9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:48.963733 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf619c5-a1e2-467c-b742-74c052f3d9c3 None admin] PATH_INFO: `/v3/projects/3f5199ad4b6b4534bfa9c94c6da85f3e/groups/277bd059474947a5a783a7fc06ee88db/roles/3e1c8e0567ff4244aef0d6a62fc8b18d` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:48.966239 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf619c5-a1e2-467c-b742-74c052f3d9c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=3f5199ad4b6b4534bfa9c94c6da85f3e, group_id=277bd059474947a5a783a7fc06ee88db, role_id=3e1c8e0567ff4244aef0d6a62fc8b18d)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:48.966953 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 210/400] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:15:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:15:48.967885 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0cb0a1-1e84-4121-b25e-969d94684fff None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:48.968462 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf619c5-a1e2-467c-b742-74c052f3d9c3 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:48.993001 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 191/401] 10.222.0.42 () {58 vars in 1442 bytes} [Tue Aug 2 15:15:48 2022] PUT /identity/v3/projects/3f5199ad4b6b4534bfa9c94c6da85f3e/groups/277bd059474947a5a783a7fc06ee88db/roles/3e1c8e0567ff4244aef0d6a62fc8b18d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:15:48.993840 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf619c5-a1e2-467c-b742-74c052f3d9c3 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:49.048332 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:49.096279 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0cb0a1-1e84-4121-b25e-969d94684fff None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:49.151353 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd40a21-605a-4aed-bbf4-6a11420684a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:49.153087 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd40a21-605a-4aed-bbf4-6a11420684a8 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:49.153672 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd40a21-605a-4aed-bbf4-6a11420684a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:49.154148 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd40a21-605a-4aed-bbf4-6a11420684a8 None admin] PATH_INFO: `/v3/projects/02cccaf1e1a44792916250e99dc79efa` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:49.159232 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd40a21-605a-4aed-bbf4-6a11420684a8 None admin] RBAC: Authorizing `identity:get_project(project_id=02cccaf1e1a44792916250e99dc79efa)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:49.161113 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd40a21-605a-4aed-bbf4-6a11420684a8 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:49.164797 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 211/402] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 2 15:15:48 2022] GET /identity/v3/projects/02cccaf1e1a44792916250e99dc79efa => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:49.170217 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd40a21-605a-4aed-bbf4-6a11420684a8 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:49.183139 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:49.211506 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf619c5-a1e2-467c-b742-74c052f3d9c3 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:49.263827 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5153b0-fb98-4e22-b7f7-b26d4638e7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:49.265173 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5153b0-fb98-4e22-b7f7-b26d4638e7d4 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:49.265681 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5153b0-fb98-4e22-b7f7-b26d4638e7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:49.266452 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5153b0-fb98-4e22-b7f7-b26d4638e7d4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:49.282669 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5153b0-fb98-4e22-b7f7-b26d4638e7d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:15:49.291234 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-5a5153b0-fb98-4e22-b7f7-b26d4638e7d4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 15:15:49.291234 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:15:49.291234 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:15:49.291234 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:15:49.291234 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:15:49.291234 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:15:49.291234 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:15:49.291234 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:15:49.291234 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:15:49.291234 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:15:49.291234 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:15:49.291234 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:15:49.291234 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:15:49.291234 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:15:49.291234 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:15:49.291234 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:15:49.292209 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:15:49.292209 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:15:49.292209 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:15:49.292209 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:15:49.292209 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:15:49.292209 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:15:49.292209 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:15:49.292209 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:15:49.292209 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:15:49.292209 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:15:49.292209 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:15:49.292209 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:15:49.292209 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:15:49.292209 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:15:49.292209 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:15:49.292209 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:15:49.293027 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:15:49.293027 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:15:49.293027 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:15:49.293027 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:15:49.293027 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:15:49.293027 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:15:49.293027 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:15:49.293027 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:15:49.293027 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:15:49.293027 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:15:49.293027 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 15:15:49.293027 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:15:49.301652 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 192/403] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Aug 2 15:15:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:15:49.301652 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b722ce-d34e-4b20-b5d8-19dcf82c064a None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:49.301652 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b722ce-d34e-4b20-b5d8-19dcf82c064a None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:49.301652 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b722ce-d34e-4b20-b5d8-19dcf82c064a None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:49.304306 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 193/404] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:15:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:15:49.305602 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b722ce-d34e-4b20-b5d8-19dcf82c064a None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:49.316935 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd40a21-605a-4aed-bbf4-6a11420684a8 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:49.364674 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e6a221-4c5e-49a7-974f-35bead39d82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:49.365578 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6a221-4c5e-49a7-974f-35bead39d82b None admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:49.365870 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6a221-4c5e-49a7-974f-35bead39d82b None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:49.366179 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6a221-4c5e-49a7-974f-35bead39d82b None admin] PATH_INFO: `/v3/projects/02cccaf1e1a44792916250e99dc79efa/groups/277bd059474947a5a783a7fc06ee88db/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:49.368383 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e6a221-4c5e-49a7-974f-35bead39d82b None admin] RBAC: Authorizing `identity:create_grant(project_id=02cccaf1e1a44792916250e99dc79efa, group_id=277bd059474947a5a783a7fc06ee88db, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:49.369926 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e6a221-4c5e-49a7-974f-35bead39d82b None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:49.384698 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 212/405] 10.222.0.42 () {58 vars in 1442 bytes} [Tue Aug 2 15:15:49 2022] PUT /identity/v3/projects/02cccaf1e1a44792916250e99dc79efa/groups/277bd059474947a5a783a7fc06ee88db/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:15:49.386191 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcbcd76-f625-4d87-84fb-c5c26187b72a None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:49.386416 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcbcd76-f625-4d87-84fb-c5c26187b72a None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:49.386697 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcbcd76-f625-4d87-84fb-c5c26187b72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:49.407113 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-4dcbcd76-f625-4d87-84fb-c5c26187b72a None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:15:49.408681 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-4dcbcd76-f625-4d87-84fb-c5c26187b72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:15:49.416645 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:49.456278 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b722ce-d34e-4b20-b5d8-19dcf82c064a None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:49.522646 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:49.533143 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 213/406] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:15:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:15:49.556156 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcbcd76-f625-4d87-84fb-c5c26187b72a None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:49.564577 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af59355a-eed2-4fec-879d-fe28988cbc62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:49.565238 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af59355a-eed2-4fec-879d-fe28988cbc62 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:49.565516 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af59355a-eed2-4fec-879d-fe28988cbc62 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:49.565783 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af59355a-eed2-4fec-879d-fe28988cbc62 None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:49.566512 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af59355a-eed2-4fec-879d-fe28988cbc62 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:49.566824 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af59355a-eed2-4fec-879d-fe28988cbc62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:49.568886 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af59355a-eed2-4fec-879d-fe28988cbc62 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:49.589792 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 194/407] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 2 15:15:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:49.595740 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af59355a-eed2-4fec-879d-fe28988cbc62 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:49.684868 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcbcd76-f625-4d87-84fb-c5c26187b72a None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:49.727237 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af59355a-eed2-4fec-879d-fe28988cbc62 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:49.766570 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5a5da-87fe-461d-b6f5-8c4479f18ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:49.767516 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5a5da-87fe-461d-b6f5-8c4479f18ca9 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:49.767803 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5a5da-87fe-461d-b6f5-8c4479f18ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:49.768079 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5a5da-87fe-461d-b6f5-8c4479f18ca9 None admin] PATH_INFO: `/v3/groups/277bd059474947a5a783a7fc06ee88db` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:49.769285 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b5a5da-87fe-461d-b6f5-8c4479f18ca9 None admin] RBAC: Authorizing `identity:get_group(group_id=277bd059474947a5a783a7fc06ee88db)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:49.771310 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b5a5da-87fe-461d-b6f5-8c4479f18ca9 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:49.773677 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 195/408] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Aug 2 15:15:49 2022] GET /identity/v3/groups/277bd059474947a5a783a7fc06ee88db => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:15:49.779518 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5a5da-87fe-461d-b6f5-8c4479f18ca9 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:49.793093 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:49.796033 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac9a5e-f5e6-4cd3-a582-c8f98abdbf0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:49.796710 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac9a5e-f5e6-4cd3-a582-c8f98abdbf0e None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:49.796993 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac9a5e-f5e6-4cd3-a582-c8f98abdbf0e None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:49.797270 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac9a5e-f5e6-4cd3-a582-c8f98abdbf0e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:49.851969 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac9a5e-f5e6-4cd3-a582-c8f98abdbf0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:15:49.857049 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-37ac9a5e-f5e6-4cd3-a582-c8f98abdbf0e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 15:15:49.857049 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:15:49.857049 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:15:49.857049 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:15:49.857049 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:15:49.857049 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:15:49.857049 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:15:49.857049 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:15:49.857049 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:15:49.857049 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:15:49.857049 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:15:49.857049 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:15:49.857049 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:15:49.857049 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:15:49.857049 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:15:49.857049 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:15:49.857923 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:15:49.857923 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:15:49.857923 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:15:49.857923 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:15:49.857923 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:15:49.857923 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:15:49.857923 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:15:49.857923 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:15:49.857923 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:15:49.857923 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:15:49.857923 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:15:49.857923 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:15:49.857923 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:15:49.857923 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:15:49.857923 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:15:49.857923 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:15:49.859437 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:15:49.859437 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:15:49.859437 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:15:49.859437 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:15:49.859437 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:15:49.859437 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:15:49.859437 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:15:49.859437 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:15:49.859437 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:15:49.859437 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:15:49.859437 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 15:15:49.859437 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:15:49.859437 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 214/409] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 2 15:15:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 15:15:49.867397 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac9a5e-f5e6-4cd3-a582-c8f98abdbf0e None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:49.897458 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5a5da-87fe-461d-b6f5-8c4479f18ca9 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:49.937194 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9132aff6-0f44-42fc-b284-9ae4c191a78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:49.937945 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132aff6-0f44-42fc-b284-9ae4c191a78a None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:49.938696 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132aff6-0f44-42fc-b284-9ae4c191a78a None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:49.939046 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132aff6-0f44-42fc-b284-9ae4c191a78a None admin] PATH_INFO: `/v3/projects/02cccaf1e1a44792916250e99dc79efa` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:49.948111 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9132aff6-0f44-42fc-b284-9ae4c191a78a None admin] RBAC: Authorizing `identity:get_project(project_id=02cccaf1e1a44792916250e99dc79efa)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:49.949608 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9132aff6-0f44-42fc-b284-9ae4c191a78a None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:49.953980 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 196/410] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 2 15:15:49 2022] GET /identity/v3/projects/02cccaf1e1a44792916250e99dc79efa => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:49.957337 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9132aff6-0f44-42fc-b284-9ae4c191a78a None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:50.035808 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:50.085431 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:50.115270 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac9a5e-f5e6-4cd3-a582-c8f98abdbf0e None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:50.125213 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9132aff6-0f44-42fc-b284-9ae4c191a78a None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:50.160958 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069964f2-e5fe-4e82-8547-0a60d8227f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:50.161679 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069964f2-e5fe-4e82-8547-0a60d8227f5a None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:50.162465 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069964f2-e5fe-4e82-8547-0a60d8227f5a None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:50.162737 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069964f2-e5fe-4e82-8547-0a60d8227f5a None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:50.167815 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069964f2-e5fe-4e82-8547-0a60d8227f5a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:50.168264 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069964f2-e5fe-4e82-8547-0a60d8227f5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:50.175244 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069964f2-e5fe-4e82-8547-0a60d8227f5a None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:50.179281 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 215/411] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 2 15:15:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:50.184850 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069964f2-e5fe-4e82-8547-0a60d8227f5a None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:50.185913 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b76a414-244d-40fb-a53a-0d7c475afc11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:50.186609 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76a414-244d-40fb-a53a-0d7c475afc11 None admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:50.186893 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76a414-244d-40fb-a53a-0d7c475afc11 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:50.187174 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76a414-244d-40fb-a53a-0d7c475afc11 None admin] PATH_INFO: `/v3/projects/02cccaf1e1a44792916250e99dc79efa/groups/277bd059474947a5a783a7fc06ee88db/roles/3e1c8e0567ff4244aef0d6a62fc8b18d` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:50.192650 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b76a414-244d-40fb-a53a-0d7c475afc11 None admin] RBAC: Authorizing `identity:create_grant(project_id=02cccaf1e1a44792916250e99dc79efa, group_id=277bd059474947a5a783a7fc06ee88db, role_id=3e1c8e0567ff4244aef0d6a62fc8b18d)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:50.194132 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b76a414-244d-40fb-a53a-0d7c475afc11 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:50.222659 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 197/412] 10.222.0.42 () {58 vars in 1442 bytes} [Tue Aug 2 15:15:49 2022] PUT /identity/v3/projects/02cccaf1e1a44792916250e99dc79efa/groups/277bd059474947a5a783a7fc06ee88db/roles/3e1c8e0567ff4244aef0d6a62fc8b18d => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:15:50.351005 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069964f2-e5fe-4e82-8547-0a60d8227f5a None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:50.364849 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd109f1-33fb-478c-a695-020582700cfd None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:50.365541 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd109f1-33fb-478c-a695-020582700cfd None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:50.366020 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd109f1-33fb-478c-a695-020582700cfd None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:50.368124 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 198/413] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:15:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:15:50.376754 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e068042-5deb-47b5-bbe5-ef50c1bd705e None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:50.377396 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e068042-5deb-47b5-bbe5-ef50c1bd705e None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:50.377879 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e068042-5deb-47b5-bbe5-ef50c1bd705e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:50.379769 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:50.404086 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e66e6d5-d675-4ec7-aa55-50155f2ec31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:50.404761 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66e6d5-d675-4ec7-aa55-50155f2ec31a None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:50.405057 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66e6d5-d675-4ec7-aa55-50155f2ec31a None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:50.411249 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66e6d5-d675-4ec7-aa55-50155f2ec31a None admin] PATH_INFO: `/v3/groups/f9e764c109714519b71fb4cccac770c5` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:50.411249 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e66e6d5-d675-4ec7-aa55-50155f2ec31a None admin] RBAC: Authorizing `identity:get_group(group_id=f9e764c109714519b71fb4cccac770c5)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:50.411249 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e66e6d5-d675-4ec7-aa55-50155f2ec31a None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:50.411249 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 216/414] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Aug 2 15:15:50 2022] GET /identity/v3/groups/f9e764c109714519b71fb4cccac770c5 => generated 229 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:50.417079 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e66e6d5-d675-4ec7-aa55-50155f2ec31a None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:50.424445 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-2e068042-5deb-47b5-bbe5-ef50c1bd705e None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:15:50.425993 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-2e068042-5deb-47b5-bbe5-ef50c1bd705e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:15:50.562350 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e66e6d5-d675-4ec7-aa55-50155f2ec31a None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:50.571227 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 199/415] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:15:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:15:50.596237 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e068042-5deb-47b5-bbe5-ef50c1bd705e None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:50.605610 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b760f330-beef-4a0e-b12e-e6b4faa4cc7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:50.606927 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760f330-beef-4a0e-b12e-e6b4faa4cc7b None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:50.607240 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760f330-beef-4a0e-b12e-e6b4faa4cc7b None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:50.607584 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760f330-beef-4a0e-b12e-e6b4faa4cc7b None admin] PATH_INFO: `/v3/projects/e01cd4e1a6a040d99206efa57fc6e2e1` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:50.609312 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b760f330-beef-4a0e-b12e-e6b4faa4cc7b None admin] RBAC: Authorizing `identity:get_project(project_id=e01cd4e1a6a040d99206efa57fc6e2e1)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:50.611413 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b760f330-beef-4a0e-b12e-e6b4faa4cc7b None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:50.613939 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 217/416] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 2 15:15:50 2022] GET /identity/v3/projects/e01cd4e1a6a040d99206efa57fc6e2e1 => generated 344 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:50.619909 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b760f330-beef-4a0e-b12e-e6b4faa4cc7b None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:50.706316 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:50.708668 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:50.777217 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b760f330-beef-4a0e-b12e-e6b4faa4cc7b None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:50.779523 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e068042-5deb-47b5-bbe5-ef50c1bd705e None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:50.835870 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71040532-1080-4401-9097-a5cc20f8625c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:50.836806 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71040532-1080-4401-9097-a5cc20f8625c None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:50.837127 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71040532-1080-4401-9097-a5cc20f8625c None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:50.837405 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71040532-1080-4401-9097-a5cc20f8625c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:50.852410 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71040532-1080-4401-9097-a5cc20f8625c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:15:50.858783 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-71040532-1080-4401-9097-a5cc20f8625c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 15:15:50.858783 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:15:50.858783 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:15:50.858783 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:15:50.858783 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:15:50.858783 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:15:50.858783 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:15:50.858783 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:15:50.858783 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:15:50.858783 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:15:50.858783 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:15:50.858783 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:15:50.858783 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:15:50.858783 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:15:50.858783 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:15:50.858783 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:15:50.859731 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:15:50.859731 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:15:50.859731 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:15:50.859731 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:15:50.859731 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:15:50.859731 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:15:50.859731 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:15:50.859731 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:15:50.859731 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:15:50.859731 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:15:50.859731 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:15:50.859731 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:15:50.859731 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:15:50.859731 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:15:50.859731 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:15:50.859731 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:15:50.860517 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:15:50.860517 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:15:50.860517 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:15:50.860517 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:15:50.860517 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:15:50.860517 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:15:50.860517 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:15:50.860517 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:15:50.860517 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:15:50.860517 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:15:50.860517 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 15:15:50.860517 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:15:50.860517 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 200/417] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 2 15:15:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:15:50.866048 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71040532-1080-4401-9097-a5cc20f8625c None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:50.879335 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26b9bd-0812-49de-84e0-a8a7ddb60431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:50.880067 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26b9bd-0812-49de-84e0-a8a7ddb60431 None admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:50.880360 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26b9bd-0812-49de-84e0-a8a7ddb60431 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:50.880645 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26b9bd-0812-49de-84e0-a8a7ddb60431 None admin] PATH_INFO: `/v3/projects/e01cd4e1a6a040d99206efa57fc6e2e1/groups/f9e764c109714519b71fb4cccac770c5/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:50.888773 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d26b9bd-0812-49de-84e0-a8a7ddb60431 None admin] RBAC: Authorizing `identity:create_grant(project_id=e01cd4e1a6a040d99206efa57fc6e2e1, group_id=f9e764c109714519b71fb4cccac770c5, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:50.890504 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d26b9bd-0812-49de-84e0-a8a7ddb60431 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:50.918175 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 218/418] 10.222.0.42 () {58 vars in 1442 bytes} [Tue Aug 2 15:15:50 2022] PUT /identity/v3/projects/e01cd4e1a6a040d99206efa57fc6e2e1/groups/f9e764c109714519b71fb4cccac770c5/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:15:50.986247 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71040532-1080-4401-9097-a5cc20f8625c None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:51.016533 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:51.026987 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c1577b-aecc-48ff-8365-a083fbf3fe6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:51.027648 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1577b-aecc-48ff-8365-a083fbf3fe6e None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:51.027931 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1577b-aecc-48ff-8365-a083fbf3fe6e None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:51.028207 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1577b-aecc-48ff-8365-a083fbf3fe6e None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:51.028939 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c1577b-aecc-48ff-8365-a083fbf3fe6e None admin] RBAC: Adding query filter params (name=member) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:51.029243 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c1577b-aecc-48ff-8365-a083fbf3fe6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:51.030736 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c1577b-aecc-48ff-8365-a083fbf3fe6e None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:51.042003 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 201/419] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 2 15:15:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:15:51.047740 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26b9bd-0812-49de-84e0-a8a7ddb60431 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:51.178891 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26b9bd-0812-49de-84e0-a8a7ddb60431 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:51.196060 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:51.220336 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30968dde-038d-4113-8c6e-49acf74eb495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:51.221180 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30968dde-038d-4113-8c6e-49acf74eb495 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:51.221611 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30968dde-038d-4113-8c6e-49acf74eb495 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:51.222177 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30968dde-038d-4113-8c6e-49acf74eb495 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:51.297842 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30968dde-038d-4113-8c6e-49acf74eb495 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:51.299531 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30968dde-038d-4113-8c6e-49acf74eb495 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:51.360434 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69963f6c-9b68-4f7e-9353-2a1ba2b96eaf None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:51.360795 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69963f6c-9b68-4f7e-9353-2a1ba2b96eaf None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:51.361085 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69963f6c-9b68-4f7e-9353-2a1ba2b96eaf None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:51.362721 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 202/420] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:15:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 15:15:51.367921 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d6e57-900e-4406-bf73-c20f0865be2b None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:51.368205 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d6e57-900e-4406-bf73-c20f0865be2b None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:51.368481 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d6e57-900e-4406-bf73-c20f0865be2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:51.388018 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-e97d6e57-900e-4406-bf73-c20f0865be2b None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:15:51.389377 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-e97d6e57-900e-4406-bf73-c20f0865be2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:15:51.415461 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 219/421] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 2 15:15:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 15:15:51.421091 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30968dde-038d-4113-8c6e-49acf74eb495 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:51.440267 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:51.481028 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 203/422] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:15:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 15:15:51.522046 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d6e57-900e-4406-bf73-c20f0865be2b None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:51.537362 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30968dde-038d-4113-8c6e-49acf74eb495 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:51.573893 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd8ce8d-1079-4f8f-8a73-ea370cc800da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:51.574540 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8ce8d-1079-4f8f-8a73-ea370cc800da None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:51.574824 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8ce8d-1079-4f8f-8a73-ea370cc800da None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:51.575101 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8ce8d-1079-4f8f-8a73-ea370cc800da None admin] PATH_INFO: `/v3/projects/3f5199ad4b6b4534bfa9c94c6da85f3e` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:51.580623 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd8ce8d-1079-4f8f-8a73-ea370cc800da None admin] RBAC: Authorizing `identity:get_project(project_id=3f5199ad4b6b4534bfa9c94c6da85f3e)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:51.582094 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd8ce8d-1079-4f8f-8a73-ea370cc800da None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:51.584424 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 220/423] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 2 15:15:51 2022] GET /identity/v3/projects/3f5199ad4b6b4534bfa9c94c6da85f3e => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:15:51.590426 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd8ce8d-1079-4f8f-8a73-ea370cc800da None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:51.725904 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d6e57-900e-4406-bf73-c20f0865be2b None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:51.747632 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:51.761143 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd8ce8d-1079-4f8f-8a73-ea370cc800da None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:51.779608 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:51.790884 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4676ca95-d64e-4327-b707-6cad83897e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:51.791597 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676ca95-d64e-4327-b707-6cad83897e86 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:51.791889 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676ca95-d64e-4327-b707-6cad83897e86 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:51.792181 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676ca95-d64e-4327-b707-6cad83897e86 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:51.808193 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31459889-ad41-4072-8746-a6b97528379d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:51.809029 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31459889-ad41-4072-8746-a6b97528379d None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:51.809319 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31459889-ad41-4072-8746-a6b97528379d None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:51.809597 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31459889-ad41-4072-8746-a6b97528379d None admin] PATH_INFO: `/v3/groups/277bd059474947a5a783a7fc06ee88db` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:51.810816 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31459889-ad41-4072-8746-a6b97528379d None admin] RBAC: Authorizing `identity:get_group(group_id=277bd059474947a5a783a7fc06ee88db)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:51.812720 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31459889-ad41-4072-8746-a6b97528379d None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:51.814856 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 221/424] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Aug 2 15:15:51 2022] GET /identity/v3/groups/277bd059474947a5a783a7fc06ee88db => generated 226 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:51.820409 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4676ca95-d64e-4327-b707-6cad83897e86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:15:51.820820 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31459889-ad41-4072-8746-a6b97528379d None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:51.826050 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-4676ca95-d64e-4327-b707-6cad83897e86 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 15:15:51.826050 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:15:51.826050 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:15:51.826050 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:15:51.826050 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:15:51.826050 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:15:51.826050 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:15:51.826050 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:15:51.826050 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:15:51.826050 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:15:51.826050 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:15:51.826050 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:15:51.826050 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:15:51.826050 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:15:51.826050 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:15:51.826050 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:15:51.827045 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:15:51.827045 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:15:51.827045 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:15:51.827045 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:15:51.827045 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:15:51.827045 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:15:51.827045 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:15:51.827045 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:15:51.827045 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:15:51.827045 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:15:51.827045 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:15:51.827045 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:15:51.827045 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:15:51.827045 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:15:51.827045 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:15:51.827045 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:15:51.827876 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:15:51.827876 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:15:51.827876 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:15:51.827876 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:15:51.827876 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:15:51.827876 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:15:51.827876 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:15:51.827876 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:15:51.827876 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:15:51.827876 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:15:51.827876 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 15:15:51.827876 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:15:51.834347 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 204/425] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Aug 2 15:15:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 15:15:51.835304 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4676ca95-d64e-4327-b707-6cad83897e86 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:51.945361 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31459889-ad41-4072-8746-a6b97528379d None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:51.986905 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d7a2ae-2c0c-4e0c-ad86-627988f90077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:51.987476 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d7a2ae-2c0c-4e0c-ad86-627988f90077 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:51.987762 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d7a2ae-2c0c-4e0c-ad86-627988f90077 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:51.988299 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d7a2ae-2c0c-4e0c-ad86-627988f90077 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:51.989110 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d7a2ae-2c0c-4e0c-ad86-627988f90077 None admin] RBAC: Adding query filter params (group.id=277bd059474947a5a783a7fc06ee88db, role.id=bf4fcdd92d8a4a6d855f3eaa4f542529, scope.project.id=3f5199ad4b6b4534bfa9c94c6da85f3e) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:51.989430 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d7a2ae-2c0c-4e0c-ad86-627988f90077 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:51.991554 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d7a2ae-2c0c-4e0c-ad86-627988f90077 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:51.999352 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 222/426] 10.222.0.42 () {56 vars in 1376 bytes} [Tue Aug 2 15:15:51 2022] GET /identity/v3/role_assignments?group.id=277bd059474947a5a783a7fc06ee88db&scope.project.id=3f5199ad4b6b4534bfa9c94c6da85f3e&role.id=bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 611 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:52.055705 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4676ca95-d64e-4327-b707-6cad83897e86 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:52.093537 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8cd904-3c54-4145-af7c-37d9cf605862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:52.094168 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8cd904-3c54-4145-af7c-37d9cf605862 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:52.094450 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8cd904-3c54-4145-af7c-37d9cf605862 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:52.094729 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8cd904-3c54-4145-af7c-37d9cf605862 None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:52.095482 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8cd904-3c54-4145-af7c-37d9cf605862 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:52.095789 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8cd904-3c54-4145-af7c-37d9cf605862 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:52.097197 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8cd904-3c54-4145-af7c-37d9cf605862 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:52.106478 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 205/427] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 2 15:15:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:52.112346 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d7a2ae-2c0c-4e0c-ad86-627988f90077 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:52.130006 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:52.221697 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d751e-7430-4fae-af51-e23bb548c871 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:52.222355 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d751e-7430-4fae-af51-e23bb548c871 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:52.222683 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d751e-7430-4fae-af51-e23bb548c871 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:52.228567 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 206/428] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:15:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 15:15:52.230582 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50706b24-218b-4e88-ac6b-5ce1062e67b7 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:52.230869 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50706b24-218b-4e88-ac6b-5ce1062e67b7 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:52.231144 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50706b24-218b-4e88-ac6b-5ce1062e67b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:52.267967 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-50706b24-218b-4e88-ac6b-5ce1062e67b7 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:15:52.269268 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-50706b24-218b-4e88-ac6b-5ce1062e67b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:15:52.274775 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d7a2ae-2c0c-4e0c-ad86-627988f90077 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:52.319840 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:52.321267 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c395e207-1e14-4217-aa83-ff7199283f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:52.323116 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395e207-1e14-4217-aa83-ff7199283f9d None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:52.323116 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395e207-1e14-4217-aa83-ff7199283f9d None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:52.323116 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395e207-1e14-4217-aa83-ff7199283f9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:52.370425 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 207/429] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:15:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 15:15:52.395329 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50706b24-218b-4e88-ac6b-5ce1062e67b7 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:52.418209 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c395e207-1e14-4217-aa83-ff7199283f9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:52.420191 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c395e207-1e14-4217-aa83-ff7199283f9d None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:52.438980 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:52.548740 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50706b24-218b-4e88-ac6b-5ce1062e67b7 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:52.550302 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 223/430] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 2 15:15:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 15:15:52.560997 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c395e207-1e14-4217-aa83-ff7199283f9d None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:52.596833 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b7cda-6b7c-49be-b1b7-deec636f8f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:52.597744 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b7cda-6b7c-49be-b1b7-deec636f8f3e None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:52.598168 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b7cda-6b7c-49be-b1b7-deec636f8f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:52.598585 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b7cda-6b7c-49be-b1b7-deec636f8f3e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:52.616853 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2b7cda-6b7c-49be-b1b7-deec636f8f3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:15:52.623661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-cd2b7cda-6b7c-49be-b1b7-deec636f8f3e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 15:15:52.623661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:15:52.623661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:15:52.623661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:15:52.623661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:15:52.623661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:15:52.623661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:15:52.623661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:15:52.623661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:15:52.623661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:15:52.623661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:15:52.623661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:15:52.623661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:15:52.623661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:15:52.623661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:15:52.623661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:15:52.625160 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:15:52.625160 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:15:52.625160 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:15:52.625160 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:15:52.625160 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:15:52.625160 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:15:52.625160 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:15:52.625160 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:15:52.625160 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:15:52.625160 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:15:52.625160 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:15:52.625160 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:15:52.625160 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:15:52.625160 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:15:52.625160 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:15:52.625160 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:15:52.626196 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:15:52.626196 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:15:52.626196 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:15:52.626196 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:15:52.626196 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:15:52.626196 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:15:52.626196 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:15:52.626196 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:15:52.626196 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:15:52.626196 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:15:52.626196 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 15:15:52.626196 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:15:52.628695 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 208/431] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 2 15:15:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 15:15:52.637694 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b7cda-6b7c-49be-b1b7-deec636f8f3e None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:52.686974 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:52.717684 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c395e207-1e14-4217-aa83-ff7199283f9d None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:52.735430 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:52.759453 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6dfca8-8de4-4125-904c-acdf2c58cc82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:52.760150 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6dfca8-8de4-4125-904c-acdf2c58cc82 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:52.760431 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6dfca8-8de4-4125-904c-acdf2c58cc82 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:52.760966 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6dfca8-8de4-4125-904c-acdf2c58cc82 None admin] PATH_INFO: `/v3/projects/3f5199ad4b6b4534bfa9c94c6da85f3e` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:52.762929 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6dfca8-8de4-4125-904c-acdf2c58cc82 None admin] RBAC: Authorizing `identity:get_project(project_id=3f5199ad4b6b4534bfa9c94c6da85f3e)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:52.764664 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6dfca8-8de4-4125-904c-acdf2c58cc82 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:52.771052 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 224/432] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 2 15:15:52 2022] GET /identity/v3/projects/3f5199ad4b6b4534bfa9c94c6da85f3e => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:52.773540 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6dfca8-8de4-4125-904c-acdf2c58cc82 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:52.777726 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b7cda-6b7c-49be-b1b7-deec636f8f3e None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:52.835412 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41540e5-0488-48cd-9824-0389577735ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:52.835999 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41540e5-0488-48cd-9824-0389577735ea None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:52.836244 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41540e5-0488-48cd-9824-0389577735ea None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:52.836481 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41540e5-0488-48cd-9824-0389577735ea None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:52.837198 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41540e5-0488-48cd-9824-0389577735ea None admin] RBAC: Adding query filter params (name=member) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:52.837502 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41540e5-0488-48cd-9824-0389577735ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:52.838883 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41540e5-0488-48cd-9824-0389577735ea None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:52.848357 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 209/433] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 2 15:15:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:52.850221 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf80c0-5898-41ed-99c7-9d7fa52a4bcc None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:52.850509 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf80c0-5898-41ed-99c7-9d7fa52a4bcc None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:52.850785 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf80c0-5898-41ed-99c7-9d7fa52a4bcc None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:52.852706 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 210/434] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:15:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:15:52.855306 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabf80c0-5898-41ed-99c7-9d7fa52a4bcc None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:52.898941 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6dfca8-8de4-4125-904c-acdf2c58cc82 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:52.941923 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3800a22-db0b-49c6-97fa-57621d695313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:52.942578 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3800a22-db0b-49c6-97fa-57621d695313 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:52.943554 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3800a22-db0b-49c6-97fa-57621d695313 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:52.943898 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3800a22-db0b-49c6-97fa-57621d695313 None admin] PATH_INFO: `/v3/groups/277bd059474947a5a783a7fc06ee88db` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:52.945117 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3800a22-db0b-49c6-97fa-57621d695313 None admin] RBAC: Authorizing `identity:get_group(group_id=277bd059474947a5a783a7fc06ee88db)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:52.946576 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3800a22-db0b-49c6-97fa-57621d695313 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:52.948660 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 225/435] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Aug 2 15:15:52 2022] GET /identity/v3/groups/277bd059474947a5a783a7fc06ee88db => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:52.952428 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e88268-0df9-4e22-8f39-ac4ddae793ed None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:52.952717 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e88268-0df9-4e22-8f39-ac4ddae793ed None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:52.952992 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e88268-0df9-4e22-8f39-ac4ddae793ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:52.971379 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-34e88268-0df9-4e22-8f39-ac4ddae793ed None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:15:52.972587 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-34e88268-0df9-4e22-8f39-ac4ddae793ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:15:52.975146 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:52.987984 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabf80c0-5898-41ed-99c7-9d7fa52a4bcc None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:53.034996 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335c8c50-b840-4dad-b2ae-b3ea06e755fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:53.035475 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:53.036242 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c8c50-b840-4dad-b2ae-b3ea06e755fa None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:53.036453 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c8c50-b840-4dad-b2ae-b3ea06e755fa None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:53.036723 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c8c50-b840-4dad-b2ae-b3ea06e755fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:53.075277 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 226/436] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:15:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:15:53.075734 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e88268-0df9-4e22-8f39-ac4ddae793ed None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:53.124514 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335c8c50-b840-4dad-b2ae-b3ea06e755fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:53.126002 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335c8c50-b840-4dad-b2ae-b3ea06e755fa None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:53.216361 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e88268-0df9-4e22-8f39-ac4ddae793ed None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:53.234408 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:53.246723 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 211/437] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 2 15:15:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 15:15:53.247612 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335c8c50-b840-4dad-b2ae-b3ea06e755fa None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:53.260765 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5b4cf8-83b7-4bde-816a-86e13c86dbf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:53.261383 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b4cf8-83b7-4bde-816a-86e13c86dbf7 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:53.261667 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b4cf8-83b7-4bde-816a-86e13c86dbf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:53.261932 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b4cf8-83b7-4bde-816a-86e13c86dbf7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:53.262721 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5b4cf8-83b7-4bde-816a-86e13c86dbf7 None admin] RBAC: Adding query filter params (group.id=277bd059474947a5a783a7fc06ee88db, role.id=3e1c8e0567ff4244aef0d6a62fc8b18d, scope.project.id=3f5199ad4b6b4534bfa9c94c6da85f3e) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:53.263030 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5b4cf8-83b7-4bde-816a-86e13c86dbf7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:53.264506 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5b4cf8-83b7-4bde-816a-86e13c86dbf7 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:53.283246 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 227/438] 10.222.0.42 () {56 vars in 1376 bytes} [Tue Aug 2 15:15:53 2022] GET /identity/v3/role_assignments?group.id=277bd059474947a5a783a7fc06ee88db&scope.project.id=3f5199ad4b6b4534bfa9c94c6da85f3e&role.id=3e1c8e0567ff4244aef0d6a62fc8b18d => generated 611 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:53.283246 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5b4cf8-83b7-4bde-816a-86e13c86dbf7 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:53.350287 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:53.368055 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335c8c50-b840-4dad-b2ae-b3ea06e755fa None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:53.406837 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ddceb-1811-4e35-aa78-586deb148e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:53.407536 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ddceb-1811-4e35-aa78-586deb148e31 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:53.407879 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ddceb-1811-4e35-aa78-586deb148e31 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:53.408220 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ddceb-1811-4e35-aa78-586deb148e31 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:53.416069 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5b4cf8-83b7-4bde-816a-86e13c86dbf7 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:53.421377 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71ddceb-1811-4e35-aa78-586deb148e31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:15:53.426584 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-f71ddceb-1811-4e35-aa78-586deb148e31 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 15:15:53.426584 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:15:53.426584 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:15:53.426584 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:15:53.426584 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:15:53.426584 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:15:53.426584 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:15:53.426584 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:15:53.426584 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:15:53.426584 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:15:53.426584 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:15:53.426584 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:15:53.426584 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:15:53.426584 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:15:53.426584 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:15:53.426584 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:15:53.427828 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:15:53.427828 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:15:53.427828 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:15:53.427828 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:15:53.427828 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:15:53.427828 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:15:53.427828 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:15:53.427828 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:15:53.427828 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:15:53.427828 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:15:53.427828 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:15:53.427828 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:15:53.427828 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:15:53.427828 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:15:53.427828 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:15:53.427828 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:15:53.428828 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:15:53.428828 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:15:53.428828 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:15:53.428828 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:15:53.428828 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:15:53.428828 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:15:53.428828 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:15:53.428828 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:15:53.428828 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:15:53.428828 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:15:53.428828 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 15:15:53.428828 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:15:53.430020 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 212/439] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Aug 2 15:15:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:15:53.435398 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ddceb-1811-4e35-aa78-586deb148e31 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:53.461218 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc4e4a-e77d-45b8-a94b-7146073a4ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:53.461871 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc4e4a-e77d-45b8-a94b-7146073a4ee6 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:53.462156 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc4e4a-e77d-45b8-a94b-7146073a4ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:53.462424 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc4e4a-e77d-45b8-a94b-7146073a4ee6 None admin] PATH_INFO: `/v3/projects/02cccaf1e1a44792916250e99dc79efa` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:53.463648 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dc4e4a-e77d-45b8-a94b-7146073a4ee6 None admin] RBAC: Authorizing `identity:get_project(project_id=02cccaf1e1a44792916250e99dc79efa)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:53.465106 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dc4e4a-e77d-45b8-a94b-7146073a4ee6 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:53.467086 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 228/440] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 2 15:15:53 2022] GET /identity/v3/projects/02cccaf1e1a44792916250e99dc79efa => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:53.472677 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc4e4a-e77d-45b8-a94b-7146073a4ee6 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:53.514058 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:53.589273 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ddceb-1811-4e35-aa78-586deb148e31 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:53.608359 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc4e4a-e77d-45b8-a94b-7146073a4ee6 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:53.622929 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:53.638166 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da9863b-1fc0-4b47-a16a-770e28be0204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:53.638790 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9863b-1fc0-4b47-a16a-770e28be0204 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:53.639070 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9863b-1fc0-4b47-a16a-770e28be0204 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:53.639382 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9863b-1fc0-4b47-a16a-770e28be0204 None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:53.640165 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da9863b-1fc0-4b47-a16a-770e28be0204 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:53.640398 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da9863b-1fc0-4b47-a16a-770e28be0204 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:53.641765 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da9863b-1fc0-4b47-a16a-770e28be0204 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:53.651447 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec968d-c6c5-412d-b5ca-fe71003d03e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:53.652151 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec968d-c6c5-412d-b5ca-fe71003d03e2 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:53.652415 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec968d-c6c5-412d-b5ca-fe71003d03e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:53.652700 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec968d-c6c5-412d-b5ca-fe71003d03e2 None admin] PATH_INFO: `/v3/groups/277bd059474947a5a783a7fc06ee88db` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:53.654139 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ec968d-c6c5-412d-b5ca-fe71003d03e2 None admin] RBAC: Authorizing `identity:get_group(group_id=277bd059474947a5a783a7fc06ee88db)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:53.654268 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 213/441] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 2 15:15:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:53.655492 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ec968d-c6c5-412d-b5ca-fe71003d03e2 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:53.655841 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd01b3e-6ca5-40b9-8f31-3610ba41b42c None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:53.656187 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd01b3e-6ca5-40b9-8f31-3610ba41b42c None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:53.656470 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd01b3e-6ca5-40b9-8f31-3610ba41b42c None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:53.657966 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 214/442] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:15:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:15:53.662160 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 229/443] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Aug 2 15:15:53 2022] GET /identity/v3/groups/277bd059474947a5a783a7fc06ee88db => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:53.663069 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd01b3e-6ca5-40b9-8f31-3610ba41b42c None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:53.665206 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e77fb-b9f6-4a0c-b1fc-965a7e51970d None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:53.665499 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e77fb-b9f6-4a0c-b1fc-965a7e51970d None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:53.665778 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e77fb-b9f6-4a0c-b1fc-965a7e51970d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:53.685441 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-306e77fb-b9f6-4a0c-b1fc-965a7e51970d None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:15:53.686649 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-306e77fb-b9f6-4a0c-b1fc-965a7e51970d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:15:53.762893 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 230/444] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:15:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:15:53.763942 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306e77fb-b9f6-4a0c-b1fc-965a7e51970d None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:53.774659 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd01b3e-6ca5-40b9-8f31-3610ba41b42c None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:53.790955 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:53.813668 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08a0c6-aca1-4624-b4d8-7b7a4b644256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:53.814300 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08a0c6-aca1-4624-b4d8-7b7a4b644256 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:53.814585 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08a0c6-aca1-4624-b4d8-7b7a4b644256 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:53.814867 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08a0c6-aca1-4624-b4d8-7b7a4b644256 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:53.877517 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306e77fb-b9f6-4a0c-b1fc-965a7e51970d None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:53.885178 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d08a0c6-aca1-4624-b4d8-7b7a4b644256 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:53.887012 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d08a0c6-aca1-4624-b4d8-7b7a4b644256 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:53.888276 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:53.913230 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a03099-8679-49d3-a9c1-b591c450e7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:53.914019 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a03099-8679-49d3-a9c1-b591c450e7d1 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:53.914306 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a03099-8679-49d3-a9c1-b591c450e7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:53.914585 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a03099-8679-49d3-a9c1-b591c450e7d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:53.915411 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a03099-8679-49d3-a9c1-b591c450e7d1 None admin] RBAC: Adding query filter params (group.id=277bd059474947a5a783a7fc06ee88db, role.id=bf4fcdd92d8a4a6d855f3eaa4f542529, scope.project.id=02cccaf1e1a44792916250e99dc79efa) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:53.915713 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a03099-8679-49d3-a9c1-b591c450e7d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:53.917161 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a03099-8679-49d3-a9c1-b591c450e7d1 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:53.922918 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 231/445] 10.222.0.42 () {56 vars in 1376 bytes} [Tue Aug 2 15:15:53 2022] GET /identity/v3/role_assignments?group.id=277bd059474947a5a783a7fc06ee88db&scope.project.id=02cccaf1e1a44792916250e99dc79efa&role.id=bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 611 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:53.923737 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a03099-8679-49d3-a9c1-b591c450e7d1 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:54.001138 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 215/446] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 2 15:15:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 15:15:54.007007 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08a0c6-aca1-4624-b4d8-7b7a4b644256 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:54.023751 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:54.057998 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a03099-8679-49d3-a9c1-b591c450e7d1 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:54.100672 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca729c-73ec-4896-a3db-66019e8695c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:54.101844 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca729c-73ec-4896-a3db-66019e8695c7 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:54.101844 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca729c-73ec-4896-a3db-66019e8695c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:54.101844 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca729c-73ec-4896-a3db-66019e8695c7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:54.115851 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfca729c-73ec-4896-a3db-66019e8695c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:15:54.122022 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-bfca729c-73ec-4896-a3db-66019e8695c7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 15:15:54.122022 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:15:54.122022 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:15:54.122022 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:15:54.122022 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:15:54.122022 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:15:54.122022 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:15:54.122022 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:15:54.122022 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:15:54.122022 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:15:54.122022 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:15:54.122022 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:15:54.122022 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:15:54.122022 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:15:54.122022 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:15:54.122022 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:15:54.123148 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:15:54.123148 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:15:54.123148 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:15:54.123148 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:15:54.123148 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:15:54.123148 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:15:54.123148 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:15:54.123148 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:15:54.123148 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:15:54.123148 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:15:54.123148 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:15:54.123148 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:15:54.123148 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:15:54.123148 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:15:54.123148 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:15:54.123148 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:15:54.124001 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:15:54.124001 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:15:54.124001 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:15:54.124001 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:15:54.124001 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:15:54.124001 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:15:54.124001 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:15:54.124001 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:15:54.124001 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:15:54.124001 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:15:54.124001 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 15:15:54.124001 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:15:54.124001 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 232/447] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 2 15:15:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:15:54.129585 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca729c-73ec-4896-a3db-66019e8695c7 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:54.139049 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08a0c6-aca1-4624-b4d8-7b7a4b644256 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:54.181388 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:54.181559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474b58a-bb18-47c4-84f2-6cbfffe49aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:54.182015 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474b58a-bb18-47c4-84f2-6cbfffe49aa1 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:54.182294 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474b58a-bb18-47c4-84f2-6cbfffe49aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:54.182568 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474b58a-bb18-47c4-84f2-6cbfffe49aa1 None admin] PATH_INFO: `/v3/projects/02cccaf1e1a44792916250e99dc79efa` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:54.183778 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e474b58a-bb18-47c4-84f2-6cbfffe49aa1 None admin] RBAC: Authorizing `identity:get_project(project_id=02cccaf1e1a44792916250e99dc79efa)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:54.185213 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e474b58a-bb18-47c4-84f2-6cbfffe49aa1 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:54.187123 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 216/448] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 2 15:15:54 2022] GET /identity/v3/projects/02cccaf1e1a44792916250e99dc79efa => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:54.192615 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474b58a-bb18-47c4-84f2-6cbfffe49aa1 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:54.265375 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca729c-73ec-4896-a3db-66019e8695c7 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:54.292009 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:54.304647 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54233cdf-0a8d-4a73-a50e-586c82dbc01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:54.305328 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54233cdf-0a8d-4a73-a50e-586c82dbc01d None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:54.305613 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54233cdf-0a8d-4a73-a50e-586c82dbc01d None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:54.305881 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54233cdf-0a8d-4a73-a50e-586c82dbc01d None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:54.306591 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54233cdf-0a8d-4a73-a50e-586c82dbc01d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:54.306891 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54233cdf-0a8d-4a73-a50e-586c82dbc01d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:54.308327 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54233cdf-0a8d-4a73-a50e-586c82dbc01d None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:54.311940 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474b58a-bb18-47c4-84f2-6cbfffe49aa1 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:54.316801 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 233/449] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 2 15:15:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:15:54.322841 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54233cdf-0a8d-4a73-a50e-586c82dbc01d None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:54.349051 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da6f24-6fe1-401d-824a-3e4e29cc4abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:54.349695 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da6f24-6fe1-401d-824a-3e4e29cc4abe None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:54.349982 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da6f24-6fe1-401d-824a-3e4e29cc4abe None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:54.350262 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da6f24-6fe1-401d-824a-3e4e29cc4abe None admin] PATH_INFO: `/v3/groups/277bd059474947a5a783a7fc06ee88db` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:54.351460 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5da6f24-6fe1-401d-824a-3e4e29cc4abe None admin] RBAC: Authorizing `identity:get_group(group_id=277bd059474947a5a783a7fc06ee88db)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:54.352900 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5da6f24-6fe1-401d-824a-3e4e29cc4abe None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:54.354682 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 217/450] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Aug 2 15:15:54 2022] GET /identity/v3/groups/277bd059474947a5a783a7fc06ee88db => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:15:54.360295 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da6f24-6fe1-401d-824a-3e4e29cc4abe None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:54.418476 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:54.424607 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54233cdf-0a8d-4a73-a50e-586c82dbc01d None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:54.460383 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47031ef7-7244-4d93-92d9-58dc0fdf24c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:54.460995 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47031ef7-7244-4d93-92d9-58dc0fdf24c6 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:54.461279 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47031ef7-7244-4d93-92d9-58dc0fdf24c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:54.461555 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47031ef7-7244-4d93-92d9-58dc0fdf24c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:54.462360 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da6f24-6fe1-401d-824a-3e4e29cc4abe None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:54.495814 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f51770-9dc2-4a3e-b49a-93f33db451c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:54.496426 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f51770-9dc2-4a3e-b49a-93f33db451c2 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:54.496708 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f51770-9dc2-4a3e-b49a-93f33db451c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:54.496988 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f51770-9dc2-4a3e-b49a-93f33db451c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:54.497793 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f51770-9dc2-4a3e-b49a-93f33db451c2 None admin] RBAC: Adding query filter params (group.id=277bd059474947a5a783a7fc06ee88db, role.id=3e1c8e0567ff4244aef0d6a62fc8b18d, scope.project.id=02cccaf1e1a44792916250e99dc79efa) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:54.498083 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f51770-9dc2-4a3e-b49a-93f33db451c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:54.499545 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f51770-9dc2-4a3e-b49a-93f33db451c2 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:54.505822 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 218/451] 10.222.0.42 () {56 vars in 1376 bytes} [Tue Aug 2 15:15:54 2022] GET /identity/v3/role_assignments?group.id=277bd059474947a5a783a7fc06ee88db&scope.project.id=02cccaf1e1a44792916250e99dc79efa&role.id=3e1c8e0567ff4244aef0d6a62fc8b18d => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:15:54.532094 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47031ef7-7244-4d93-92d9-58dc0fdf24c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:54.533580 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47031ef7-7244-4d93-92d9-58dc0fdf24c6 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:54.640580 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:54.648072 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 234/452] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 2 15:15:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 02 15:15:54.654062 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f51770-9dc2-4a3e-b49a-93f33db451c2 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:54.673309 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:54.766378 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f51770-9dc2-4a3e-b49a-93f33db451c2 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:54.802652 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e1813-41b0-47d0-a1eb-9c304536f2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:54.803333 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e1813-41b0-47d0-a1eb-9c304536f2a6 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:54.803622 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e1813-41b0-47d0-a1eb-9c304536f2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:54.803899 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e1813-41b0-47d0-a1eb-9c304536f2a6 None admin] PATH_INFO: `/v3/projects/e01cd4e1a6a040d99206efa57fc6e2e1` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:54.805071 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59e1813-41b0-47d0-a1eb-9c304536f2a6 None admin] RBAC: Authorizing `identity:get_project(project_id=e01cd4e1a6a040d99206efa57fc6e2e1)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:54.806531 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59e1813-41b0-47d0-a1eb-9c304536f2a6 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:54.808236 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 219/453] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 2 15:15:54 2022] GET /identity/v3/projects/e01cd4e1a6a040d99206efa57fc6e2e1 => generated 344 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:54.813980 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47031ef7-7244-4d93-92d9-58dc0fdf24c6 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:54.914278 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47031ef7-7244-4d93-92d9-58dc0fdf24c6 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:54.947571 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d68b5-1f8f-4723-acb1-fcca70c31d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:54.948188 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d68b5-1f8f-4723-acb1-fcca70c31d4f None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:54.948464 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d68b5-1f8f-4723-acb1-fcca70c31d4f None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:54.948732 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d68b5-1f8f-4723-acb1-fcca70c31d4f None admin] PATH_INFO: `/v3/groups/f9e764c109714519b71fb4cccac770c5` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:54.949892 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3d68b5-1f8f-4723-acb1-fcca70c31d4f None admin] RBAC: Authorizing `identity:get_group(group_id=f9e764c109714519b71fb4cccac770c5)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:54.951360 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3d68b5-1f8f-4723-acb1-fcca70c31d4f None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:54.952959 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 235/454] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Aug 2 15:15:54 2022] GET /identity/v3/groups/f9e764c109714519b71fb4cccac770c5 => generated 229 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:54.961949 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e1813-41b0-47d0-a1eb-9c304536f2a6 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:55.055784 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:55.074062 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e1813-41b0-47d0-a1eb-9c304536f2a6 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:55.106227 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad2268-2853-41ae-8d79-a3b9e689db45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:55.106833 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad2268-2853-41ae-8d79-a3b9e689db45 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:55.107115 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad2268-2853-41ae-8d79-a3b9e689db45 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:55.107420 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad2268-2853-41ae-8d79-a3b9e689db45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:55.108193 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ad2268-2853-41ae-8d79-a3b9e689db45 None admin] RBAC: Adding query filter params (group.id=f9e764c109714519b71fb4cccac770c5, role.id=d75c9572cb294caeb8eb456521ff6f57, scope.project.id=e01cd4e1a6a040d99206efa57fc6e2e1) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:55.108500 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ad2268-2853-41ae-8d79-a3b9e689db45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:55.109937 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ad2268-2853-41ae-8d79-a3b9e689db45 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:55.116420 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 220/455] 10.222.0.42 () {56 vars in 1376 bytes} [Tue Aug 2 15:15:54 2022] GET /identity/v3/role_assignments?group.id=f9e764c109714519b71fb4cccac770c5&scope.project.id=e01cd4e1a6a040d99206efa57fc6e2e1&role.id=d75c9572cb294caeb8eb456521ff6f57 => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:57.598420 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd62bb1-c763-43b2-8fcf-c864ee52007f None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:57.598982 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd62bb1-c763-43b2-8fcf-c864ee52007f None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:57.599057 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd62bb1-c763-43b2-8fcf-c864ee52007f None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:57.600720 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 236/456] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:15:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:15:57.605689 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad059e1-1704-4dcb-999a-d1bb5efb80ff None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:57.606132 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad059e1-1704-4dcb-999a-d1bb5efb80ff None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:57.606308 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad059e1-1704-4dcb-999a-d1bb5efb80ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:57.632241 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-8ad059e1-1704-4dcb-999a-d1bb5efb80ff None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:15:57.633472 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-8ad059e1-1704-4dcb-999a-d1bb5efb80ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:15:57.735888 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 221/457] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:15:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 15:15:57.775879 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd62bb1-c763-43b2-8fcf-c864ee52007f None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:57.853805 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:57.906945 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd62bb1-c763-43b2-8fcf-c864ee52007f None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:57.953323 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe306b-de4d-426e-84fb-0845a21a96fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:57.953974 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe306b-de4d-426e-84fb-0845a21a96fa None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:57.954259 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe306b-de4d-426e-84fb-0845a21a96fa None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:57.954538 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe306b-de4d-426e-84fb-0845a21a96fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:57.967560 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7abb86-80b1-4acd-ae3e-75568636b806 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:57.967846 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7abb86-80b1-4acd-ae3e-75568636b806 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:57.968175 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7abb86-80b1-4acd-ae3e-75568636b806 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:57.969668 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 222/458] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:15:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 15:15:57.973001 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe306b-de4d-426e-84fb-0845a21a96fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:57.976082 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a1a61-fade-4b18-90ad-a4b03290f767 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:57.976372 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a1a61-fade-4b18-90ad-a4b03290f767 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:57.976731 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a1a61-fade-4b18-90ad-a4b03290f767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:57.982237 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe306b-de4d-426e-84fb-0845a21a96fa None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:58.003771 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-5a6a1a61-fade-4b18-90ad-a4b03290f767 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:15:58.004989 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-5a6a1a61-fade-4b18-90ad-a4b03290f767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:15:58.013711 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-d4fe306b-de4d-426e-84fb-0845a21a96fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:15:58.013711 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:15:58.013711 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:15:58.013711 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:15:58.013711 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:15:58.013711 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:15:58.013711 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:15:58.013711 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:15:58.013711 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:15:58.013711 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:15:58.013711 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:15:58.013711 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:15:58.013711 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:15:58.013711 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:15:58.013711 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:15:58.014602 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:15:58.014602 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:15:58.014602 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:15:58.014602 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:15:58.014602 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:15:58.014602 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:15:58.014602 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:15:58.014602 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:15:58.014602 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:15:58.014602 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:15:58.014602 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:15:58.014602 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:15:58.014602 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:15:58.014602 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:15:58.014602 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:15:58.014602 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:15:58.014602 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:15:58.015633 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:15:58.015633 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:15:58.015633 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:15:58.015633 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:15:58.021447 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 237/459] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:15:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:15:58.024578 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe306b-de4d-426e-84fb-0845a21a96fa None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:58.116478 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 223/460] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:15:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:15:58.118326 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f19485-f8c3-4a3e-b23f-00b9c7afb15e None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:58.118837 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f19485-f8c3-4a3e-b23f-00b9c7afb15e None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:58.119344 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f19485-f8c3-4a3e-b23f-00b9c7afb15e None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:58.122622 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 224/461] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:15:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:15:58.126861 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9392b48-a68f-45c5-b89a-ec84308c69ec None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:58.127570 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9392b48-a68f-45c5-b89a-ec84308c69ec None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:58.128097 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9392b48-a68f-45c5-b89a-ec84308c69ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:58.141980 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:58.150809 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-a9392b48-a68f-45c5-b89a-ec84308c69ec None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:15:58.152069 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-a9392b48-a68f-45c5-b89a-ec84308c69ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:15:58.197724 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe306b-de4d-426e-84fb-0845a21a96fa None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:58.216535 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:58.238042 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0db96b-317f-4ae3-93cc-23ba9967b63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:58.238964 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0db96b-317f-4ae3-93cc-23ba9967b63f None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:58.239453 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0db96b-317f-4ae3-93cc-23ba9967b63f None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:58.239896 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0db96b-317f-4ae3-93cc-23ba9967b63f None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:58.240759 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0db96b-317f-4ae3-93cc-23ba9967b63f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:58.241256 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0db96b-317f-4ae3-93cc-23ba9967b63f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:58.242849 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0db96b-317f-4ae3-93cc-23ba9967b63f None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:58.243288 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 225/462] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:15:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 15:15:58.244272 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9392b48-a68f-45c5-b89a-ec84308c69ec None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:58.257083 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 238/463] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:15:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:58.262610 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0db96b-317f-4ae3-93cc-23ba9967b63f None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:58.355699 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9392b48-a68f-45c5-b89a-ec84308c69ec None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:58.381577 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0db96b-317f-4ae3-93cc-23ba9967b63f None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:58.392456 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af50a109-2246-4af8-b65d-64544a2a1cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:58.393107 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af50a109-2246-4af8-b65d-64544a2a1cdd None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:58.393398 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af50a109-2246-4af8-b65d-64544a2a1cdd None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:58.393667 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af50a109-2246-4af8-b65d-64544a2a1cdd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:58.397224 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:58.406855 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af50a109-2246-4af8-b65d-64544a2a1cdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:58.408491 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af50a109-2246-4af8-b65d-64544a2a1cdd None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:58.422206 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f3dbc9-82cb-4e7a-921a-0030f8f82dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:58.423151 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3dbc9-82cb-4e7a-921a-0030f8f82dc0 None admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:58.423593 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3dbc9-82cb-4e7a-921a-0030f8f82dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:58.424056 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3dbc9-82cb-4e7a-921a-0030f8f82dc0 None admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:58.424177 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-af50a109-2246-4af8-b65d-64544a2a1cdd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:15:58.424177 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:15:58.424177 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:15:58.424177 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:15:58.424177 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:15:58.424177 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:15:58.424177 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:15:58.424177 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:15:58.424177 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:15:58.424177 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:15:58.424177 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:15:58.424177 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:15:58.424177 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:15:58.424177 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:15:58.424177 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:15:58.425159 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:15:58.425159 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:15:58.425159 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:15:58.425159 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:15:58.425159 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:15:58.425159 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:15:58.425159 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:15:58.425159 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:15:58.425159 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:15:58.425159 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:15:58.425159 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:15:58.425159 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:15:58.425159 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:15:58.425159 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:15:58.425159 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:15:58.425159 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:15:58.425159 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:15:58.426017 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:15:58.426017 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:15:58.426017 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:15:58.426017 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:15:58.426017 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 226/464] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:15:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:15:58.426399 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af50a109-2246-4af8-b65d-64544a2a1cdd None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:58.427305 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f3dbc9-82cb-4e7a-921a-0030f8f82dc0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:58.428767 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f3dbc9-82cb-4e7a-921a-0030f8f82dc0 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:58.460765 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 239/465] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Aug 2 15:15:58 2022] POST /identity/v3/users => generated 246 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 15:15:58.472777 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365b5cfa-5ec7-4e70-8ba6-c0e23b8f8eed None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:58.473064 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365b5cfa-5ec7-4e70-8ba6-c0e23b8f8eed None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:58.473339 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365b5cfa-5ec7-4e70-8ba6-c0e23b8f8eed None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:58.474713 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 240/466] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:15:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:15:58.475433 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365b5cfa-5ec7-4e70-8ba6-c0e23b8f8eed None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:58.522720 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:58.568917 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af50a109-2246-4af8-b65d-64544a2a1cdd None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:58.619721 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365b5cfa-5ec7-4e70-8ba6-c0e23b8f8eed None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:58.620287 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ec961d-1d20-4008-844e-a60f109b7e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:58.620789 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ec961d-1d20-4008-844e-a60f109b7e6a None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:58.621002 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ec961d-1d20-4008-844e-a60f109b7e6a None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:58.621286 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ec961d-1d20-4008-844e-a60f109b7e6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:58.637317 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ec961d-1d20-4008-844e-a60f109b7e6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:58.637984 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ec961d-1d20-4008-844e-a60f109b7e6a None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:58.657799 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-f6ec961d-1d20-4008-844e-a60f109b7e6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:15:58.657799 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:15:58.657799 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:15:58.657799 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:15:58.657799 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:15:58.657799 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:15:58.657799 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:15:58.657799 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:15:58.657799 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:15:58.657799 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:15:58.657799 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:15:58.657799 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:15:58.657799 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:15:58.657799 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:15:58.657799 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:15:58.658696 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:15:58.658696 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:15:58.658696 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:15:58.658696 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:15:58.658696 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:15:58.658696 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:15:58.658696 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:15:58.658696 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:15:58.658696 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:15:58.658696 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:15:58.658696 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:15:58.658696 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:15:58.658696 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:15:58.658696 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:15:58.658696 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:15:58.658696 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:15:58.658696 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:15:58.660017 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:15:58.660017 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:15:58.660017 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:15:58.660017 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:15:58.660017 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 227/467] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:15:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:15:58.661112 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17bfbb3-3eae-4a96-8d29-4196731bdffd None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:58.661436 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17bfbb3-3eae-4a96-8d29-4196731bdffd None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:58.661719 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17bfbb3-3eae-4a96-8d29-4196731bdffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:58.671350 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50ac0ad-5be9-4566-a3fe-6fde478830ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:58.672302 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ac0ad-5be9-4566-a3fe-6fde478830ce None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:58.672805 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ac0ad-5be9-4566-a3fe-6fde478830ce None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:58.673275 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ac0ad-5be9-4566-a3fe-6fde478830ce None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:58.674163 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50ac0ad-5be9-4566-a3fe-6fde478830ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:58.674665 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50ac0ad-5be9-4566-a3fe-6fde478830ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:58.676386 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50ac0ad-5be9-4566-a3fe-6fde478830ce None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:58.683163 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-b17bfbb3-3eae-4a96-8d29-4196731bdffd None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:15:58.684398 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-b17bfbb3-3eae-4a96-8d29-4196731bdffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:15:58.691384 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 241/468] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:15:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:58.692773 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50ac0ad-5be9-4566-a3fe-6fde478830ce None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:58.729984 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:58.775370 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 228/469] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:15:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:15:58.776492 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17bfbb3-3eae-4a96-8d29-4196731bdffd None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:58.835115 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:58.844854 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50ac0ad-5be9-4566-a3fe-6fde478830ce None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:58.882219 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10dcb6f-0a7b-4a11-a516-d62649d3c048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:58.883047 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10dcb6f-0a7b-4a11-a516-d62649d3c048 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:58.883472 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10dcb6f-0a7b-4a11-a516-d62649d3c048 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:58.883880 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10dcb6f-0a7b-4a11-a516-d62649d3c048 None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:58.884613 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10dcb6f-0a7b-4a11-a516-d62649d3c048 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:58.884987 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10dcb6f-0a7b-4a11-a516-d62649d3c048 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:58.886466 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10dcb6f-0a7b-4a11-a516-d62649d3c048 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:58.900161 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 242/470] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:15:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:15:58.900838 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10dcb6f-0a7b-4a11-a516-d62649d3c048 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:58.910081 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17bfbb3-3eae-4a96-8d29-4196731bdffd None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:58.947914 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916a10c-1078-4d88-b033-5b1721e6079e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:58.948543 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916a10c-1078-4d88-b033-5b1721e6079e None admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:58.948873 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916a10c-1078-4d88-b033-5b1721e6079e None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:58.949150 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916a10c-1078-4d88-b033-5b1721e6079e None admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:58.949835 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a916a10c-1078-4d88-b033-5b1721e6079e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:58.951453 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a916a10c-1078-4d88-b033-5b1721e6079e None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:58.983608 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 229/471] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Aug 2 15:15:58 2022] POST /identity/v3/users => generated 248 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:15:58.984707 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916a10c-1078-4d88-b033-5b1721e6079e None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:59.027114 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:59.040870 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10dcb6f-0a7b-4a11-a516-d62649d3c048 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:59.083567 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3889b7-c779-4135-b7b3-f92c3f07ed5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:59.084645 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3889b7-c779-4135-b7b3-f92c3f07ed5e None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:59.085170 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3889b7-c779-4135-b7b3-f92c3f07ed5e None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:59.085656 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3889b7-c779-4135-b7b3-f92c3f07ed5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:59.099654 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3889b7-c779-4135-b7b3-f92c3f07ed5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:59.101647 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3889b7-c779-4135-b7b3-f92c3f07ed5e None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:59.119148 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-6d3889b7-c779-4135-b7b3-f92c3f07ed5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:15:59.119148 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:15:59.119148 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:15:59.119148 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:15:59.119148 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:15:59.119148 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:15:59.119148 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:15:59.119148 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:15:59.119148 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:15:59.119148 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:15:59.119148 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:15:59.119148 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:15:59.119148 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:15:59.119148 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:15:59.119148 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:15:59.120081 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:15:59.120081 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:15:59.120081 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:15:59.120081 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:15:59.120081 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:15:59.120081 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:15:59.120081 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:15:59.120081 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:15:59.120081 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:15:59.120081 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:15:59.120081 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:15:59.120081 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:15:59.120081 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:15:59.120081 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:15:59.120081 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:15:59.120081 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:15:59.120081 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:15:59.120940 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:15:59.120940 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:15:59.120940 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:15:59.120940 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:15:59.122960 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 243/472] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:15:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:15:59.124625 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66102e1f-a7b1-43bb-8fd8-54b91b32a981 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:59.125152 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66102e1f-a7b1-43bb-8fd8-54b91b32a981 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:59.125679 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66102e1f-a7b1-43bb-8fd8-54b91b32a981 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:59.126190 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916a10c-1078-4d88-b033-5b1721e6079e None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:59.127944 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 244/473] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:15:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:15:59.133326 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66102e1f-a7b1-43bb-8fd8-54b91b32a981 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:59.137223 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:59.170843 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03172a29-c250-41ef-ac22-c3761f9abea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:59.171517 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03172a29-c250-41ef-ac22-c3761f9abea6 None admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:59.171797 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03172a29-c250-41ef-ac22-c3761f9abea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:59.172080 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03172a29-c250-41ef-ac22-c3761f9abea6 None admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:59.172770 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03172a29-c250-41ef-ac22-c3761f9abea6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:59.174259 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03172a29-c250-41ef-ac22-c3761f9abea6 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:59.196435 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 230/474] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Aug 2 15:15:58 2022] POST /identity/v3/users => generated 248 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:15:59.197744 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c78db8-70a3-45f7-84fb-13509f33a5e4 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:59.198072 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c78db8-70a3-45f7-84fb-13509f33a5e4 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:59.198395 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c78db8-70a3-45f7-84fb-13509f33a5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:59.221627 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-78c78db8-70a3-45f7-84fb-13509f33a5e4 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:15:59.222964 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-78c78db8-70a3-45f7-84fb-13509f33a5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:15:59.296375 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66102e1f-a7b1-43bb-8fd8-54b91b32a981 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:59.311795 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 231/475] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:15:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:15:59.336591 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c78db8-70a3-45f7-84fb-13509f33a5e4 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:59.348171 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f727d3e-c5e6-4dc2-9232-2919514809a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:59.349429 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f727d3e-c5e6-4dc2-9232-2919514809a4 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:59.349934 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f727d3e-c5e6-4dc2-9232-2919514809a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:59.350402 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f727d3e-c5e6-4dc2-9232-2919514809a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:59.351566 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f727d3e-c5e6-4dc2-9232-2919514809a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:59.352158 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f727d3e-c5e6-4dc2-9232-2919514809a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:59.353929 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f727d3e-c5e6-4dc2-9232-2919514809a4 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:59.355892 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:59.373436 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 245/476] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:15:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:15:59.378926 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f727d3e-c5e6-4dc2-9232-2919514809a4 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:59.450518 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:59.473659 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c78db8-70a3-45f7-84fb-13509f33a5e4 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:59.496411 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f727d3e-c5e6-4dc2-9232-2919514809a4 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:59.520485 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828ba2c4-12ff-49f0-8e68-0ff9c51cd552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:59.521646 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ba2c4-12ff-49f0-8e68-0ff9c51cd552 None admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:59.521934 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ba2c4-12ff-49f0-8e68-0ff9c51cd552 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:59.522214 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ba2c4-12ff-49f0-8e68-0ff9c51cd552 None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:59.523104 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828ba2c4-12ff-49f0-8e68-0ff9c51cd552 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:59.525560 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828ba2c4-12ff-49f0-8e68-0ff9c51cd552 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:59.535275 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.sql.core [None req-828ba2c4-12ff-49f0-8e68-0ff9c51cd552 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 02 15:15:59.535275 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 02 15:15:59.535275 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [parameters: {'id': '99672a30f50642758a52782881ee9a75', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 02 15:15:59.535275 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80360) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 02 15:15:59.537226 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67efcef6-b944-45ee-9fcc-672c60a4fe80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:59.538157 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67efcef6-b944-45ee-9fcc-672c60a4fe80 None admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:59.538896 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67efcef6-b944-45ee-9fcc-672c60a4fe80 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:59.539388 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67efcef6-b944-45ee-9fcc-672c60a4fe80 None admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:59.540260 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67efcef6-b944-45ee-9fcc-672c60a4fe80 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:59.541891 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67efcef6-b944-45ee-9fcc-672c60a4fe80 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:59.554202 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-828ba2c4-12ff-49f0-8e68-0ff9c51cd552 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 02 15:15:59.554202 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:15:59.554202 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 02 15:15:59.554202 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 02 15:15:59.554202 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 02 15:15:59.554202 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 02 15:15:59.554202 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 02 15:15:59.554202 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application result = self._query(query) Aug 02 15:15:59.554202 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 02 15:15:59.554202 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application conn.query(q) Aug 02 15:15:59.554202 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 02 15:15:59.554202 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 02 15:15:59.554202 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 02 15:15:59.554202 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application result.read() Aug 02 15:15:59.554202 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 02 15:15:59.555396 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 02 15:15:59.555396 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 02 15:15:59.555396 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 02 15:15:59.555396 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 02 15:15:59.555396 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 02 15:15:59.555396 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 02 15:15:59.555396 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 02 15:15:59.555396 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 02 15:15:59.555396 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:15:59.555396 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 02 15:15:59.555396 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:15:59.555396 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:15:59.555396 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 02 15:15:59.555396 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 02 15:15:59.555396 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 02 15:15:59.555396 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return ref.to_dict() Aug 02 15:15:59.555396 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 02 15:15:59.555396 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application next(self.gen) Aug 02 15:15:59.556479 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 02 15:15:59.556479 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application yield resource Aug 02 15:15:59.556479 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 02 15:15:59.556479 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application next(self.gen) Aug 02 15:15:59.556479 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 02 15:15:59.556479 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self.session.rollback() Aug 02 15:15:59.556479 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 15:15:59.556479 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self.force_reraise() Aug 02 15:15:59.556479 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 15:15:59.556479 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise self.value Aug 02 15:15:59.556479 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 02 15:15:59.556479 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 02 15:15:59.556479 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 02 15:15:59.556479 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application session.commit() Aug 02 15:15:59.556479 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 02 15:15:59.556479 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 02 15:15:59.556479 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 02 15:15:59.557564 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self._prepare_impl() Aug 02 15:15:59.557564 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 02 15:15:59.557564 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self.session.flush() Aug 02 15:15:59.557564 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 02 15:15:59.557564 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self._flush(objects) Aug 02 15:15:59.557564 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 02 15:15:59.557564 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 02 15:15:59.557564 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 02 15:15:59.557564 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application compat.raise_( Aug 02 15:15:59.557564 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 02 15:15:59.557564 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception Aug 02 15:15:59.557564 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 02 15:15:59.557564 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application flush_context.execute() Aug 02 15:15:59.557564 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 02 15:15:59.557564 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rec.execute(self) Aug 02 15:15:59.557564 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 02 15:15:59.557564 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 02 15:15:59.558635 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 02 15:15:59.558635 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 02 15:15:59.558635 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 02 15:15:59.558635 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 02 15:15:59.558635 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 02 15:15:59.558635 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 02 15:15:59.558635 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 02 15:15:59.558635 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 02 15:15:59.558635 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 02 15:15:59.558635 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 02 15:15:59.558635 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 02 15:15:59.558635 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 02 15:15:59.558635 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 02 15:15:59.558635 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 02 15:15:59.558635 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 02 15:15:59.558635 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception Aug 02 15:15:59.559650 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 02 15:15:59.559650 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 02 15:15:59.559650 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 02 15:15:59.559650 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 02 15:15:59.559650 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 02 15:15:59.559650 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application result = self._query(query) Aug 02 15:15:59.559650 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 02 15:15:59.559650 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application conn.query(q) Aug 02 15:15:59.559650 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 02 15:15:59.559650 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 02 15:15:59.559650 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 02 15:15:59.559650 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application result.read() Aug 02 15:15:59.559650 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 02 15:15:59.559650 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 02 15:15:59.559650 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 02 15:15:59.559650 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 02 15:15:59.560608 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 02 15:15:59.560608 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 02 15:15:59.560608 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 02 15:15:59.560608 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 02 15:15:59.560608 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 02 15:15:59.560608 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 02 15:15:59.560608 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [parameters: {'id': '99672a30f50642758a52782881ee9a75', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 02 15:15:59.560608 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 02 15:15:59.560608 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:15:59.560608 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 15:15:59.560608 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:15:59.560608 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:15:59.560608 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:15:59.560608 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:15:59.560608 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:15:59.560608 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:15:59.561601 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:15:59.561601 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:15:59.561601 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:15:59.561601 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:15:59.561601 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:15:59.561601 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:15:59.561601 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 02 15:15:59.561601 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 02 15:15:59.561601 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:15:59.561601 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:15:59.561601 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 02 15:15:59.561601 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 02 15:15:59.561601 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 02 15:15:59.561601 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 02 15:15:59.561601 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 02 15:15:59.561601 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:15:59.564434 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 232/477] 10.222.0.42 () {60 vars in 1131 bytes} [Tue Aug 2 15:15:59 2022] POST /identity/v3/roles => generated 144 bytes in 228 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 02 15:15:59.570693 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828ba2c4-12ff-49f0-8e68-0ff9c51cd552 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:59.583034 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 246/478] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Aug 2 15:15:59 2022] POST /identity/v3/users => generated 249 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 15:15:59.675257 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:59.707018 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828ba2c4-12ff-49f0-8e68-0ff9c51cd552 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:59.748359 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22631412-c463-4217-b950-d0851f85c21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:59.749028 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22631412-c463-4217-b950-d0851f85c21e None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:59.749327 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22631412-c463-4217-b950-d0851f85c21e None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:59.749587 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22631412-c463-4217-b950-d0851f85c21e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:59.764830 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22631412-c463-4217-b950-d0851f85c21e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:15:59.769794 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-22631412-c463-4217-b950-d0851f85c21e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 15:15:59.769794 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:15:59.769794 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:15:59.769794 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:15:59.769794 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:15:59.769794 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:15:59.769794 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:15:59.769794 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:15:59.769794 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:15:59.769794 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:15:59.769794 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:15:59.769794 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:15:59.769794 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:15:59.769794 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:15:59.769794 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:15:59.769794 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:15:59.771309 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:15:59.771309 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:15:59.771309 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:15:59.771309 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:15:59.771309 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:15:59.771309 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:15:59.771309 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:15:59.771309 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:15:59.771309 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:15:59.771309 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:15:59.771309 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:15:59.771309 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:15:59.771309 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:15:59.771309 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:15:59.771309 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:15:59.771309 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:15:59.772154 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:15:59.772154 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:15:59.772154 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:15:59.772154 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:15:59.772154 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:15:59.772154 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:15:59.772154 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:15:59.772154 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:15:59.772154 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:15:59.772154 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:15:59.772154 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 15:15:59.772154 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:15:59.772154 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 233/479] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Aug 2 15:15:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 15:15:59.778763 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67efcef6-b944-45ee-9fcc-672c60a4fe80 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:15:59.898775 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67efcef6-b944-45ee-9fcc-672c60a4fe80 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:15:59.925201 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:15:59.942130 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5722003-825b-425b-b972-7cbc64f01ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:15:59.943273 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5722003-825b-425b-b972-7cbc64f01ffd None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:15:59.943900 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5722003-825b-425b-b972-7cbc64f01ffd None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:15:59.944413 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5722003-825b-425b-b972-7cbc64f01ffd None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:15:59.945359 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5722003-825b-425b-b972-7cbc64f01ffd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:15:59.945877 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5722003-825b-425b-b972-7cbc64f01ffd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:15:59.947505 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5722003-825b-425b-b972-7cbc64f01ffd None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:15:59.957330 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 247/480] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 2 15:15:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:00.977258 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0320d0-c450-4875-b292-1f91bd34688c None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:00.977778 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0320d0-c450-4875-b292-1f91bd34688c None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:00.977888 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0320d0-c450-4875-b292-1f91bd34688c None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:00.979366 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 234/481] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:16:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:16:00.985111 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac6bc5-6dad-4fdf-8b21-58c5947d20cb None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:00.985956 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac6bc5-6dad-4fdf-8b21-58c5947d20cb None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:00.986476 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac6bc5-6dad-4fdf-8b21-58c5947d20cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:01.016432 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-4aac6bc5-6dad-4fdf-8b21-58c5947d20cb None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:16:01.018008 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-4aac6bc5-6dad-4fdf-8b21-58c5947d20cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:16:01.112948 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 248/482] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:16:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 15:16:01.136520 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0320d0-c450-4875-b292-1f91bd34688c None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:01.297019 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0320d0-c450-4875-b292-1f91bd34688c None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:01.343597 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f115a-a6e5-4169-b53a-bcdfd3b93dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:01.344253 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f115a-a6e5-4169-b53a-bcdfd3b93dd7 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:01.344531 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f115a-a6e5-4169-b53a-bcdfd3b93dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:01.344804 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f115a-a6e5-4169-b53a-bcdfd3b93dd7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:01.348133 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:01.357975 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263f115a-a6e5-4169-b53a-bcdfd3b93dd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:16:01.363085 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-263f115a-a6e5-4169-b53a-bcdfd3b93dd7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 15:16:01.363085 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:01.363085 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:01.363085 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:01.363085 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:01.363085 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:01.363085 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:01.363085 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:01.363085 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:01.363085 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:01.363085 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:01.363085 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:01.363085 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:16:01.363085 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:16:01.363085 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:16:01.363085 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:16:01.364098 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:16:01.364098 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:16:01.364098 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:16:01.364098 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:16:01.364098 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:01.364098 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:01.364098 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:01.364098 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:01.364098 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:01.364098 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:01.364098 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:01.364098 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:01.364098 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:01.364098 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:01.364098 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:01.364098 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:01.364927 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:01.364927 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:01.364927 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:01.364927 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:01.364927 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:16:01.364927 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:16:01.364927 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:16:01.364927 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:16:01.364927 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:16:01.364927 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:16:01.364927 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 15:16:01.364927 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:01.365532 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 235/483] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 2 15:16:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:01.372466 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac6bc5-6dad-4fdf-8b21-58c5947d20cb None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:01.506765 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac6bc5-6dad-4fdf-8b21-58c5947d20cb None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:01.528044 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:01.554540 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3022b959-e141-4a27-9c8b-6dac97568e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:01.555082 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022b959-e141-4a27-9c8b-6dac97568e6c None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:01.555398 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022b959-e141-4a27-9c8b-6dac97568e6c None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:01.555681 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022b959-e141-4a27-9c8b-6dac97568e6c None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:01.556406 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3022b959-e141-4a27-9c8b-6dac97568e6c None admin] RBAC: Adding query filter params (name=service) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:01.556712 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3022b959-e141-4a27-9c8b-6dac97568e6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:01.558143 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3022b959-e141-4a27-9c8b-6dac97568e6c None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:01.572038 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 249/484] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Aug 2 15:16:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:01.577395 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f115a-a6e5-4169-b53a-bcdfd3b93dd7 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:01.617746 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049bc7b5-69f9-4010-aef4-4fc73b80e4dd None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:01.619455 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049bc7b5-69f9-4010-aef4-4fc73b80e4dd None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:01.620154 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049bc7b5-69f9-4010-aef4-4fc73b80e4dd None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:01.622747 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 250/485] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:16:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 15:16:01.632925 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b554a1-548b-4859-82e1-90a61712de13 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:01.633500 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b554a1-548b-4859-82e1-90a61712de13 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:01.633982 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b554a1-548b-4859-82e1-90a61712de13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:01.676455 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-f9b554a1-548b-4859-82e1-90a61712de13 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:16:01.678593 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-f9b554a1-548b-4859-82e1-90a61712de13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:16:01.726624 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f115a-a6e5-4169-b53a-bcdfd3b93dd7 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:01.774794 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc4074-d7a8-4860-af12-45d8e62c1ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:01.776075 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc4074-d7a8-4860-af12-45d8e62c1ee7 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:01.777317 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc4074-d7a8-4860-af12-45d8e62c1ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:01.777966 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc4074-d7a8-4860-af12-45d8e62c1ee7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:01.800109 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dc4074-d7a8-4860-af12-45d8e62c1ee7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:01.802915 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dc4074-d7a8-4860-af12-45d8e62c1ee7 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:01.822497 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 251/486] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:16:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:16:01.828323 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-22dc4074-d7a8-4860-af12-45d8e62c1ee7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:01.828323 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:01.828323 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:01.828323 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:01.828323 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:01.828323 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:01.828323 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:01.828323 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:01.828323 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:01.828323 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:01.828323 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:01.828323 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:01.828323 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:16:01.828323 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:16:01.828323 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:16:01.829182 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:16:01.829182 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:01.829182 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:01.829182 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:01.829182 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:01.829182 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:01.829182 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:01.829182 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:01.829182 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:01.829182 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:01.829182 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:01.829182 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:01.829182 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:01.829182 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:01.829182 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:01.829182 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:01.829182 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:01.830062 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:16:01.830062 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:16:01.830062 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:01.830062 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:01.832240 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 236/487] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:16:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:01.843293 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b554a1-548b-4859-82e1-90a61712de13 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:01.881402 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc4074-d7a8-4860-af12-45d8e62c1ee7 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:01.978667 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:02.010344 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b554a1-548b-4859-82e1-90a61712de13 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:02.021377 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:02.063047 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee1354a-64ab-410f-bf04-8c87bd0cae9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:02.064512 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1354a-64ab-410f-bf04-8c87bd0cae9c None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:02.065593 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1354a-64ab-410f-bf04-8c87bd0cae9c None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:02.065873 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1354a-64ab-410f-bf04-8c87bd0cae9c None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:02.066585 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee1354a-64ab-410f-bf04-8c87bd0cae9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:02.066900 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee1354a-64ab-410f-bf04-8c87bd0cae9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:02.068869 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee1354a-64ab-410f-bf04-8c87bd0cae9c None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:02.082615 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc4074-d7a8-4860-af12-45d8e62c1ee7 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:02.091398 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 252/488] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:16:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:02.093025 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a42ca-a179-4242-80f9-14bc269af538 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:02.093492 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a42ca-a179-4242-80f9-14bc269af538 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:02.093940 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a42ca-a179-4242-80f9-14bc269af538 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:02.099652 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 253/489] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:16:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:16:02.100791 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224a42ca-a179-4242-80f9-14bc269af538 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:02.127158 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6795fce8-6ab0-4f80-ad86-98441b11714e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:02.128117 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795fce8-6ab0-4f80-ad86-98441b11714e None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:02.128723 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795fce8-6ab0-4f80-ad86-98441b11714e None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:02.129082 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795fce8-6ab0-4f80-ad86-98441b11714e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:02.145452 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6795fce8-6ab0-4f80-ad86-98441b11714e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:16:02.153965 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-6795fce8-6ab0-4f80-ad86-98441b11714e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 15:16:02.153965 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:02.153965 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:02.153965 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:02.153965 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:02.153965 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:02.153965 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:02.153965 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:02.153965 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:02.153965 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:02.153965 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:02.153965 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:02.153965 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:16:02.153965 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:16:02.153965 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:16:02.153965 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:16:02.154874 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:16:02.154874 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:16:02.154874 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:16:02.154874 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:16:02.154874 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:02.154874 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:02.154874 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:02.154874 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:02.154874 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:02.154874 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:02.154874 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:02.154874 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:02.154874 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:02.154874 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:02.154874 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:02.154874 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:02.155720 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:02.155720 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:02.155720 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:02.155720 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:02.155720 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:16:02.155720 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:16:02.155720 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:16:02.155720 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:16:02.155720 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:16:02.155720 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:16:02.155720 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 15:16:02.155720 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:02.155720 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 237/490] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 2 15:16:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 15:16:02.157285 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01466386-70d8-41fe-9d69-af767d40820f None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:02.157584 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01466386-70d8-41fe-9d69-af767d40820f None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:02.157867 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01466386-70d8-41fe-9d69-af767d40820f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:02.183566 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-01466386-70d8-41fe-9d69-af767d40820f None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:16:02.185075 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-01466386-70d8-41fe-9d69-af767d40820f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:16:02.220750 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224a42ca-a179-4242-80f9-14bc269af538 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:02.260181 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d02bf6-4d06-4f36-85d7-2c292a6e5e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:02.261188 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d02bf6-4d06-4f36-85d7-2c292a6e5e87 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:02.261646 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d02bf6-4d06-4f36-85d7-2c292a6e5e87 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:02.262098 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d02bf6-4d06-4f36-85d7-2c292a6e5e87 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:02.271341 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d02bf6-4d06-4f36-85d7-2c292a6e5e87 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:02.273215 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d02bf6-4d06-4f36-85d7-2c292a6e5e87 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:02.287246 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 238/491] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:16:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:16:02.287246 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01466386-70d8-41fe-9d69-af767d40820f None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:02.299757 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-a3d02bf6-4d06-4f36-85d7-2c292a6e5e87 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 15:16:02.299757 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:02.299757 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:02.299757 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:02.299757 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:02.299757 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:02.299757 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:02.299757 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:02.299757 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:02.299757 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:02.299757 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:02.299757 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:02.299757 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 15:16:02.299757 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 15:16:02.299757 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 15:16:02.299757 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 15:16:02.300681 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:02.300681 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:02.300681 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 15:16:02.300681 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:16:02.300681 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 15:16:02.300681 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:16:02.300681 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:02.300681 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:02.300681 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:02.300681 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:02.300681 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:02.300681 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:02.300681 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:02.300681 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:02.300681 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:02.300681 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:02.300681 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:02.300681 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:02.301557 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:02.301557 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:02.301557 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 15:16:02.301557 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 15:16:02.301557 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 15:16:02.301557 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 15:16:02.301557 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 15:16:02.301557 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 15:16:02.301557 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 15:16:02.301557 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:02.303549 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 254/492] 10.222.0.42 () {56 vars in 1093 bytes} [Tue Aug 2 15:16:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:02.311075 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d02bf6-4d06-4f36-85d7-2c292a6e5e87 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:02.347699 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:02.349636 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:02.431525 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01466386-70d8-41fe-9d69-af767d40820f None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:02.435989 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d02bf6-4d06-4f36-85d7-2c292a6e5e87 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:02.471290 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5f791-31e5-4e19-923c-8cc6f1b69eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:02.472362 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5f791-31e5-4e19-923c-8cc6f1b69eb3 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:02.473096 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5f791-31e5-4e19-923c-8cc6f1b69eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:02.473566 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5f791-31e5-4e19-923c-8cc6f1b69eb3 None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:02.474505 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac5f791-31e5-4e19-923c-8cc6f1b69eb3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:02.475012 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac5f791-31e5-4e19-923c-8cc6f1b69eb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:02.476620 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac5f791-31e5-4e19-923c-8cc6f1b69eb3 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:02.478020 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48dba5b-2710-4500-bc89-c3af4c0c182f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:02.478821 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48dba5b-2710-4500-bc89-c3af4c0c182f None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:02.479114 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48dba5b-2710-4500-bc89-c3af4c0c182f None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:02.479444 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48dba5b-2710-4500-bc89-c3af4c0c182f None admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:02.480604 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48dba5b-2710-4500-bc89-c3af4c0c182f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:02.480930 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48dba5b-2710-4500-bc89-c3af4c0c182f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:02.482404 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48dba5b-2710-4500-bc89-c3af4c0c182f None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:02.487880 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 239/493] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Aug 2 15:16:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:02.489058 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5f791-31e5-4e19-923c-8cc6f1b69eb3 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:02.525193 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 255/494] 10.222.0.42 () {56 vars in 1133 bytes} [Tue Aug 2 15:16:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:02.531261 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133754e-b095-48d5-a790-3c304785d6b8 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:02.532285 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133754e-b095-48d5-a790-3c304785d6b8 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:02.532285 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133754e-b095-48d5-a790-3c304785d6b8 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:02.533942 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 256/495] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:16:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:16:02.534503 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5133754e-b095-48d5-a790-3c304785d6b8 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:02.606346 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:02.609463 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5f791-31e5-4e19-923c-8cc6f1b69eb3 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:02.636595 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:02.648931 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdafce3-fcb2-41a3-93cc-3801bf318c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:02.649588 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdafce3-fcb2-41a3-93cc-3801bf318c5d None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:02.649870 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdafce3-fcb2-41a3-93cc-3801bf318c5d None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:02.650150 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdafce3-fcb2-41a3-93cc-3801bf318c5d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:02.656926 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5133754e-b095-48d5-a790-3c304785d6b8 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:02.660465 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdafce3-fcb2-41a3-93cc-3801bf318c5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:16:02.666771 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-fbdafce3-fcb2-41a3-93cc-3801bf318c5d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 15:16:02.666771 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:02.666771 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:02.666771 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:02.666771 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:02.666771 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:02.666771 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:02.666771 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:02.666771 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:02.666771 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:02.666771 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:02.666771 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:02.666771 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:16:02.666771 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:16:02.666771 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:16:02.666771 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:16:02.667857 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:16:02.667857 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:16:02.667857 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:16:02.667857 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:16:02.667857 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:02.667857 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:02.667857 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:02.667857 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:02.667857 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:02.667857 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:02.667857 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:02.667857 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:02.667857 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:02.667857 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:02.667857 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:02.667857 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:02.668621 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:02.668621 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:02.668621 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:02.668621 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:02.668621 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:16:02.668621 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:16:02.668621 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:16:02.668621 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:16:02.668621 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:16:02.668621 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:16:02.668621 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 15:16:02.668621 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:02.668621 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 240/496] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 2 15:16:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:02.669261 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdafce3-fcb2-41a3-93cc-3801bf318c5d None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:02.694507 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f27e4-9ed4-4cd0-b115-56f595ad2411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:02.695148 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f27e4-9ed4-4cd0-b115-56f595ad2411 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:02.695459 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f27e4-9ed4-4cd0-b115-56f595ad2411 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:02.695735 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f27e4-9ed4-4cd0-b115-56f595ad2411 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:02.705874 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9f27e4-9ed4-4cd0-b115-56f595ad2411 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:02.707432 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9f27e4-9ed4-4cd0-b115-56f595ad2411 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:02.723025 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-2c9f27e4-9ed4-4cd0-b115-56f595ad2411 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:02.723025 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:02.723025 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:02.723025 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:02.723025 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:02.723025 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:02.723025 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:02.723025 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:02.723025 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:02.723025 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:02.723025 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:02.723025 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:02.723025 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:16:02.723025 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:16:02.723025 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:16:02.724616 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:16:02.724616 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:02.724616 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:02.724616 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:02.724616 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:02.724616 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:02.724616 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:02.724616 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:02.724616 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:02.724616 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:02.724616 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:02.724616 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:02.724616 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:02.724616 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:02.724616 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:02.724616 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:02.724616 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:02.725613 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:16:02.725613 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:16:02.725613 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:02.725613 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:02.725613 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 257/497] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:16:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:02.727195 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e4bd7-9bb7-44d8-9a28-ffcdd631f41f None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:02.727817 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e4bd7-9bb7-44d8-9a28-ffcdd631f41f None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:02.728107 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e4bd7-9bb7-44d8-9a28-ffcdd631f41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:02.746773 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-672e4bd7-9bb7-44d8-9a28-ffcdd631f41f None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:16:02.748093 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-672e4bd7-9bb7-44d8-9a28-ffcdd631f41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:16:02.776070 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdafce3-fcb2-41a3-93cc-3801bf318c5d None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:02.811484 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03afdcd-3b5e-455a-af3d-1bc6848cec1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:02.812103 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03afdcd-3b5e-455a-af3d-1bc6848cec1e None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:02.812380 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03afdcd-3b5e-455a-af3d-1bc6848cec1e None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:02.812651 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03afdcd-3b5e-455a-af3d-1bc6848cec1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:02.818421 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 258/498] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:16:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:16:02.819919 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2fcea-ddb2-4fa4-bff8-8648fcfd4cee None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:02.820307 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2fcea-ddb2-4fa4-bff8-8648fcfd4cee None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:02.820639 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2fcea-ddb2-4fa4-bff8-8648fcfd4cee None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:02.826455 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 259/499] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:16:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:16:02.826455 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2fcea-ddb2-4fa4-bff8-8648fcfd4cee None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:02.852138 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:02.900283 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03afdcd-3b5e-455a-af3d-1bc6848cec1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:02.900472 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:02.901851 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03afdcd-3b5e-455a-af3d-1bc6848cec1e None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:02.939525 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2fcea-ddb2-4fa4-bff8-8648fcfd4cee None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:02.974009 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8881e01-eb1f-40f4-8acb-cbd3d7294a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:02.974619 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8881e01-eb1f-40f4-8acb-cbd3d7294a77 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:02.974897 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8881e01-eb1f-40f4-8acb-cbd3d7294a77 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:02.975169 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8881e01-eb1f-40f4-8acb-cbd3d7294a77 None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:02.975914 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8881e01-eb1f-40f4-8acb-cbd3d7294a77 None admin] RBAC: Adding query filter params (name=service) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:02.976217 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8881e01-eb1f-40f4-8acb-cbd3d7294a77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:02.977628 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8881e01-eb1f-40f4-8acb-cbd3d7294a77 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:02.985537 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 260/500] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Aug 2 15:16:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:02.986326 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8881e01-eb1f-40f4-8acb-cbd3d7294a77 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:03.002398 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 241/501] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 2 15:16:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 15:16:03.003762 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe6b19a-ee79-4e9f-b090-9071a5ef4707 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:03.004062 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe6b19a-ee79-4e9f-b090-9071a5ef4707 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:03.004340 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe6b19a-ee79-4e9f-b090-9071a5ef4707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:03.024050 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-9fe6b19a-ee79-4e9f-b090-9071a5ef4707 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:16:03.025246 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-9fe6b19a-ee79-4e9f-b090-9071a5ef4707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:16:03.080904 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:03.090757 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8881e01-eb1f-40f4-8acb-cbd3d7294a77 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:03.092729 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 242/502] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:16:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:16:03.093551 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe6b19a-ee79-4e9f-b090-9071a5ef4707 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:03.131863 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:03.141092 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e5b304-3800-4d06-92bd-b143ce226596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:03.141711 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5b304-3800-4d06-92bd-b143ce226596 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:03.141992 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5b304-3800-4d06-92bd-b143ce226596 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:03.142265 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5b304-3800-4d06-92bd-b143ce226596 None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:03.142994 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e5b304-3800-4d06-92bd-b143ce226596 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:03.143397 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e5b304-3800-4d06-92bd-b143ce226596 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:03.144805 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e5b304-3800-4d06-92bd-b143ce226596 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:03.157514 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 261/503] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:16:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:03.158361 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e5b304-3800-4d06-92bd-b143ce226596 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:03.200243 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe6b19a-ee79-4e9f-b090-9071a5ef4707 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:03.243207 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052ab063-a6e6-4ecd-9de0-ae03ae5d156f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:03.243882 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ab063-a6e6-4ecd-9de0-ae03ae5d156f None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:03.244163 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ab063-a6e6-4ecd-9de0-ae03ae5d156f None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:03.244459 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ab063-a6e6-4ecd-9de0-ae03ae5d156f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:03.254667 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052ab063-a6e6-4ecd-9de0-ae03ae5d156f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:16:03.259557 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-052ab063-a6e6-4ecd-9de0-ae03ae5d156f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 15:16:03.259557 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:03.259557 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:03.259557 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:03.259557 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:03.259557 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:03.259557 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:03.259557 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:03.259557 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:03.259557 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:03.259557 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:03.259557 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:03.259557 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:16:03.259557 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:16:03.259557 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:16:03.259557 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:16:03.260474 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:16:03.260474 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:16:03.260474 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:16:03.260474 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:16:03.260474 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:03.260474 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:03.260474 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:03.260474 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:03.260474 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:03.260474 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:03.260474 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:03.260474 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:03.260474 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:03.260474 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:03.260474 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:03.260474 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:03.261452 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:03.261452 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:03.261452 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:03.261452 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:03.261452 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:16:03.261452 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:16:03.261452 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:16:03.261452 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:16:03.261452 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:16:03.261452 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:16:03.261452 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 15:16:03.261452 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:03.263498 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 243/504] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 2 15:16:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:03.264490 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052ab063-a6e6-4ecd-9de0-ae03ae5d156f None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:03.280426 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e5b304-3800-4d06-92bd-b143ce226596 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:03.314824 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc1555-034c-4390-9529-3865f34df0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:03.315600 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc1555-034c-4390-9529-3865f34df0f9 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:03.315884 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc1555-034c-4390-9529-3865f34df0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:03.316161 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc1555-034c-4390-9529-3865f34df0f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:03.317080 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:03.326612 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dc1555-034c-4390-9529-3865f34df0f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:03.328126 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dc1555-034c-4390-9529-3865f34df0f9 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:03.344539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-e7dc1555-034c-4390-9529-3865f34df0f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:03.344539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:03.344539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:03.344539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:03.344539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:03.344539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:03.344539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:03.344539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:03.344539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:03.344539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:03.344539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:03.344539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:03.344539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:16:03.344539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:16:03.344539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:16:03.345865 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:16:03.345865 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:03.345865 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:03.345865 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:03.345865 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:03.345865 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:03.345865 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:03.345865 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:03.345865 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:03.345865 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:03.345865 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:03.345865 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:03.345865 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:03.345865 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:03.345865 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:03.345865 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:03.345865 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:03.346883 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:16:03.346883 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:16:03.346883 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:03.346883 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:03.346883 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 262/505] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:16:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:03.346883 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc1555-034c-4390-9529-3865f34df0f9 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:03.374440 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052ab063-a6e6-4ecd-9de0-ae03ae5d156f None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:03.392879 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:03.410935 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16241905-49dc-43fd-8225-b9fce218efa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:03.412159 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16241905-49dc-43fd-8225-b9fce218efa4 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:03.412450 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16241905-49dc-43fd-8225-b9fce218efa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:03.412717 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16241905-49dc-43fd-8225-b9fce218efa4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:03.423231 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16241905-49dc-43fd-8225-b9fce218efa4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:03.424701 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16241905-49dc-43fd-8225-b9fce218efa4 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:03.439166 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-16241905-49dc-43fd-8225-b9fce218efa4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:03.439166 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:03.439166 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:03.439166 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:03.439166 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:03.439166 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:03.439166 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:03.439166 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:03.439166 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:03.439166 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:03.439166 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:03.439166 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:03.439166 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:16:03.439166 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:16:03.439166 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:16:03.440213 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:16:03.440213 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:03.440213 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:03.440213 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:03.440213 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:03.440213 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:03.440213 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:03.440213 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:03.440213 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:03.440213 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:03.440213 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:03.440213 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:03.440213 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:03.440213 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:03.440213 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:03.440213 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:03.440213 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:03.441196 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:16:03.441196 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:16:03.441196 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:03.441196 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:03.441196 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 244/506] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:16:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:03.441196 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16241905-49dc-43fd-8225-b9fce218efa4 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:03.456365 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc1555-034c-4390-9529-3865f34df0f9 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:03.490908 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c3b696-c5f3-495a-9c4b-194420130b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:03.491670 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c3b696-c5f3-495a-9c4b-194420130b54 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:03.492007 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c3b696-c5f3-495a-9c4b-194420130b54 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:03.492330 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c3b696-c5f3-495a-9c4b-194420130b54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:03.502932 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c3b696-c5f3-495a-9c4b-194420130b54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:03.504428 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c3b696-c5f3-495a-9c4b-194420130b54 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:03.524415 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-e5c3b696-c5f3-495a-9c4b-194420130b54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:03.524415 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:03.524415 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:03.524415 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:03.524415 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:03.524415 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:03.524415 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:03.524415 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:03.524415 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:03.524415 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:03.524415 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:03.524415 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:03.524415 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:16:03.524415 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:16:03.524415 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:16:03.525515 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:16:03.525515 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:03.525515 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:03.525515 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:03.525515 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:03.525515 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:03.525515 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:03.525515 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:03.525515 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:03.525515 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:03.525515 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:03.525515 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:03.525515 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:03.525515 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:03.525515 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:03.525515 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:03.525515 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:03.526591 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:16:03.526591 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:16:03.526591 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:03.526591 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:03.526591 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 263/507] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:16:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:03.526917 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c3b696-c5f3-495a-9c4b-194420130b54 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:03.549733 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16241905-49dc-43fd-8225-b9fce218efa4 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:03.551582 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:03.586676 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dba9b9-c2f0-4ffb-b6ea-0f68020dca32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:03.587340 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dba9b9-c2f0-4ffb-b6ea-0f68020dca32 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:03.587625 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dba9b9-c2f0-4ffb-b6ea-0f68020dca32 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:03.587908 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dba9b9-c2f0-4ffb-b6ea-0f68020dca32 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:03.595748 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dba9b9-c2f0-4ffb-b6ea-0f68020dca32 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:03.597192 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dba9b9-c2f0-4ffb-b6ea-0f68020dca32 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:03.609859 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-31dba9b9-c2f0-4ffb-b6ea-0f68020dca32 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 02 15:16:03.609859 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:03.609859 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:03.609859 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:03.609859 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:03.609859 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:03.609859 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:03.609859 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:03.609859 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:03.609859 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:03.609859 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:03.609859 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:03.609859 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 15:16:03.609859 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 15:16:03.609859 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 15:16:03.609859 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 15:16:03.610887 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:03.610887 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:03.610887 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 15:16:03.610887 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:16:03.610887 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 15:16:03.610887 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:16:03.610887 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:03.610887 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:03.610887 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:03.610887 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:03.610887 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:03.610887 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:03.610887 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:03.610887 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:03.610887 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:03.610887 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:03.610887 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:03.610887 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:03.611845 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:03.611845 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:03.611845 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 15:16:03.611845 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 15:16:03.611845 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 15:16:03.611845 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 15:16:03.611845 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 15:16:03.611845 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 15:16:03.611845 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 02 15:16:03.611845 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:03.611845 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 245/508] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 2 15:16:03 2022] GET /identity/v3/users/glance => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:03.612393 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dba9b9-c2f0-4ffb-b6ea-0f68020dca32 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:03.627765 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:03.638634 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c3b696-c5f3-495a-9c4b-194420130b54 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:03.674527 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ddbb83-f35f-4f7f-9e47-70bc77246090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:03.675057 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ddbb83-f35f-4f7f-9e47-70bc77246090 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:03.675404 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ddbb83-f35f-4f7f-9e47-70bc77246090 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:03.675645 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ddbb83-f35f-4f7f-9e47-70bc77246090 None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:03.676358 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ddbb83-f35f-4f7f-9e47-70bc77246090 None admin] RBAC: Adding query filter params (name=service) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:03.676664 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ddbb83-f35f-4f7f-9e47-70bc77246090 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:03.678084 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ddbb83-f35f-4f7f-9e47-70bc77246090 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:03.686519 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 264/509] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Aug 2 15:16:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:03.687363 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ddbb83-f35f-4f7f-9e47-70bc77246090 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:03.717667 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dba9b9-c2f0-4ffb-b6ea-0f68020dca32 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:03.752803 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211aa5a8-fa0b-4ba8-88b8-9b42520bc7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:03.753418 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211aa5a8-fa0b-4ba8-88b8-9b42520bc7b8 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:03.753706 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211aa5a8-fa0b-4ba8-88b8-9b42520bc7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:03.753978 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211aa5a8-fa0b-4ba8-88b8-9b42520bc7b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:03.754666 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211aa5a8-fa0b-4ba8-88b8-9b42520bc7b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:03.755538 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211aa5a8-fa0b-4ba8-88b8-9b42520bc7b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:03.756921 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211aa5a8-fa0b-4ba8-88b8-9b42520bc7b8 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:03.768670 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 246/510] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:16:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:03.769495 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211aa5a8-fa0b-4ba8-88b8-9b42520bc7b8 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:03.792954 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ddbb83-f35f-4f7f-9e47-70bc77246090 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:03.794529 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:03.828324 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed4afab-142d-47c1-a879-1dc9ac61caa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:03.828935 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4afab-142d-47c1-a879-1dc9ac61caa8 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:03.829216 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4afab-142d-47c1-a879-1dc9ac61caa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:03.829492 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4afab-142d-47c1-a879-1dc9ac61caa8 None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:03.830174 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed4afab-142d-47c1-a879-1dc9ac61caa8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:03.830480 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed4afab-142d-47c1-a879-1dc9ac61caa8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:03.831890 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed4afab-142d-47c1-a879-1dc9ac61caa8 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:03.844196 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 265/511] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:16:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:03.844987 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed4afab-142d-47c1-a879-1dc9ac61caa8 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:03.860949 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:03.871610 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211aa5a8-fa0b-4ba8-88b8-9b42520bc7b8 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:03.906451 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94e7a0-15db-446f-8164-1ea0557fa470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:03.907063 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94e7a0-15db-446f-8164-1ea0557fa470 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:03.907370 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94e7a0-15db-446f-8164-1ea0557fa470 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:03.907677 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94e7a0-15db-446f-8164-1ea0557fa470 None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:03.908353 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a94e7a0-15db-446f-8164-1ea0557fa470 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:03.908653 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a94e7a0-15db-446f-8164-1ea0557fa470 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:03.910010 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a94e7a0-15db-446f-8164-1ea0557fa470 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:03.922241 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 247/512] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:16:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:03.923068 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94e7a0-15db-446f-8164-1ea0557fa470 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:03.950218 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed4afab-142d-47c1-a879-1dc9ac61caa8 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:03.984808 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdb26f9-8c5a-4ea5-af11-958e1429e53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:03.985416 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb26f9-8c5a-4ea5-af11-958e1429e53a None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:03.985695 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb26f9-8c5a-4ea5-af11-958e1429e53a None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:03.985972 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb26f9-8c5a-4ea5-af11-958e1429e53a None admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:03.986761 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdb26f9-8c5a-4ea5-af11-958e1429e53a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:03.987070 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdb26f9-8c5a-4ea5-af11-958e1429e53a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:03.988566 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdb26f9-8c5a-4ea5-af11-958e1429e53a None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:04.005890 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 266/513] 10.222.0.42 () {56 vars in 1137 bytes} [Tue Aug 2 15:16:03 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:04.006720 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdb26f9-8c5a-4ea5-af11-958e1429e53a None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:04.011958 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:04.031024 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94e7a0-15db-446f-8164-1ea0557fa470 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:04.065181 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c238c0-f361-407c-8d74-b86a79dcab31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:04.065809 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c238c0-f361-407c-8d74-b86a79dcab31 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:04.066085 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c238c0-f361-407c-8d74-b86a79dcab31 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:04.066356 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c238c0-f361-407c-8d74-b86a79dcab31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:04.076490 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:04.076722 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c238c0-f361-407c-8d74-b86a79dcab31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:04.078172 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c238c0-f361-407c-8d74-b86a79dcab31 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:04.093320 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-72c238c0-f361-407c-8d74-b86a79dcab31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:04.093320 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:04.093320 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:04.093320 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:04.093320 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:04.093320 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:04.093320 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:04.093320 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:04.093320 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:04.093320 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:04.093320 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:04.093320 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:04.093320 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:16:04.093320 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:16:04.093320 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:16:04.094196 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:16:04.094196 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:04.094196 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:04.094196 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:04.094196 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:04.094196 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:04.094196 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:04.094196 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:04.094196 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:04.094196 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:04.094196 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:04.094196 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:04.094196 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:04.094196 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:04.094196 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:04.094196 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:04.094196 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:04.095067 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:16:04.095067 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:16:04.095067 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:04.095067 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:04.095067 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 248/514] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:16:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:04.095952 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c238c0-f361-407c-8d74-b86a79dcab31 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:04.111777 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdb26f9-8c5a-4ea5-af11-958e1429e53a None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:04.146659 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9b920-0759-40bc-bab4-3be01f2da259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:04.147330 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9b920-0759-40bc-bab4-3be01f2da259 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:04.147607 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9b920-0759-40bc-bab4-3be01f2da259 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:04.147876 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9b920-0759-40bc-bab4-3be01f2da259 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:04.155401 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed9b920-0759-40bc-bab4-3be01f2da259 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:04.156861 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed9b920-0759-40bc-bab4-3be01f2da259 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:04.169540 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-8ed9b920-0759-40bc-bab4-3be01f2da259 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 02 15:16:04.169540 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:04.169540 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:04.169540 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:04.169540 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:04.169540 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:04.169540 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:04.169540 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:04.169540 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:04.169540 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:04.169540 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:04.169540 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:04.169540 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 15:16:04.169540 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 15:16:04.169540 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 15:16:04.169540 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 15:16:04.170651 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:04.170651 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:04.170651 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 15:16:04.170651 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:16:04.170651 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 15:16:04.170651 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:16:04.170651 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:04.170651 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:04.170651 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:04.170651 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:04.170651 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:04.170651 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:04.170651 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:04.170651 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:04.170651 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:04.170651 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:04.170651 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:04.170651 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:04.171579 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:04.171579 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:04.171579 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 15:16:04.171579 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 15:16:04.171579 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 15:16:04.171579 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 15:16:04.171579 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 15:16:04.171579 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 15:16:04.171579 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 02 15:16:04.171579 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:04.171579 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 267/515] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 2 15:16:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:04.171579 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9b920-0759-40bc-bab4-3be01f2da259 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:04.202027 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c238c0-f361-407c-8d74-b86a79dcab31 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:04.240490 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393645be-0c08-4d34-8cc5-d3cfc95c244d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:04.241146 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393645be-0c08-4d34-8cc5-d3cfc95c244d None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:04.241431 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393645be-0c08-4d34-8cc5-d3cfc95c244d None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:04.241711 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393645be-0c08-4d34-8cc5-d3cfc95c244d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:04.243715 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:04.249379 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393645be-0c08-4d34-8cc5-d3cfc95c244d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:04.251080 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393645be-0c08-4d34-8cc5-d3cfc95c244d None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:04.264007 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-393645be-0c08-4d34-8cc5-d3cfc95c244d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:16:04.264007 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:04.264007 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:04.264007 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:04.264007 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:04.264007 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:04.264007 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:04.264007 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:04.264007 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:04.264007 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:04.264007 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:04.264007 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:04.264007 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 15:16:04.264007 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 15:16:04.264007 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 15:16:04.265159 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 15:16:04.265159 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:04.265159 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:04.265159 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:04.265159 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:04.265159 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:04.265159 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:04.265159 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:04.265159 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:04.265159 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:04.265159 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:04.265159 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:04.265159 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:04.265159 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:04.265159 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:04.265159 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:04.265159 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:04.266189 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 15:16:04.266189 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 15:16:04.266189 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 15:16:04.266189 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 15:16:04.266189 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 15:16:04.266189 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 15:16:04.266189 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:16:04.266189 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:04.266189 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 249/516] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 2 15:16:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:04.266732 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393645be-0c08-4d34-8cc5-d3cfc95c244d None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:04.274388 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9b920-0759-40bc-bab4-3be01f2da259 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:04.304908 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:04.311744 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01da7f0-a69b-424c-a316-e0e210aef25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:04.312419 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01da7f0-a69b-424c-a316-e0e210aef25c None admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:04.312708 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01da7f0-a69b-424c-a316-e0e210aef25c None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:04.312984 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01da7f0-a69b-424c-a316-e0e210aef25c None admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:04.313668 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01da7f0-a69b-424c-a316-e0e210aef25c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:04.315105 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01da7f0-a69b-424c-a316-e0e210aef25c None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:04.336920 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 268/517] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Aug 2 15:16:04 2022] POST /identity/v3/users => generated 247 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:16:04.337752 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01da7f0-a69b-424c-a316-e0e210aef25c None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:04.380722 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393645be-0c08-4d34-8cc5-d3cfc95c244d None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:04.425477 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8522facb-9ae6-492a-9663-ee0f2e3399ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:04.427615 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522facb-9ae6-492a-9663-ee0f2e3399ab None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:04.428516 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522facb-9ae6-492a-9663-ee0f2e3399ab None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:04.428977 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522facb-9ae6-492a-9663-ee0f2e3399ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:04.453562 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01da7f0-a69b-424c-a316-e0e210aef25c None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:04.495717 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b372faf-0acf-4f7e-bad4-660f84155add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:04.495717 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b372faf-0acf-4f7e-bad4-660f84155add None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:04.495717 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b372faf-0acf-4f7e-bad4-660f84155add None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:04.496063 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b372faf-0acf-4f7e-bad4-660f84155add None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:04.496849 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b372faf-0acf-4f7e-bad4-660f84155add None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:04.497230 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b372faf-0acf-4f7e-bad4-660f84155add None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:04.498698 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b372faf-0acf-4f7e-bad4-660f84155add None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:04.504778 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:04.514014 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 269/518] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:16:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:04.514933 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b372faf-0acf-4f7e-bad4-660f84155add None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:04.515441 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8522facb-9ae6-492a-9663-ee0f2e3399ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:04.516871 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8522facb-9ae6-492a-9663-ee0f2e3399ab None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:04.573644 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:04.636683 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 250/519] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 2 15:16:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 15:16:04.636683 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8522facb-9ae6-492a-9663-ee0f2e3399ab None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:04.636937 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b372faf-0acf-4f7e-bad4-660f84155add None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:04.677395 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1abc5d4-d278-4d50-a6d9-0eebdce37050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:04.678029 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1abc5d4-d278-4d50-a6d9-0eebdce37050 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:04.678314 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1abc5d4-d278-4d50-a6d9-0eebdce37050 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:04.678591 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1abc5d4-d278-4d50-a6d9-0eebdce37050 None admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:04.679532 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1abc5d4-d278-4d50-a6d9-0eebdce37050 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:04.679770 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1abc5d4-d278-4d50-a6d9-0eebdce37050 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:04.681204 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1abc5d4-d278-4d50-a6d9-0eebdce37050 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:04.705219 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 270/520] 10.222.0.42 () {56 vars in 1137 bytes} [Tue Aug 2 15:16:04 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:04.706017 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1abc5d4-d278-4d50-a6d9-0eebdce37050 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:04.740482 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:04.749093 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8522facb-9ae6-492a-9663-ee0f2e3399ab None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:04.786611 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233fbfea-22b2-4341-b6a2-4240e5fda931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:04.787249 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233fbfea-22b2-4341-b6a2-4240e5fda931 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:04.787528 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233fbfea-22b2-4341-b6a2-4240e5fda931 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:04.787801 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233fbfea-22b2-4341-b6a2-4240e5fda931 None admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:04.788809 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233fbfea-22b2-4341-b6a2-4240e5fda931 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:04.789118 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233fbfea-22b2-4341-b6a2-4240e5fda931 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:04.791236 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233fbfea-22b2-4341-b6a2-4240e5fda931 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:04.811094 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 251/521] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 2 15:16:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:04.812218 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233fbfea-22b2-4341-b6a2-4240e5fda931 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:04.821872 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1abc5d4-d278-4d50-a6d9-0eebdce37050 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:04.825305 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:04.863405 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da324103-33aa-470e-8447-2dbdb7194c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:04.864146 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da324103-33aa-470e-8447-2dbdb7194c92 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:04.866595 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da324103-33aa-470e-8447-2dbdb7194c92 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:04.866595 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da324103-33aa-470e-8447-2dbdb7194c92 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:04.873266 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da324103-33aa-470e-8447-2dbdb7194c92 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:04.874752 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da324103-33aa-470e-8447-2dbdb7194c92 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:04.891688 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-da324103-33aa-470e-8447-2dbdb7194c92 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 02 15:16:04.891688 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:04.891688 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:04.891688 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:04.891688 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:04.891688 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:04.891688 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:04.891688 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:04.891688 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:04.891688 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:04.891688 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:04.891688 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:04.891688 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 15:16:04.891688 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 15:16:04.891688 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 15:16:04.891688 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 15:16:04.892844 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:04.892844 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:04.892844 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 15:16:04.892844 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:16:04.892844 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 15:16:04.892844 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:16:04.892844 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:04.892844 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:04.892844 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:04.892844 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:04.892844 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:04.892844 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:04.892844 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:04.892844 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:04.892844 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:04.892844 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:04.892844 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:04.892844 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:04.893939 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:04.893939 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:04.893939 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 15:16:04.893939 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 15:16:04.893939 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 15:16:04.893939 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 15:16:04.893939 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 15:16:04.893939 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 15:16:04.893939 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 02 15:16:04.893939 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:04.897404 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 271/522] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 2 15:16:04 2022] GET /identity/v3/users/neutron => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:04.897404 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da324103-33aa-470e-8447-2dbdb7194c92 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:04.934512 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233fbfea-22b2-4341-b6a2-4240e5fda931 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:04.971752 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19432081-0bdb-4bf8-852d-b8e3b0910b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:04.972627 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19432081-0bdb-4bf8-852d-b8e3b0910b7b None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:04.972914 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19432081-0bdb-4bf8-852d-b8e3b0910b7b None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:04.973190 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19432081-0bdb-4bf8-852d-b8e3b0910b7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:04.984423 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19432081-0bdb-4bf8-852d-b8e3b0910b7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:04.985933 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19432081-0bdb-4bf8-852d-b8e3b0910b7b None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:05.003101 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-19432081-0bdb-4bf8-852d-b8e3b0910b7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:05.003101 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:05.003101 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:05.003101 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:05.003101 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:05.003101 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:05.003101 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:05.003101 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:05.003101 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:05.003101 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:05.003101 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:05.003101 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:05.003101 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:16:05.003101 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:16:05.003101 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:16:05.004027 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:16:05.004027 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:05.004027 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:05.004027 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:05.004027 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:05.004027 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:05.004027 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:05.004027 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:05.004027 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:05.004027 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:05.004027 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:05.004027 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:05.004027 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:05.004027 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:05.004027 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:05.004027 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:05.004027 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:05.004837 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:16:05.004837 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:16:05.004837 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:05.004837 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:05.005190 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 252/523] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:16:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:05.005808 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19432081-0bdb-4bf8-852d-b8e3b0910b7b None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:05.011509 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da324103-33aa-470e-8447-2dbdb7194c92 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:05.015464 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:05.051015 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71c8b9b-627b-4662-bfc4-31de1fe1aff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:05.052045 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c8b9b-627b-4662-bfc4-31de1fe1aff8 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:05.052332 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c8b9b-627b-4662-bfc4-31de1fe1aff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:05.052623 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c8b9b-627b-4662-bfc4-31de1fe1aff8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:05.086844 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:05.114266 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19432081-0bdb-4bf8-852d-b8e3b0910b7b None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:05.126962 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71c8b9b-627b-4662-bfc4-31de1fe1aff8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:05.128557 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71c8b9b-627b-4662-bfc4-31de1fe1aff8 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:05.159797 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5203cc-3533-49c5-a706-58307c27bba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:05.161947 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5203cc-3533-49c5-a706-58307c27bba2 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:05.162240 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5203cc-3533-49c5-a706-58307c27bba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:05.162515 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5203cc-3533-49c5-a706-58307c27bba2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:05.163354 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5203cc-3533-49c5-a706-58307c27bba2 None admin] RBAC: Adding query filter params (role.id=532162a00de849cea5c27767c8acd018, scope.project.id=cc19d22b4cd64dd1bc89ed78155d2732, user.id=4c0865af59bf43dfa4c84213d7db53c5) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:05.163972 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5203cc-3533-49c5-a706-58307c27bba2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:05.165482 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5203cc-3533-49c5-a706-58307c27bba2 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:05.171973 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 253/524] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 2 15:16:05 2022] GET /identity/v3/role_assignments?user.id=4c0865af59bf43dfa4c84213d7db53c5&scope.project.id=cc19d22b4cd64dd1bc89ed78155d2732&role.id=532162a00de849cea5c27767c8acd018 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:05.172700 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5203cc-3533-49c5-a706-58307c27bba2 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:05.270587 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 272/525] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 2 15:16:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 15:16:05.271909 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71c8b9b-627b-4662-bfc4-31de1fe1aff8 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:05.285825 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:05.328445 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5203cc-3533-49c5-a706-58307c27bba2 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:05.361569 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:05.367144 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e3ac06-084c-4399-940f-5fc584fb053d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:05.367809 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e3ac06-084c-4399-940f-5fc584fb053d None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:05.368090 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e3ac06-084c-4399-940f-5fc584fb053d None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:05.368364 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e3ac06-084c-4399-940f-5fc584fb053d None admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:05.369158 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e3ac06-084c-4399-940f-5fc584fb053d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:05.369484 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e3ac06-084c-4399-940f-5fc584fb053d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:05.370917 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e3ac06-084c-4399-940f-5fc584fb053d None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:05.403149 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71c8b9b-627b-4662-bfc4-31de1fe1aff8 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:05.413044 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 254/526] 10.222.0.42 () {56 vars in 1139 bytes} [Tue Aug 2 15:16:05 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:05.413044 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e3ac06-084c-4399-940f-5fc584fb053d None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:05.462869 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825d77d3-f6e5-4b46-9742-ced13fe0cf45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:05.463929 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d77d3-f6e5-4b46-9742-ced13fe0cf45 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:05.464245 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d77d3-f6e5-4b46-9742-ced13fe0cf45 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:05.464518 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d77d3-f6e5-4b46-9742-ced13fe0cf45 None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:05.465198 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825d77d3-f6e5-4b46-9742-ced13fe0cf45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:05.465571 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825d77d3-f6e5-4b46-9742-ced13fe0cf45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:05.467087 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825d77d3-f6e5-4b46-9742-ced13fe0cf45 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:05.484993 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 273/527] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:16:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:05.484993 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825d77d3-f6e5-4b46-9742-ced13fe0cf45 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:05.528053 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e3ac06-084c-4399-940f-5fc584fb053d None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:05.560433 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:05.569911 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147b309-40d0-44df-bc2c-84f5fbda4ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:05.571004 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147b309-40d0-44df-bc2c-84f5fbda4ff3 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:05.571664 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147b309-40d0-44df-bc2c-84f5fbda4ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:05.572144 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147b309-40d0-44df-bc2c-84f5fbda4ff3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:05.584960 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4147b309-40d0-44df-bc2c-84f5fbda4ff3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:05.586872 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4147b309-40d0-44df-bc2c-84f5fbda4ff3 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:05.608584 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-4147b309-40d0-44df-bc2c-84f5fbda4ff3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:05.608584 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:05.608584 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:05.608584 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:05.608584 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:05.608584 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:05.608584 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:05.608584 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:05.608584 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:05.608584 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:05.608584 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:05.608584 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:05.608584 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:16:05.608584 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:16:05.608584 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:16:05.609504 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:16:05.609504 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:05.609504 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:05.609504 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:05.609504 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:05.609504 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:05.609504 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:05.609504 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:05.609504 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:05.609504 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:05.609504 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:05.609504 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:05.609504 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:05.609504 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:05.609504 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:05.609504 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:05.609504 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:05.610427 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:16:05.610427 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:16:05.610427 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:05.610427 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:05.610662 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825d77d3-f6e5-4b46-9742-ced13fe0cf45 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:05.618025 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 255/528] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:16:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:05.619378 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147b309-40d0-44df-bc2c-84f5fbda4ff3 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:05.637086 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:05.650016 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28c9c4f-32a8-4a99-add7-c0c25b04609f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:05.650537 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c9c4f-32a8-4a99-add7-c0c25b04609f None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:05.650820 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c9c4f-32a8-4a99-add7-c0c25b04609f None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:05.651097 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c9c4f-32a8-4a99-add7-c0c25b04609f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:05.727246 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28c9c4f-32a8-4a99-add7-c0c25b04609f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:05.728953 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28c9c4f-32a8-4a99-add7-c0c25b04609f None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:05.732498 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147b309-40d0-44df-bc2c-84f5fbda4ff3 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:05.771924 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f00f7-a434-4795-8dc0-640b67431764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:05.773048 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f00f7-a434-4795-8dc0-640b67431764 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:05.773530 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f00f7-a434-4795-8dc0-640b67431764 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:05.774003 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f00f7-a434-4795-8dc0-640b67431764 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:05.781760 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2f00f7-a434-4795-8dc0-640b67431764 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:05.783724 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2f00f7-a434-4795-8dc0-640b67431764 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:05.798561 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-0b2f00f7-a434-4795-8dc0-640b67431764 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:16:05.798561 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:05.798561 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:05.798561 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:05.798561 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:05.798561 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:05.798561 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:05.798561 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:05.798561 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:05.798561 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:05.798561 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:05.798561 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:05.798561 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 15:16:05.798561 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 15:16:05.798561 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 15:16:05.799461 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 15:16:05.799461 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:05.799461 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:05.799461 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:05.799461 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:05.799461 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:05.799461 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:05.799461 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:05.799461 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:05.799461 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:05.799461 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:05.799461 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:05.799461 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:05.799461 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:05.799461 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:05.799461 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:05.799461 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:05.800297 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 15:16:05.800297 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 15:16:05.800297 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 15:16:05.800297 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 15:16:05.800297 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 15:16:05.800297 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 15:16:05.800297 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:16:05.800297 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:05.807382 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 256/529] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 2 15:16:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:05.808500 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f00f7-a434-4795-8dc0-640b67431764 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:05.845603 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 274/530] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 2 15:16:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 15:16:05.845603 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28c9c4f-32a8-4a99-add7-c0c25b04609f None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:05.868167 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:05.873917 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:05.949709 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f00f7-a434-4795-8dc0-640b67431764 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:05.986512 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28c9c4f-32a8-4a99-add7-c0c25b04609f None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:05.994691 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1bdea8-7a7a-458f-9d73-1414d1003e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:05.995457 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1bdea8-7a7a-458f-9d73-1414d1003e65 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:05.995813 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1bdea8-7a7a-458f-9d73-1414d1003e65 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:05.996158 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1bdea8-7a7a-458f-9d73-1414d1003e65 None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:05.996936 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1bdea8-7a7a-458f-9d73-1414d1003e65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:05.997385 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1bdea8-7a7a-458f-9d73-1414d1003e65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:05.999614 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1bdea8-7a7a-458f-9d73-1414d1003e65 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:06.025818 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 257/531] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:16:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:06.025818 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1bdea8-7a7a-458f-9d73-1414d1003e65 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:06.039482 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b4e649-079a-40e5-9b0d-753e5ca54f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:06.040346 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4e649-079a-40e5-9b0d-753e5ca54f67 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:06.040823 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4e649-079a-40e5-9b0d-753e5ca54f67 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:06.041275 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4e649-079a-40e5-9b0d-753e5ca54f67 None admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:06.042197 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b4e649-079a-40e5-9b0d-753e5ca54f67 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:06.042679 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b4e649-079a-40e5-9b0d-753e5ca54f67 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:06.044955 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b4e649-079a-40e5-9b0d-753e5ca54f67 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:06.070653 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 275/532] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 2 15:16:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:06.071740 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b4e649-079a-40e5-9b0d-753e5ca54f67 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:06.158578 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:06.162491 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1bdea8-7a7a-458f-9d73-1414d1003e65 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:06.171008 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:06.191416 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b4e649-079a-40e5-9b0d-753e5ca54f67 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:06.199342 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea09ae48-6430-4842-a44c-773f8651e449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:06.200307 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09ae48-6430-4842-a44c-773f8651e449 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:06.200501 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09ae48-6430-4842-a44c-773f8651e449 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:06.200874 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09ae48-6430-4842-a44c-773f8651e449 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:06.212315 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea09ae48-6430-4842-a44c-773f8651e449 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:06.213899 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea09ae48-6430-4842-a44c-773f8651e449 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:06.230519 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-ea09ae48-6430-4842-a44c-773f8651e449 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:06.230519 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:06.230519 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:06.230519 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:06.230519 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:06.230519 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:06.230519 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:06.230519 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:06.230519 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:06.230519 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:06.230519 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:06.230519 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:06.230519 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:16:06.230519 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:16:06.230519 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:16:06.231674 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:16:06.231674 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:06.231674 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:06.231674 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:06.231674 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:06.231674 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:06.231674 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:06.231674 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:06.231674 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:06.231674 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:06.231674 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:06.231674 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:06.231674 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:06.231674 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:06.231674 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:06.231674 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:06.231674 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:06.232820 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:16:06.232820 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:16:06.232820 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:06.232820 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:06.234458 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79150166-a375-4164-8148-4ef8a2467b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:06.235414 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79150166-a375-4164-8148-4ef8a2467b0a None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:06.235890 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79150166-a375-4164-8148-4ef8a2467b0a None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:06.236352 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79150166-a375-4164-8148-4ef8a2467b0a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:06.238564 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 258/533] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:16:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:06.239528 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea09ae48-6430-4842-a44c-773f8651e449 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:06.245103 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79150166-a375-4164-8148-4ef8a2467b0a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:06.246916 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79150166-a375-4164-8148-4ef8a2467b0a None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:06.261190 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-79150166-a375-4164-8148-4ef8a2467b0a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:16:06.261190 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:06.261190 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:06.261190 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:06.261190 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:06.261190 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:06.261190 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:06.261190 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:06.261190 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:06.261190 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:06.261190 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:06.261190 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:06.261190 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 15:16:06.261190 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 15:16:06.261190 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 15:16:06.262087 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 15:16:06.262087 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:06.262087 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:06.262087 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:06.262087 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:06.262087 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:06.262087 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:06.262087 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:06.262087 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:06.262087 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:06.262087 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:06.262087 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:06.262087 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:06.262087 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:06.262087 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:06.262087 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:06.262087 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:06.262918 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 15:16:06.262918 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 15:16:06.262918 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 15:16:06.262918 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 15:16:06.262918 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 15:16:06.262918 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 15:16:06.262918 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:16:06.262918 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:06.265489 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 276/534] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 2 15:16:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:06.266682 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79150166-a375-4164-8148-4ef8a2467b0a None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:06.352691 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea09ae48-6430-4842-a44c-773f8651e449 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:06.386533 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79150166-a375-4164-8148-4ef8a2467b0a None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:06.387964 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc415a5-5c89-4406-9a23-ab4a4bf104b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:06.388693 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc415a5-5c89-4406-9a23-ab4a4bf104b4 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:06.389075 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc415a5-5c89-4406-9a23-ab4a4bf104b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:06.389448 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc415a5-5c89-4406-9a23-ab4a4bf104b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:06.390674 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc415a5-5c89-4406-9a23-ab4a4bf104b4 None admin] RBAC: Adding query filter params (role.id=532162a00de849cea5c27767c8acd018, scope.project.id=cc19d22b4cd64dd1bc89ed78155d2732, user.id=946af31d75ca41a2a4301e0294cf98f3) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:06.390674 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc415a5-5c89-4406-9a23-ab4a4bf104b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:06.392328 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc415a5-5c89-4406-9a23-ab4a4bf104b4 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:06.399279 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 259/535] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 2 15:16:06 2022] GET /identity/v3/role_assignments?user.id=946af31d75ca41a2a4301e0294cf98f3&scope.project.id=cc19d22b4cd64dd1bc89ed78155d2732&role.id=532162a00de849cea5c27767c8acd018 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:06.400303 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc415a5-5c89-4406-9a23-ab4a4bf104b4 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:06.421227 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:06.432492 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b9c51-6500-4243-80a0-902d1c22caf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:06.433592 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b9c51-6500-4243-80a0-902d1c22caf1 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:06.434022 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b9c51-6500-4243-80a0-902d1c22caf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:06.434591 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b9c51-6500-4243-80a0-902d1c22caf1 None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:06.435545 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96b9c51-6500-4243-80a0-902d1c22caf1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:06.436035 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96b9c51-6500-4243-80a0-902d1c22caf1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:06.437743 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96b9c51-6500-4243-80a0-902d1c22caf1 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:06.460381 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 277/536] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:16:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:06.476787 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b9c51-6500-4243-80a0-902d1c22caf1 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:06.483465 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:06.521609 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc415a5-5c89-4406-9a23-ab4a4bf104b4 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:06.559976 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe7f5f5-3f8a-46b8-8065-3794b2350395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:06.560991 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7f5f5-3f8a-46b8-8065-3794b2350395 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:06.561368 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7f5f5-3f8a-46b8-8065-3794b2350395 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:06.561723 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7f5f5-3f8a-46b8-8065-3794b2350395 None admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:06.562723 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe7f5f5-3f8a-46b8-8065-3794b2350395 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:06.563144 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe7f5f5-3f8a-46b8-8065-3794b2350395 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:06.564756 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe7f5f5-3f8a-46b8-8065-3794b2350395 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:06.580009 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 260/537] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 2 15:16:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:06.586587 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044320c-0eb1-4070-98e7-bb8d2cbec827 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:06.586939 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044320c-0eb1-4070-98e7-bb8d2cbec827 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:06.587315 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044320c-0eb1-4070-98e7-bb8d2cbec827 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:06.589081 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 261/538] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:16:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:16:06.590242 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d044320c-0eb1-4070-98e7-bb8d2cbec827 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:06.603945 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b9c51-6500-4243-80a0-902d1c22caf1 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:06.656282 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecd57ca-576d-4c50-91c7-0a83baf4f6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:06.657031 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd57ca-576d-4c50-91c7-0a83baf4f6cc None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:06.658026 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd57ca-576d-4c50-91c7-0a83baf4f6cc None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:06.658428 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd57ca-576d-4c50-91c7-0a83baf4f6cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:06.670173 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecd57ca-576d-4c50-91c7-0a83baf4f6cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:06.671969 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecd57ca-576d-4c50-91c7-0a83baf4f6cc None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:06.687754 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:06.689057 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-0ecd57ca-576d-4c50-91c7-0a83baf4f6cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:16:06.689057 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:06.689057 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:06.689057 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:06.689057 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:06.689057 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:06.689057 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:06.689057 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:06.689057 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:06.689057 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:06.689057 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:06.689057 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:06.689057 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 15:16:06.689057 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 15:16:06.689057 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 15:16:06.690101 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 15:16:06.690101 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:06.690101 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:06.690101 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:06.690101 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:06.690101 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:06.690101 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:06.690101 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:06.690101 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:06.690101 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:06.690101 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:06.690101 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:06.690101 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:06.690101 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:06.690101 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:06.690101 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:06.690101 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:06.691113 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 15:16:06.691113 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 15:16:06.691113 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 15:16:06.691113 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 15:16:06.691113 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 15:16:06.691113 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 15:16:06.691113 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:16:06.691113 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:06.695602 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 278/539] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 2 15:16:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:06.698299 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbcb822-c2ee-40c6-baba-e51655313fb3 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:06.699104 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbcb822-c2ee-40c6-baba-e51655313fb3 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:06.699550 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbcb822-c2ee-40c6-baba-e51655313fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:06.721750 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-7dbcb822-c2ee-40c6-baba-e51655313fb3 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:16:06.722317 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d044320c-0eb1-4070-98e7-bb8d2cbec827 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:06.723241 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-7dbcb822-c2ee-40c6-baba-e51655313fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:16:06.771553 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db96f9b-50f9-4de7-8fc6-a2e9e0bbbdef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:06.772757 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db96f9b-50f9-4de7-8fc6-a2e9e0bbbdef None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:06.773690 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db96f9b-50f9-4de7-8fc6-a2e9e0bbbdef None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:06.774061 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db96f9b-50f9-4de7-8fc6-a2e9e0bbbdef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:06.775343 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db96f9b-50f9-4de7-8fc6-a2e9e0bbbdef None admin] RBAC: Adding query filter params (role.id=532162a00de849cea5c27767c8acd018, scope.project.id=cc19d22b4cd64dd1bc89ed78155d2732, user.id=8d09126f1821420bb4218b611c89402a) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:06.775763 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db96f9b-50f9-4de7-8fc6-a2e9e0bbbdef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:06.777387 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db96f9b-50f9-4de7-8fc6-a2e9e0bbbdef None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:06.787311 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 262/540] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 2 15:16:06 2022] GET /identity/v3/role_assignments?user.id=8d09126f1821420bb4218b611c89402a&scope.project.id=cc19d22b4cd64dd1bc89ed78155d2732&role.id=532162a00de849cea5c27767c8acd018 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:06.789060 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db96f9b-50f9-4de7-8fc6-a2e9e0bbbdef None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:06.846557 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:06.865494 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 279/541] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:16:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:16:06.913048 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbcb822-c2ee-40c6-baba-e51655313fb3 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:06.966727 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db96f9b-50f9-4de7-8fc6-a2e9e0bbbdef None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:07.021802 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38537cf-22cb-4b7b-ae38-f30c44009fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:07.022453 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38537cf-22cb-4b7b-ae38-f30c44009fca None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:07.022734 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38537cf-22cb-4b7b-ae38-f30c44009fca None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:07.023009 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38537cf-22cb-4b7b-ae38-f30c44009fca None admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:07.023800 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38537cf-22cb-4b7b-ae38-f30c44009fca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:07.024109 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38537cf-22cb-4b7b-ae38-f30c44009fca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:07.025577 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38537cf-22cb-4b7b-ae38-f30c44009fca None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:07.037704 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:07.044627 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 263/542] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 2 15:16:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:07.050533 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38537cf-22cb-4b7b-ae38-f30c44009fca None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:07.076954 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbcb822-c2ee-40c6-baba-e51655313fb3 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:07.130380 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e29ee4-2781-4b27-9743-b6d5e128c125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:07.130962 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e29ee4-2781-4b27-9743-b6d5e128c125 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:07.131277 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e29ee4-2781-4b27-9743-b6d5e128c125 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:07.131560 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e29ee4-2781-4b27-9743-b6d5e128c125 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:07.155780 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e29ee4-2781-4b27-9743-b6d5e128c125 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:16:07.163264 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-72e29ee4-2781-4b27-9743-b6d5e128c125 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 15:16:07.163264 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:07.163264 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:07.163264 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:07.163264 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:07.163264 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:07.163264 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:07.163264 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:07.163264 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:07.163264 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:07.163264 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:07.163264 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:07.163264 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:16:07.163264 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:16:07.163264 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:16:07.163264 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:16:07.164475 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:16:07.164475 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:16:07.164475 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:16:07.164475 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:16:07.164475 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:07.164475 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:07.164475 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:07.164475 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:07.164475 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:07.164475 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:07.164475 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:07.164475 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:07.164475 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:07.164475 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:07.164475 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:07.164475 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:07.165298 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:07.165298 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:07.165298 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:07.165298 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:07.165298 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:16:07.165298 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:16:07.165298 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:16:07.165298 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:16:07.165298 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:16:07.165298 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:16:07.165298 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 15:16:07.165298 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:07.170233 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 280/543] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 2 15:16:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 15:16:07.171171 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e29ee4-2781-4b27-9743-b6d5e128c125 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:07.237207 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38537cf-22cb-4b7b-ae38-f30c44009fca None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:07.279797 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:07.293544 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf4feb2-de88-49d6-98f0-ee1b475bd7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:07.294510 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4feb2-de88-49d6-98f0-ee1b475bd7f7 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:07.294948 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4feb2-de88-49d6-98f0-ee1b475bd7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:07.295400 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4feb2-de88-49d6-98f0-ee1b475bd7f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:07.296326 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf4feb2-de88-49d6-98f0-ee1b475bd7f7 None admin] RBAC: Adding query filter params (role.id=532162a00de849cea5c27767c8acd018, scope.project.id=cc19d22b4cd64dd1bc89ed78155d2732, user.id=f6d1caa34f2b41bfbcc95fa58d85f004) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:07.296796 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf4feb2-de88-49d6-98f0-ee1b475bd7f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:07.298635 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf4feb2-de88-49d6-98f0-ee1b475bd7f7 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:07.305303 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 264/544] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 2 15:16:07 2022] GET /identity/v3/role_assignments?user.id=f6d1caa34f2b41bfbcc95fa58d85f004&scope.project.id=cc19d22b4cd64dd1bc89ed78155d2732&role.id=532162a00de849cea5c27767c8acd018 => generated 259 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:16:07.306909 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efdea5a-0590-47bd-8b6d-784bbfedc4f7 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:07.307370 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efdea5a-0590-47bd-8b6d-784bbfedc4f7 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:07.307892 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efdea5a-0590-47bd-8b6d-784bbfedc4f7 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:07.313882 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 265/545] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:16:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:16:07.315967 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab9c624-73a3-43c4-bcab-aa4916fa4ca7 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:07.316439 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab9c624-73a3-43c4-bcab-aa4916fa4ca7 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:07.316871 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab9c624-73a3-43c4-bcab-aa4916fa4ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:07.334388 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e29ee4-2781-4b27-9743-b6d5e128c125 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:07.351629 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-4ab9c624-73a3-43c4-bcab-aa4916fa4ca7 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:16:07.352879 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-4ab9c624-73a3-43c4-bcab-aa4916fa4ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:16:07.390120 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3971eed7-dded-40ab-aece-6bfcd2563e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:07.390675 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3971eed7-dded-40ab-aece-6bfcd2563e5c None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:07.391026 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3971eed7-dded-40ab-aece-6bfcd2563e5c None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:07.391343 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3971eed7-dded-40ab-aece-6bfcd2563e5c None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:07.392855 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3971eed7-dded-40ab-aece-6bfcd2563e5c None admin] RBAC: Adding query filter params (name=service) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:07.393171 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3971eed7-dded-40ab-aece-6bfcd2563e5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:07.394808 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3971eed7-dded-40ab-aece-6bfcd2563e5c None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:07.405475 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 281/546] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Aug 2 15:16:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:07.414475 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3971eed7-dded-40ab-aece-6bfcd2563e5c None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:07.484957 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:07.490715 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 266/547] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:16:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:16:07.525941 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab9c624-73a3-43c4-bcab-aa4916fa4ca7 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:07.621576 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3971eed7-dded-40ab-aece-6bfcd2563e5c None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:07.671865 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:07.708716 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4165232a-86fc-4af0-9b87-9b3a79d17422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:07.709650 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165232a-86fc-4af0-9b87-9b3a79d17422 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:07.710080 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165232a-86fc-4af0-9b87-9b3a79d17422 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:07.710499 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165232a-86fc-4af0-9b87-9b3a79d17422 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:07.710732 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab9c624-73a3-43c4-bcab-aa4916fa4ca7 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:07.740918 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4165232a-86fc-4af0-9b87-9b3a79d17422 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:07.742725 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4165232a-86fc-4af0-9b87-9b3a79d17422 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:07.753655 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b6ae0e-1796-4b90-8935-e626af4abfa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:07.754316 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b6ae0e-1796-4b90-8935-e626af4abfa9 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:07.754596 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b6ae0e-1796-4b90-8935-e626af4abfa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:07.754941 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b6ae0e-1796-4b90-8935-e626af4abfa9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:07.774127 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-4165232a-86fc-4af0-9b87-9b3a79d17422 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:07.774127 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:07.774127 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:07.774127 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:07.774127 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:07.774127 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:07.774127 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:07.774127 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:07.774127 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:07.774127 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:07.774127 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:07.774127 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:07.774127 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:16:07.774127 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:16:07.774127 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:16:07.775234 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:16:07.775234 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:07.775234 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:07.775234 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:07.775234 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:07.775234 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:07.775234 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:07.775234 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:07.775234 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:07.775234 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:07.775234 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:07.775234 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:07.775234 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:07.775234 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:07.775234 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:07.775234 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:07.775234 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:07.776485 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:16:07.776485 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:16:07.776485 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:07.776485 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:07.777790 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 282/548] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:16:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:07.781405 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b6ae0e-1796-4b90-8935-e626af4abfa9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:16:07.788000 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4165232a-86fc-4af0-9b87-9b3a79d17422 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:07.788927 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-a3b6ae0e-1796-4b90-8935-e626af4abfa9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 15:16:07.788927 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:07.788927 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:07.788927 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:07.788927 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:07.788927 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:07.788927 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:07.788927 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:07.788927 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:07.788927 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:07.788927 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:07.788927 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:07.788927 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:16:07.788927 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:16:07.788927 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:16:07.788927 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:16:07.790300 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:16:07.790300 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:16:07.790300 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:16:07.790300 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:16:07.790300 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:07.790300 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:07.790300 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:07.790300 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:07.790300 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:07.790300 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:07.790300 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:07.790300 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:07.790300 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:07.790300 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:07.790300 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:07.790300 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:07.792101 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:07.792101 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:07.792101 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:07.792101 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:07.792101 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:16:07.792101 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:16:07.792101 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:16:07.792101 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:16:07.792101 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:16:07.792101 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:16:07.792101 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 15:16:07.792101 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:07.799248 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 267/549] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 2 15:16:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:07.799248 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b6ae0e-1796-4b90-8935-e626af4abfa9 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:07.896789 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:07.945935 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b6ae0e-1796-4b90-8935-e626af4abfa9 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:07.980179 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4165232a-86fc-4af0-9b87-9b3a79d17422 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:07.983082 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89481203-43e2-4ff5-a353-ebcbe33613c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:07.983850 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89481203-43e2-4ff5-a353-ebcbe33613c2 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:07.984234 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89481203-43e2-4ff5-a353-ebcbe33613c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:07.984634 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89481203-43e2-4ff5-a353-ebcbe33613c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:07.985462 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89481203-43e2-4ff5-a353-ebcbe33613c2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:07.985871 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89481203-43e2-4ff5-a353-ebcbe33613c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:07.987400 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89481203-43e2-4ff5-a353-ebcbe33613c2 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:07.998836 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 268/550] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Aug 2 15:16:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:08.008416 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89481203-43e2-4ff5-a353-ebcbe33613c2 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:08.027860 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef8f9cb-d8a1-4130-8103-6f3aa7ef6e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:08.028487 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8f9cb-d8a1-4130-8103-6f3aa7ef6e40 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:08.028762 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8f9cb-d8a1-4130-8103-6f3aa7ef6e40 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:08.029035 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8f9cb-d8a1-4130-8103-6f3aa7ef6e40 None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:08.029730 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef8f9cb-d8a1-4130-8103-6f3aa7ef6e40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:08.030030 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef8f9cb-d8a1-4130-8103-6f3aa7ef6e40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:08.031443 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef8f9cb-d8a1-4130-8103-6f3aa7ef6e40 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:08.045313 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 283/551] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:16:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:08.064927 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef8f9cb-d8a1-4130-8103-6f3aa7ef6e40 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:08.098125 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:08.146046 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89481203-43e2-4ff5-a353-ebcbe33613c2 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:08.175674 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef8f9cb-d8a1-4130-8103-6f3aa7ef6e40 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:08.187602 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:08.199017 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b3248-2548-4a78-9370-81494102fde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:08.199715 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b3248-2548-4a78-9370-81494102fde1 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:08.200070 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b3248-2548-4a78-9370-81494102fde1 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:08.200423 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b3248-2548-4a78-9370-81494102fde1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:08.213482 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6b3248-2548-4a78-9370-81494102fde1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:08.215079 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6b3248-2548-4a78-9370-81494102fde1 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:08.227249 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede6b5d3-94b6-4cf1-9dd5-bdf43704b8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:08.227921 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede6b5d3-94b6-4cf1-9dd5-bdf43704b8a7 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:08.228202 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede6b5d3-94b6-4cf1-9dd5-bdf43704b8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:08.228483 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede6b5d3-94b6-4cf1-9dd5-bdf43704b8a7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:08.231711 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-1e6b3248-2548-4a78-9370-81494102fde1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:08.231711 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:08.231711 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:08.231711 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:08.231711 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:08.231711 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:08.231711 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:08.231711 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:08.231711 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:08.231711 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:08.231711 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:08.231711 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:08.231711 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:16:08.231711 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:16:08.231711 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:16:08.232660 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:16:08.232660 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:08.232660 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:08.232660 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:08.232660 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:08.232660 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:08.232660 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:08.232660 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:08.232660 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:08.232660 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:08.232660 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:08.232660 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:08.232660 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:08.232660 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:08.232660 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:08.232660 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:08.232660 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:08.233614 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:16:08.233614 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:16:08.233614 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:08.233614 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:08.233614 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 269/552] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:16:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:08.236437 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede6b5d3-94b6-4cf1-9dd5-bdf43704b8a7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:08.237929 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede6b5d3-94b6-4cf1-9dd5-bdf43704b8a7 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:08.238694 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b3248-2548-4a78-9370-81494102fde1 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:08.252714 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-ede6b5d3-94b6-4cf1-9dd5-bdf43704b8a7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 02 15:16:08.252714 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:08.252714 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:08.252714 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:08.252714 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:08.252714 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:08.252714 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:08.252714 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:08.252714 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:08.252714 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:08.252714 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:08.252714 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:08.252714 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 15:16:08.252714 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 15:16:08.252714 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 15:16:08.252714 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 15:16:08.253710 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:08.253710 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:08.253710 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 15:16:08.253710 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:16:08.253710 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 15:16:08.253710 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:16:08.253710 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:08.253710 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:08.253710 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:08.253710 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:08.253710 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:08.253710 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:08.253710 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:08.253710 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:08.253710 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:08.253710 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:08.253710 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:08.253710 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:08.259930 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:08.259930 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:08.259930 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 15:16:08.259930 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 15:16:08.259930 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 15:16:08.259930 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 15:16:08.259930 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 15:16:08.259930 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 15:16:08.259930 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 02 15:16:08.259930 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:08.259930 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 284/553] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 2 15:16:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 15:16:08.263496 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede6b5d3-94b6-4cf1-9dd5-bdf43704b8a7 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:08.382151 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:08.396124 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede6b5d3-94b6-4cf1-9dd5-bdf43704b8a7 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:08.433685 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b3248-2548-4a78-9370-81494102fde1 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:08.439143 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb913df-615e-4765-aed9-dba564912cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:08.440137 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb913df-615e-4765-aed9-dba564912cbe None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:08.440889 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb913df-615e-4765-aed9-dba564912cbe None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:08.441484 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb913df-615e-4765-aed9-dba564912cbe None admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:08.442616 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb913df-615e-4765-aed9-dba564912cbe None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:08.443240 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb913df-615e-4765-aed9-dba564912cbe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:08.444916 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb913df-615e-4765-aed9-dba564912cbe None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:08.465435 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 285/554] 10.222.0.42 () {56 vars in 1135 bytes} [Tue Aug 2 15:16:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:16:08.471035 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb913df-615e-4765-aed9-dba564912cbe None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:08.526398 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588653d9-2a4a-4321-b1c6-bc7d139b2c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:08.527031 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588653d9-2a4a-4321-b1c6-bc7d139b2c2d None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:08.527336 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588653d9-2a4a-4321-b1c6-bc7d139b2c2d None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:08.527619 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588653d9-2a4a-4321-b1c6-bc7d139b2c2d None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:08.528304 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588653d9-2a4a-4321-b1c6-bc7d139b2c2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:08.528606 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588653d9-2a4a-4321-b1c6-bc7d139b2c2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:08.530007 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588653d9-2a4a-4321-b1c6-bc7d139b2c2d None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:08.565509 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 270/555] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:16:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:08.572385 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588653d9-2a4a-4321-b1c6-bc7d139b2c2d None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:08.596368 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb913df-615e-4765-aed9-dba564912cbe None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:08.645236 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:08.679259 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85026f1c-da18-4218-b721-0e4406db213b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:08.679887 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85026f1c-da18-4218-b721-0e4406db213b None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:08.680170 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85026f1c-da18-4218-b721-0e4406db213b None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:08.680445 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85026f1c-da18-4218-b721-0e4406db213b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:08.735681 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:08.754646 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588653d9-2a4a-4321-b1c6-bc7d139b2c2d None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:08.796988 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85026f1c-da18-4218-b721-0e4406db213b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:08.798500 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85026f1c-da18-4218-b721-0e4406db213b None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:08.817989 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b280eada-e8bc-47e2-b270-43715a8fcce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:08.818638 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280eada-e8bc-47e2-b270-43715a8fcce0 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:08.818918 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280eada-e8bc-47e2-b270-43715a8fcce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:08.819262 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280eada-e8bc-47e2-b270-43715a8fcce0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:08.831954 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b280eada-e8bc-47e2-b270-43715a8fcce0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:08.833453 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b280eada-e8bc-47e2-b270-43715a8fcce0 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:08.856866 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-b280eada-e8bc-47e2-b270-43715a8fcce0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 15:16:08.856866 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:08.856866 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:08.856866 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:08.856866 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:08.856866 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:08.856866 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:08.856866 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:08.856866 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:08.856866 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:08.856866 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:08.856866 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:08.856866 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 15:16:08.856866 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 15:16:08.856866 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 15:16:08.856866 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 15:16:08.858382 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:08.858382 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:08.858382 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 15:16:08.858382 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:16:08.858382 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 15:16:08.858382 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:16:08.858382 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:08.858382 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:08.858382 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:08.858382 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:08.858382 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:08.858382 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:08.858382 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:08.858382 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:08.858382 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:08.858382 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:08.858382 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:08.858382 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:08.859332 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:08.859332 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:08.859332 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 15:16:08.859332 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 15:16:08.859332 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 15:16:08.859332 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 15:16:08.859332 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 15:16:08.859332 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 15:16:08.859332 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 15:16:08.859332 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:08.869542 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 271/556] 10.222.0.42 () {56 vars in 1093 bytes} [Tue Aug 2 15:16:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:08.876939 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b280eada-e8bc-47e2-b270-43715a8fcce0 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:08.915854 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 286/557] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 2 15:16:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 02 15:16:08.921344 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85026f1c-da18-4218-b721-0e4406db213b None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:08.978749 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:09.033571 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:09.045732 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85026f1c-da18-4218-b721-0e4406db213b None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:09.063700 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b280eada-e8bc-47e2-b270-43715a8fcce0 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:09.096626 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87728cfd-f40a-4e52-b9a3-7d57aa62d104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:09.097887 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87728cfd-f40a-4e52-b9a3-7d57aa62d104 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:09.098661 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87728cfd-f40a-4e52-b9a3-7d57aa62d104 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:09.099590 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87728cfd-f40a-4e52-b9a3-7d57aa62d104 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:09.104240 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d0917-a0db-4ca1-aff6-027a6ba32562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:09.104902 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d0917-a0db-4ca1-aff6-027a6ba32562 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:09.105286 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d0917-a0db-4ca1-aff6-027a6ba32562 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:09.105574 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d0917-a0db-4ca1-aff6-027a6ba32562 None admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:09.106373 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843d0917-a0db-4ca1-aff6-027a6ba32562 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:09.106681 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843d0917-a0db-4ca1-aff6-027a6ba32562 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:09.108217 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843d0917-a0db-4ca1-aff6-027a6ba32562 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:09.114141 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87728cfd-f40a-4e52-b9a3-7d57aa62d104 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:09.116253 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87728cfd-f40a-4e52-b9a3-7d57aa62d104 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:09.127839 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 272/558] 10.222.0.42 () {56 vars in 1133 bytes} [Tue Aug 2 15:16:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:16:09.129218 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29426c4-bc12-44be-92f2-4b4d6da74831 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:09.129509 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29426c4-bc12-44be-92f2-4b4d6da74831 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:09.130315 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29426c4-bc12-44be-92f2-4b4d6da74831 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:09.135690 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 273/559] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:16:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:16:09.135690 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29426c4-bc12-44be-92f2-4b4d6da74831 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:09.142473 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-87728cfd-f40a-4e52-b9a3-7d57aa62d104 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:09.142473 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:09.142473 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:09.142473 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:09.142473 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:09.142473 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:09.142473 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:09.142473 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:09.142473 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:09.142473 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:09.142473 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:09.142473 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:09.142473 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:16:09.142473 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:16:09.142473 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:16:09.143431 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:16:09.143431 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:09.143431 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:09.143431 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:09.143431 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:09.143431 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:09.143431 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:09.143431 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:09.143431 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:09.143431 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:09.143431 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:09.143431 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:09.143431 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:09.143431 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:09.143431 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:09.143431 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:09.143431 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:09.144317 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:16:09.144317 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:16:09.144317 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:09.144317 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:09.147644 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 287/560] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:16:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:09.149192 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa130b-0214-4ea8-82bd-0815b3232339 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:09.149728 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa130b-0214-4ea8-82bd-0815b3232339 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:09.150207 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa130b-0214-4ea8-82bd-0815b3232339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:09.184323 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-9daa130b-0214-4ea8-82bd-0815b3232339 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:16:09.187172 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-9daa130b-0214-4ea8-82bd-0815b3232339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:16:09.286195 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 288/561] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:16:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:16:09.287878 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa130b-0214-4ea8-82bd-0815b3232339 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:09.299568 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29426c4-bc12-44be-92f2-4b4d6da74831 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:09.334914 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:09.356942 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af1cac9-5a9d-4c84-9c2b-f3aeee24555d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:09.357751 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1cac9-5a9d-4c84-9c2b-f3aeee24555d None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:09.358138 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1cac9-5a9d-4c84-9c2b-f3aeee24555d None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:09.358517 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1cac9-5a9d-4c84-9c2b-f3aeee24555d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:09.371072 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af1cac9-5a9d-4c84-9c2b-f3aeee24555d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:09.372753 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af1cac9-5a9d-4c84-9c2b-f3aeee24555d None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:09.382513 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:09.391550 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-0af1cac9-5a9d-4c84-9c2b-f3aeee24555d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:09.391550 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:09.391550 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:09.391550 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:09.391550 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:09.391550 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:09.391550 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:09.391550 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:09.391550 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:09.391550 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:09.391550 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:09.391550 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:09.391550 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:16:09.391550 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:16:09.391550 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:16:09.392471 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:16:09.392471 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:09.392471 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:09.392471 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:09.392471 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:09.392471 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:09.392471 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:09.392471 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:09.392471 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:09.392471 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:09.392471 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:09.392471 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:09.392471 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:09.392471 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:09.392471 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:09.392471 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:09.392471 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:09.393405 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:16:09.393405 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:16:09.393405 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:09.393405 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:09.393405 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 274/562] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:16:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:09.393668 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af1cac9-5a9d-4c84-9c2b-f3aeee24555d None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:09.428058 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa130b-0214-4ea8-82bd-0815b3232339 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:09.470841 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac47f4bb-8aeb-4af0-81c6-77c4af57ee2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:09.471506 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47f4bb-8aeb-4af0-81c6-77c4af57ee2e None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:09.471778 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47f4bb-8aeb-4af0-81c6-77c4af57ee2e None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:09.472052 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47f4bb-8aeb-4af0-81c6-77c4af57ee2e None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:09.472752 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac47f4bb-8aeb-4af0-81c6-77c4af57ee2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:09.473060 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac47f4bb-8aeb-4af0-81c6-77c4af57ee2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:09.475027 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac47f4bb-8aeb-4af0-81c6-77c4af57ee2e None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:09.486596 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 289/563] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:16:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:09.487925 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b0d48-a886-48d9-b872-c4d2bc17d025 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:09.488221 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b0d48-a886-48d9-b872-c4d2bc17d025 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:09.488503 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b0d48-a886-48d9-b872-c4d2bc17d025 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:09.489927 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 290/564] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:16:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:16:09.490542 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b0d48-a886-48d9-b872-c4d2bc17d025 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:09.512398 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af1cac9-5a9d-4c84-9c2b-f3aeee24555d None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:09.555919 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd97ac-8adf-41d4-94f3-eee9a22cc5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:09.556477 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd97ac-8adf-41d4-94f3-eee9a22cc5ee None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:09.556798 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd97ac-8adf-41d4-94f3-eee9a22cc5ee None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:09.557031 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd97ac-8adf-41d4-94f3-eee9a22cc5ee None admin] PATH_INFO: `/v3/roles/service` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:09.569791 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcd97ac-8adf-41d4-94f3-eee9a22cc5ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:16:09.575121 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-abcd97ac-8adf-41d4-94f3-eee9a22cc5ee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 15:16:09.575121 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:09.575121 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:09.575121 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:09.575121 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:09.575121 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:09.575121 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:09.575121 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:09.575121 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:09.575121 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:09.575121 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:09.575121 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:09.575121 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:16:09.575121 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:16:09.575121 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:16:09.575121 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:16:09.576319 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:16:09.576319 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:16:09.576319 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:16:09.576319 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:16:09.576319 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:09.576319 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:09.576319 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:09.576319 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:09.576319 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:09.576319 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:09.576319 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:09.576319 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:09.576319 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:09.576319 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:09.576319 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:09.576319 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:09.577972 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:09.577972 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:09.577972 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:09.577972 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:09.577972 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:16:09.577972 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:16:09.577972 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:16:09.577972 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:16:09.577972 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:16:09.577972 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:16:09.577972 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 15:16:09.577972 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:09.579372 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 275/565] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 2 15:16:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:09.580450 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd97ac-8adf-41d4-94f3-eee9a22cc5ee None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:09.588497 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:09.602149 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b0d48-a886-48d9-b872-c4d2bc17d025 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:09.637905 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67064935-5871-4c72-a16d-57fbd8c4d5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:09.638533 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67064935-5871-4c72-a16d-57fbd8c4d5ad None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:09.638806 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67064935-5871-4c72-a16d-57fbd8c4d5ad None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:09.639078 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67064935-5871-4c72-a16d-57fbd8c4d5ad None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:09.639802 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67064935-5871-4c72-a16d-57fbd8c4d5ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:09.640103 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67064935-5871-4c72-a16d-57fbd8c4d5ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:09.641484 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67064935-5871-4c72-a16d-57fbd8c4d5ad None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:09.643412 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:09.655096 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 291/566] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:16:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:09.656389 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cddbce-6ef9-4385-a7f6-b314dc2e7eff None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:09.656675 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cddbce-6ef9-4385-a7f6-b314dc2e7eff None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:09.656955 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cddbce-6ef9-4385-a7f6-b314dc2e7eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:09.676106 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-77cddbce-6ef9-4385-a7f6-b314dc2e7eff None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:16:09.677459 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-77cddbce-6ef9-4385-a7f6-b314dc2e7eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:16:09.690069 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd97ac-8adf-41d4-94f3-eee9a22cc5ee None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:09.725525 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c22a1e8-004b-4777-bb59-2a261d7047d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:09.726172 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22a1e8-004b-4777-bb59-2a261d7047d0 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:09.726458 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22a1e8-004b-4777-bb59-2a261d7047d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:09.726735 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22a1e8-004b-4777-bb59-2a261d7047d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:09.733861 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c22a1e8-004b-4777-bb59-2a261d7047d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:09.735352 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c22a1e8-004b-4777-bb59-2a261d7047d0 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:09.752814 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-8c22a1e8-004b-4777-bb59-2a261d7047d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:16:09.752814 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:09.752814 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:09.752814 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:09.752814 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:09.752814 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:09.752814 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:09.752814 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:09.752814 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:09.752814 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:09.752814 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:09.752814 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:09.752814 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 15:16:09.752814 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 15:16:09.752814 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 15:16:09.753916 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 15:16:09.753916 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:09.753916 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:09.753916 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:09.753916 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:09.753916 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:09.753916 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:09.753916 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:09.753916 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:09.753916 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:09.753916 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:09.753916 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:09.753916 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:09.753916 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:09.753916 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:09.753916 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:09.753916 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:09.755484 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 15:16:09.755484 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 15:16:09.755484 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 15:16:09.755484 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 15:16:09.755484 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 15:16:09.755484 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 15:16:09.755484 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:16:09.755484 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:09.757880 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 292/567] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:16:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:16:09.759342 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762a414-66e3-4053-919b-1beab10c33e7 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:09.759555 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 276/568] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 2 15:16:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:09.759765 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762a414-66e3-4053-919b-1beab10c33e7 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:09.760010 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762a414-66e3-4053-919b-1beab10c33e7 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:09.760271 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c22a1e8-004b-4777-bb59-2a261d7047d0 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:09.761456 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 293/569] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:16:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:16:09.764033 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762a414-66e3-4053-919b-1beab10c33e7 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:09.848526 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:09.872068 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762a414-66e3-4053-919b-1beab10c33e7 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:09.878177 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c22a1e8-004b-4777-bb59-2a261d7047d0 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:09.896864 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:09.908032 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab8aa1-a700-4a2b-b05b-ae6bc425692a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:09.908681 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab8aa1-a700-4a2b-b05b-ae6bc425692a None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:09.908956 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab8aa1-a700-4a2b-b05b-ae6bc425692a None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:09.909226 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab8aa1-a700-4a2b-b05b-ae6bc425692a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:09.915800 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a3f0de-c68b-455d-ac60-ffe464431525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:09.916447 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a3f0de-c68b-455d-ac60-ffe464431525 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:09.916600 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab8aa1-a700-4a2b-b05b-ae6bc425692a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:09.916696 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a3f0de-c68b-455d-ac60-ffe464431525 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:09.916957 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a3f0de-c68b-455d-ac60-ffe464431525 None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:09.917664 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a3f0de-c68b-455d-ac60-ffe464431525 None admin] RBAC: Adding query filter params (name=service) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:09.917919 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab8aa1-a700-4a2b-b05b-ae6bc425692a None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:09.918050 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a3f0de-c68b-455d-ac60-ffe464431525 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:09.919362 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a3f0de-c68b-455d-ac60-ffe464431525 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:09.928125 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 277/570] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Aug 2 15:16:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:09.928953 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a3f0de-c68b-455d-ac60-ffe464431525 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:09.929914 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-96ab8aa1-a700-4a2b-b05b-ae6bc425692a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:16:09.929914 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:09.929914 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:09.929914 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:09.929914 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:09.929914 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:09.929914 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:09.929914 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:09.929914 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:09.929914 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:09.929914 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:09.929914 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:09.929914 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 15:16:09.929914 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 15:16:09.929914 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 15:16:09.930902 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 15:16:09.930902 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:09.930902 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:09.930902 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:09.930902 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:09.930902 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:09.930902 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:09.930902 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:09.930902 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:09.930902 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:09.930902 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:09.930902 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:09.930902 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:09.930902 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:09.930902 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:09.930902 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:09.930902 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:09.932383 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 15:16:09.932383 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 15:16:09.932383 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 15:16:09.932383 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 15:16:09.932383 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 15:16:09.932383 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 15:16:09.932383 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:16:09.932383 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:09.932383 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 294/571] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 2 15:16:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:09.937107 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad8b30-1a48-4807-a34a-f2dd20124cad None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:09.937441 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad8b30-1a48-4807-a34a-f2dd20124cad None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:09.937756 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad8b30-1a48-4807-a34a-f2dd20124cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:09.956877 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-d0ad8b30-1a48-4807-a34a-f2dd20124cad None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:16:09.958283 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-d0ad8b30-1a48-4807-a34a-f2dd20124cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:16:10.031815 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 295/572] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:16:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:16:10.032871 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad8b30-1a48-4807-a34a-f2dd20124cad None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:10.040741 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a3f0de-c68b-455d-ac60-ffe464431525 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:10.077812 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a197d8-fb52-4b13-ac24-7702c81aafd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:10.078425 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a197d8-fb52-4b13-ac24-7702c81aafd5 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:10.078708 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a197d8-fb52-4b13-ac24-7702c81aafd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:10.078980 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a197d8-fb52-4b13-ac24-7702c81aafd5 None admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:10.079764 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a197d8-fb52-4b13-ac24-7702c81aafd5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:10.080067 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a197d8-fb52-4b13-ac24-7702c81aafd5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:10.082010 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a197d8-fb52-4b13-ac24-7702c81aafd5 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:10.094658 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 278/573] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 2 15:16:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:10.095546 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a197d8-fb52-4b13-ac24-7702c81aafd5 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:10.109820 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:10.146592 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:10.147850 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad8b30-1a48-4807-a34a-f2dd20124cad None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:10.188127 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1293d547-6116-4333-a6ab-f52b9ca84fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:10.188887 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293d547-6116-4333-a6ab-f52b9ca84fa3 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:10.189076 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293d547-6116-4333-a6ab-f52b9ca84fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:10.189350 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293d547-6116-4333-a6ab-f52b9ca84fa3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:10.200395 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1293d547-6116-4333-a6ab-f52b9ca84fa3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:16:10.205359 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-1293d547-6116-4333-a6ab-f52b9ca84fa3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 15:16:10.205359 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:10.205359 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:10.205359 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:10.205359 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:10.205359 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:10.205359 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:10.205359 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:10.205359 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:10.205359 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:10.205359 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:10.205359 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:10.205359 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:16:10.205359 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:16:10.205359 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:16:10.205359 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:16:10.206283 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:16:10.206283 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:16:10.206283 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:16:10.206283 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:16:10.206283 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:10.206283 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:10.206283 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:10.206283 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:10.206283 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:10.206283 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:10.206283 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:10.206283 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:10.206283 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:10.206283 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:10.206283 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:10.206283 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:10.207113 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:10.207113 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:10.207113 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:10.207113 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:10.207113 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:16:10.207113 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:16:10.207113 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:16:10.207113 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:16:10.207113 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:16:10.207113 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:16:10.207113 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 15:16:10.207113 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:10.207113 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 296/574] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 2 15:16:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:10.207828 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1293d547-6116-4333-a6ab-f52b9ca84fa3 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:10.214803 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a197d8-fb52-4b13-ac24-7702c81aafd5 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:10.251955 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d63d0-3fde-4f9f-a7c5-4ed8688f9669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:10.252613 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d63d0-3fde-4f9f-a7c5-4ed8688f9669 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:10.252891 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d63d0-3fde-4f9f-a7c5-4ed8688f9669 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:10.253165 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d63d0-3fde-4f9f-a7c5-4ed8688f9669 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:10.264073 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d63d0-3fde-4f9f-a7c5-4ed8688f9669 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:10.265523 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d63d0-3fde-4f9f-a7c5-4ed8688f9669 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:10.281898 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-8d1d63d0-3fde-4f9f-a7c5-4ed8688f9669 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:10.281898 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:10.281898 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:10.281898 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:10.281898 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:10.281898 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:10.281898 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:10.281898 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:10.281898 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:10.281898 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:10.281898 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:10.281898 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:10.281898 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:16:10.281898 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:16:10.281898 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:16:10.283107 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:16:10.283107 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:10.283107 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:10.283107 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:10.283107 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:10.283107 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:10.283107 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:10.283107 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:10.283107 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:10.283107 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:10.283107 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:10.283107 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:10.283107 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:10.283107 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:10.283107 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:10.283107 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:10.283107 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:10.284068 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:16:10.284068 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:16:10.284068 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:10.284068 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:10.284068 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 279/575] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:16:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:10.284068 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d63d0-3fde-4f9f-a7c5-4ed8688f9669 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:10.321753 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1293d547-6116-4333-a6ab-f52b9ca84fa3 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:10.349739 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:10.358500 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a6795b-f0e4-4779-a3bb-912a625908f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:10.359272 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a6795b-f0e4-4779-a3bb-912a625908f7 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:10.359443 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a6795b-f0e4-4779-a3bb-912a625908f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:10.359724 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a6795b-f0e4-4779-a3bb-912a625908f7 None admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:10.360531 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a6795b-f0e4-4779-a3bb-912a625908f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:10.360794 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a6795b-f0e4-4779-a3bb-912a625908f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:10.362259 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a6795b-f0e4-4779-a3bb-912a625908f7 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:10.375334 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 297/576] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 2 15:16:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:10.376200 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a6795b-f0e4-4779-a3bb-912a625908f7 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:10.385128 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:10.394139 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d63d0-3fde-4f9f-a7c5-4ed8688f9669 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:10.432309 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4802fb-dfdd-4b21-93aa-52af6094e18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:10.432954 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4802fb-dfdd-4b21-93aa-52af6094e18b None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:10.433226 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4802fb-dfdd-4b21-93aa-52af6094e18b None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:10.433500 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4802fb-dfdd-4b21-93aa-52af6094e18b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:10.444521 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4802fb-dfdd-4b21-93aa-52af6094e18b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:16:10.449908 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-6a4802fb-dfdd-4b21-93aa-52af6094e18b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 15:16:10.449908 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:10.449908 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:10.449908 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:10.449908 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:10.449908 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:10.449908 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:10.449908 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:10.449908 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:10.449908 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:10.449908 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:10.449908 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:10.449908 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:16:10.449908 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:16:10.449908 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:16:10.449908 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:16:10.450880 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:16:10.450880 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:16:10.450880 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:16:10.450880 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:16:10.450880 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:10.450880 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:10.450880 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:10.450880 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:10.450880 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:10.450880 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:10.450880 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:10.450880 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:10.450880 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:10.450880 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:10.450880 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:10.450880 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:10.452327 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:10.452327 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:10.452327 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:10.452327 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:10.452327 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:16:10.452327 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:16:10.452327 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:16:10.452327 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:16:10.452327 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:16:10.452327 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:16:10.452327 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 15:16:10.452327 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:10.452327 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 280/577] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 2 15:16:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:10.452327 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4802fb-dfdd-4b21-93aa-52af6094e18b None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:10.498304 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a6795b-f0e4-4779-a3bb-912a625908f7 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:10.534389 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97225c6d-9219-4e88-b8be-35bb7948817f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:10.535291 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97225c6d-9219-4e88-b8be-35bb7948817f None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:10.535582 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97225c6d-9219-4e88-b8be-35bb7948817f None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:10.536467 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97225c6d-9219-4e88-b8be-35bb7948817f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:10.537391 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97225c6d-9219-4e88-b8be-35bb7948817f None admin] RBAC: Adding query filter params (role.id=532162a00de849cea5c27767c8acd018, scope.project.id=cc19d22b4cd64dd1bc89ed78155d2732, user.id=6f4de590df474c8b95f2b1193f7dbcb5) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:10.537702 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97225c6d-9219-4e88-b8be-35bb7948817f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:10.539516 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97225c6d-9219-4e88-b8be-35bb7948817f None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:10.545866 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 298/578] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 2 15:16:10 2022] GET /identity/v3/role_assignments?user.id=6f4de590df474c8b95f2b1193f7dbcb5&scope.project.id=cc19d22b4cd64dd1bc89ed78155d2732&role.id=532162a00de849cea5c27767c8acd018 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:10.546679 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97225c6d-9219-4e88-b8be-35bb7948817f None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:10.570435 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4802fb-dfdd-4b21-93aa-52af6094e18b None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:10.614192 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:10.622860 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bac590-4727-455c-8e40-3ee2d5aa26a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:10.623752 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bac590-4727-455c-8e40-3ee2d5aa26a3 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:10.623910 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bac590-4727-455c-8e40-3ee2d5aa26a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:10.624054 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bac590-4727-455c-8e40-3ee2d5aa26a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:10.624797 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bac590-4727-455c-8e40-3ee2d5aa26a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:10.625175 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bac590-4727-455c-8e40-3ee2d5aa26a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:10.626525 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bac590-4727-455c-8e40-3ee2d5aa26a3 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:10.637049 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 281/579] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Aug 2 15:16:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:10.638071 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bac590-4727-455c-8e40-3ee2d5aa26a3 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:10.657475 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:10.683655 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97225c6d-9219-4e88-b8be-35bb7948817f None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:10.732375 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b9b42-1da1-4be1-8e3a-1d435034ed72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:10.733009 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b9b42-1da1-4be1-8e3a-1d435034ed72 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:10.733299 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b9b42-1da1-4be1-8e3a-1d435034ed72 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:10.733572 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b9b42-1da1-4be1-8e3a-1d435034ed72 None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:10.734268 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46b9b42-1da1-4be1-8e3a-1d435034ed72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:10.734575 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46b9b42-1da1-4be1-8e3a-1d435034ed72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:10.736091 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46b9b42-1da1-4be1-8e3a-1d435034ed72 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:10.749125 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 299/580] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:16:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:10.750052 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b9b42-1da1-4be1-8e3a-1d435034ed72 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:10.771752 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bac590-4727-455c-8e40-3ee2d5aa26a3 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:10.822746 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d3eea-b6b2-4aa1-a3a7-b2dc4083e4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:10.824204 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d3eea-b6b2-4aa1-a3a7-b2dc4083e4c2 None admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:10.824667 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d3eea-b6b2-4aa1-a3a7-b2dc4083e4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:10.825123 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d3eea-b6b2-4aa1-a3a7-b2dc4083e4c2 None admin] PATH_INFO: `/v3/projects/cc19d22b4cd64dd1bc89ed78155d2732/users/4c0865af59bf43dfa4c84213d7db53c5/roles/532162a00de849cea5c27767c8acd018` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:10.849296 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78d3eea-b6b2-4aa1-a3a7-b2dc4083e4c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=cc19d22b4cd64dd1bc89ed78155d2732, user_id=4c0865af59bf43dfa4c84213d7db53c5, role_id=532162a00de849cea5c27767c8acd018)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:10.852076 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78d3eea-b6b2-4aa1-a3a7-b2dc4083e4c2 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:10.883332 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 282/581] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 2 15:16:10 2022] PUT /identity/v3/projects/cc19d22b4cd64dd1bc89ed78155d2732/users/4c0865af59bf43dfa4c84213d7db53c5/roles/532162a00de849cea5c27767c8acd018 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:16:10.883332 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d3eea-b6b2-4aa1-a3a7-b2dc4083e4c2 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:10.917800 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b9b42-1da1-4be1-8e3a-1d435034ed72 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:10.934581 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:10.963087 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:10.965626 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee582077-5628-4fbf-a6e9-eedf0eb762ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:10.966604 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee582077-5628-4fbf-a6e9-eedf0eb762ee None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:10.967110 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee582077-5628-4fbf-a6e9-eedf0eb762ee None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:10.967600 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee582077-5628-4fbf-a6e9-eedf0eb762ee None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:10.968592 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee582077-5628-4fbf-a6e9-eedf0eb762ee None admin] RBAC: Adding query filter params (name=service) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:10.969225 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee582077-5628-4fbf-a6e9-eedf0eb762ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:10.972332 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee582077-5628-4fbf-a6e9-eedf0eb762ee None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:10.984783 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 300/582] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Aug 2 15:16:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:10.986405 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee582077-5628-4fbf-a6e9-eedf0eb762ee None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:11.040004 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d3eea-b6b2-4aa1-a3a7-b2dc4083e4c2 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:11.102344 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a1f77-ca0b-434a-be68-a977e2e21877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:11.103664 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a1f77-ca0b-434a-be68-a977e2e21877 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:11.104279 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a1f77-ca0b-434a-be68-a977e2e21877 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:11.104905 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a1f77-ca0b-434a-be68-a977e2e21877 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:11.121530 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31a1f77-ca0b-434a-be68-a977e2e21877 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:11.124560 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31a1f77-ca0b-434a-be68-a977e2e21877 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:11.151141 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-b31a1f77-ca0b-434a-be68-a977e2e21877 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:11.151141 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:11.151141 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:11.151141 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:11.151141 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:11.151141 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:11.151141 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:11.151141 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:11.151141 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:11.151141 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:11.151141 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:11.151141 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:11.151141 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:16:11.151141 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:16:11.151141 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:16:11.152265 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:16:11.152265 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:11.152265 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:11.152265 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:11.152265 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:11.152265 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:11.152265 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:11.152265 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:11.152265 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:11.152265 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:11.152265 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:11.152265 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:11.152265 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:11.152265 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:11.152265 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:11.152265 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:11.152265 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:11.153362 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:16:11.153362 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:16:11.153362 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:11.153362 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:11.155347 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 283/583] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:16:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:11.157822 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a1f77-ca0b-434a-be68-a977e2e21877 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:11.161584 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee582077-5628-4fbf-a6e9-eedf0eb762ee None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:11.203327 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4f744-265c-4d16-92f5-82ff38c75044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:11.203993 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4f744-265c-4d16-92f5-82ff38c75044 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:11.203993 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4f744-265c-4d16-92f5-82ff38c75044 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:11.204178 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4f744-265c-4d16-92f5-82ff38c75044 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:11.214251 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa4f744-265c-4d16-92f5-82ff38c75044 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:11.215920 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa4f744-265c-4d16-92f5-82ff38c75044 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:11.230714 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-7fa4f744-265c-4d16-92f5-82ff38c75044 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 02 15:16:11.230714 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:11.230714 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:11.230714 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:11.230714 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:11.230714 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:11.230714 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:11.230714 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:11.230714 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:11.230714 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:11.230714 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:11.230714 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:11.230714 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 15:16:11.230714 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 15:16:11.230714 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 15:16:11.230714 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 15:16:11.231770 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:11.231770 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:11.231770 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 15:16:11.231770 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:16:11.231770 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 15:16:11.231770 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:16:11.231770 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:11.231770 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:11.231770 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:11.231770 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:11.231770 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:11.231770 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:11.231770 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:11.231770 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:11.231770 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:11.231770 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:11.231770 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:11.231770 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:11.232731 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:11.232731 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:11.232731 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 15:16:11.232731 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 15:16:11.232731 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 15:16:11.232731 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 15:16:11.232731 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 15:16:11.232731 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 15:16:11.232731 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 02 15:16:11.232731 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:11.232731 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 301/584] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 2 15:16:10 2022] GET /identity/v3/users/glance => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:11.233324 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4f744-265c-4d16-92f5-82ff38c75044 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:11.278051 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:11.282409 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a1f77-ca0b-434a-be68-a977e2e21877 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:11.301032 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:11.330755 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af8e2ab-5eb2-458d-ad3e-6aa7788fb738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:11.331869 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8e2ab-5eb2-458d-ad3e-6aa7788fb738 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:11.332466 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8e2ab-5eb2-458d-ad3e-6aa7788fb738 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:11.333783 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8e2ab-5eb2-458d-ad3e-6aa7788fb738 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:11.346369 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af8e2ab-5eb2-458d-ad3e-6aa7788fb738 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:11.348200 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af8e2ab-5eb2-458d-ad3e-6aa7788fb738 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:11.359756 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4f744-265c-4d16-92f5-82ff38c75044 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:11.365786 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-1af8e2ab-5eb2-458d-ad3e-6aa7788fb738 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:11.365786 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:11.365786 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:11.365786 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:11.365786 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:11.365786 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:11.365786 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:11.365786 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:11.365786 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:11.365786 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:11.365786 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:11.365786 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:11.365786 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:16:11.365786 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:16:11.365786 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:16:11.366710 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:16:11.366710 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:11.366710 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:11.366710 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:11.366710 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:11.366710 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:11.366710 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:11.366710 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:11.366710 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:11.366710 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:11.366710 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:11.366710 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:11.366710 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:11.366710 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:11.366710 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:11.366710 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:11.366710 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:11.367727 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:16:11.367727 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:16:11.367727 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:11.367727 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:11.370638 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 284/585] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:16:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:11.372045 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af8e2ab-5eb2-458d-ad3e-6aa7788fb738 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:11.398888 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58136d20-0318-4e93-bbe9-0b39b37fc46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:11.399659 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58136d20-0318-4e93-bbe9-0b39b37fc46d None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:11.399960 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58136d20-0318-4e93-bbe9-0b39b37fc46d None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:11.400549 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58136d20-0318-4e93-bbe9-0b39b37fc46d None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:11.401023 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58136d20-0318-4e93-bbe9-0b39b37fc46d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:11.401389 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58136d20-0318-4e93-bbe9-0b39b37fc46d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:11.402859 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58136d20-0318-4e93-bbe9-0b39b37fc46d None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:11.419101 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 302/586] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:16:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:11.419992 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58136d20-0318-4e93-bbe9-0b39b37fc46d None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:11.486292 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af8e2ab-5eb2-458d-ad3e-6aa7788fb738 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:11.524412 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128fafba-4bae-4543-9a43-a25e343636e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:11.525439 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128fafba-4bae-4543-9a43-a25e343636e6 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:11.525925 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128fafba-4bae-4543-9a43-a25e343636e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:11.526401 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128fafba-4bae-4543-9a43-a25e343636e6 None admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:11.527503 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128fafba-4bae-4543-9a43-a25e343636e6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:11.528056 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128fafba-4bae-4543-9a43-a25e343636e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:11.529606 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128fafba-4bae-4543-9a43-a25e343636e6 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:11.535509 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:11.545157 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58136d20-0318-4e93-bbe9-0b39b37fc46d None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:11.552050 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 285/587] 10.222.0.42 () {56 vars in 1137 bytes} [Tue Aug 2 15:16:11 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:11.553120 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128fafba-4bae-4543-9a43-a25e343636e6 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:11.587107 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:11.608979 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921aa6e-b6ee-43b7-b2da-4250f476a3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:11.610340 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921aa6e-b6ee-43b7-b2da-4250f476a3e6 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:11.611359 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921aa6e-b6ee-43b7-b2da-4250f476a3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:11.612676 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921aa6e-b6ee-43b7-b2da-4250f476a3e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:11.614943 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e921aa6e-b6ee-43b7-b2da-4250f476a3e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:11.616008 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e921aa6e-b6ee-43b7-b2da-4250f476a3e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:11.619173 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e921aa6e-b6ee-43b7-b2da-4250f476a3e6 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:11.646617 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 303/588] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:16:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:11.648240 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921aa6e-b6ee-43b7-b2da-4250f476a3e6 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:11.677435 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128fafba-4bae-4543-9a43-a25e343636e6 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:11.737591 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb53ad4-be91-4098-99cd-80351370eff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:11.739723 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb53ad4-be91-4098-99cd-80351370eff6 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:11.740228 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb53ad4-be91-4098-99cd-80351370eff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:11.740857 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb53ad4-be91-4098-99cd-80351370eff6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:11.756884 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb53ad4-be91-4098-99cd-80351370eff6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:11.760178 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb53ad4-be91-4098-99cd-80351370eff6 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:11.780353 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-0eb53ad4-be91-4098-99cd-80351370eff6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 02 15:16:11.780353 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:11.780353 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:11.780353 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:11.780353 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:11.780353 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:11.780353 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:11.780353 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:11.780353 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:11.780353 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:11.780353 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:11.780353 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:11.780353 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 15:16:11.780353 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 15:16:11.780353 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 15:16:11.780353 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 15:16:11.781375 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:11.781375 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:11.781375 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 15:16:11.781375 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:16:11.781375 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 15:16:11.781375 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:16:11.781375 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:11.781375 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:11.781375 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:11.781375 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:11.781375 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:11.781375 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:11.781375 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:11.781375 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:11.781375 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:11.781375 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:11.781375 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:11.781375 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:11.782301 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:11.782301 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:11.782301 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 15:16:11.782301 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 15:16:11.782301 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 15:16:11.782301 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 15:16:11.782301 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 15:16:11.782301 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 15:16:11.782301 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 02 15:16:11.782301 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:11.790188 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 286/589] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 2 15:16:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:11.791438 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb53ad4-be91-4098-99cd-80351370eff6 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:11.859989 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921aa6e-b6ee-43b7-b2da-4250f476a3e6 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:11.899266 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:11.920766 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb53ad4-be91-4098-99cd-80351370eff6 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:11.923470 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5740c0b-94b6-40fa-b1a8-337907a101be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:11.924132 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5740c0b-94b6-40fa-b1a8-337907a101be None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:11.924415 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5740c0b-94b6-40fa-b1a8-337907a101be None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:11.924692 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5740c0b-94b6-40fa-b1a8-337907a101be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:11.956126 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5740c0b-94b6-40fa-b1a8-337907a101be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:11.960699 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5740c0b-94b6-40fa-b1a8-337907a101be None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:11.964671 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea453d4-fb00-48cb-9e66-b025c617b183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:11.965634 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea453d4-fb00-48cb-9e66-b025c617b183 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:11.966127 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea453d4-fb00-48cb-9e66-b025c617b183 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:11.966604 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea453d4-fb00-48cb-9e66-b025c617b183 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:11.976258 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea453d4-fb00-48cb-9e66-b025c617b183 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:11.978059 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea453d4-fb00-48cb-9e66-b025c617b183 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:11.991230 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-4ea453d4-fb00-48cb-9e66-b025c617b183 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 02 15:16:11.991230 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:11.991230 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:11.991230 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:11.991230 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:11.991230 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:11.991230 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:11.991230 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:11.991230 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:11.991230 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:11.991230 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:11.991230 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:11.991230 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 15:16:11.991230 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 15:16:11.991230 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 15:16:11.991230 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 15:16:11.992223 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:11.992223 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:11.992223 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 15:16:11.992223 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:16:11.992223 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 15:16:11.992223 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:16:11.992223 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:11.992223 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:11.992223 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:11.992223 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:11.992223 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:11.992223 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:11.992223 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:11.992223 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:11.992223 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:11.992223 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:11.992223 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:11.992223 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:11.993138 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:11.993138 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:11.993138 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 15:16:11.993138 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 15:16:11.993138 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 15:16:11.993138 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 15:16:11.993138 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 15:16:11.993138 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 15:16:11.993138 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 02 15:16:11.993138 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:11.994798 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-e5740c0b-94b6-40fa-b1a8-337907a101be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:11.994798 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:11.994798 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:11.994798 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:11.994798 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:11.994798 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:11.994798 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:11.994798 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:11.994798 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:11.994798 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:11.994798 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:11.994798 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:11.994798 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:16:11.994798 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:16:11.994798 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:16:11.995839 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:16:11.995839 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:11.995839 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:11.995839 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:11.995839 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:11.995839 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:11.995839 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:11.995839 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:11.995839 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:11.995839 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:11.995839 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:11.995839 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:11.995839 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:11.995839 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:11.995839 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:11.995839 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:11.995839 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:11.996720 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:16:11.996720 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:16:11.996720 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:11.996720 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:12.001625 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 304/590] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:16:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:12.001625 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5740c0b-94b6-40fa-b1a8-337907a101be None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:12.002924 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 287/591] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 2 15:16:11 2022] GET /identity/v3/users/neutron => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:12.004065 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea453d4-fb00-48cb-9e66-b025c617b183 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:12.021964 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:12.132573 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea453d4-fb00-48cb-9e66-b025c617b183 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:12.161664 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5740c0b-94b6-40fa-b1a8-337907a101be None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:12.175866 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c283b-e4df-460f-8fc9-0dad5ee9deaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:12.177051 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c283b-e4df-460f-8fc9-0dad5ee9deaa None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:12.177343 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c283b-e4df-460f-8fc9-0dad5ee9deaa None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:12.177615 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c283b-e4df-460f-8fc9-0dad5ee9deaa None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:12.178316 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53c283b-e4df-460f-8fc9-0dad5ee9deaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:12.178682 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53c283b-e4df-460f-8fc9-0dad5ee9deaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:12.180187 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53c283b-e4df-460f-8fc9-0dad5ee9deaa None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:12.198374 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 288/592] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:16:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:12.199481 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c283b-e4df-460f-8fc9-0dad5ee9deaa None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:12.202659 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb06087a-e87b-4e1f-b078-4a2783d7d357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:12.203417 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06087a-e87b-4e1f-b078-4a2783d7d357 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:12.203954 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06087a-e87b-4e1f-b078-4a2783d7d357 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:12.203954 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06087a-e87b-4e1f-b078-4a2783d7d357 None admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:12.204767 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb06087a-e87b-4e1f-b078-4a2783d7d357 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:12.205075 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb06087a-e87b-4e1f-b078-4a2783d7d357 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:12.206597 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb06087a-e87b-4e1f-b078-4a2783d7d357 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:12.208846 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:12.239725 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 305/593] 10.222.0.42 () {56 vars in 1137 bytes} [Tue Aug 2 15:16:11 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:12.241259 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb06087a-e87b-4e1f-b078-4a2783d7d357 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:12.311836 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c283b-e4df-460f-8fc9-0dad5ee9deaa None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:12.325634 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:12.350310 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64e566-8e81-440e-99cf-376249f1fb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:12.351089 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64e566-8e81-440e-99cf-376249f1fb87 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:12.351510 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64e566-8e81-440e-99cf-376249f1fb87 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:12.351851 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64e566-8e81-440e-99cf-376249f1fb87 None admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:12.352655 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b64e566-8e81-440e-99cf-376249f1fb87 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:12.352974 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b64e566-8e81-440e-99cf-376249f1fb87 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:12.354435 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b64e566-8e81-440e-99cf-376249f1fb87 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:12.371595 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb06087a-e87b-4e1f-b078-4a2783d7d357 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:12.373396 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 289/594] 10.222.0.42 () {56 vars in 1139 bytes} [Tue Aug 2 15:16:12 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:12.374264 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64e566-8e81-440e-99cf-376249f1fb87 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:12.413993 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888f85d6-25f6-43d4-b111-34b663e5297b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:12.414654 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f85d6-25f6-43d4-b111-34b663e5297b None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:12.414934 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f85d6-25f6-43d4-b111-34b663e5297b None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:12.415236 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f85d6-25f6-43d4-b111-34b663e5297b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:12.423484 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888f85d6-25f6-43d4-b111-34b663e5297b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:12.425215 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888f85d6-25f6-43d4-b111-34b663e5297b None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:12.438671 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-888f85d6-25f6-43d4-b111-34b663e5297b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:16:12.438671 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:12.438671 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:12.438671 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:12.438671 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:12.438671 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:12.438671 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:12.438671 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:12.438671 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:12.438671 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:12.438671 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:12.438671 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:12.438671 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 15:16:12.438671 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 15:16:12.438671 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 15:16:12.440727 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 15:16:12.440727 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:12.440727 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:12.440727 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:12.440727 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:12.440727 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:12.440727 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:12.440727 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:12.440727 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:12.440727 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:12.440727 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:12.440727 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:12.440727 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:12.440727 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:12.440727 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:12.440727 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:12.440727 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:12.443478 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 15:16:12.443478 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 15:16:12.443478 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 15:16:12.443478 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 15:16:12.443478 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 15:16:12.443478 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 15:16:12.443478 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:16:12.443478 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:12.443478 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 306/595] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 2 15:16:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:12.443478 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888f85d6-25f6-43d4-b111-34b663e5297b None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:12.449943 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:12.491397 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64e566-8e81-440e-99cf-376249f1fb87 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:12.529606 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236fc8cf-63e9-40bc-a46f-a881e02e1ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:12.530607 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236fc8cf-63e9-40bc-a46f-a881e02e1ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:12.531194 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236fc8cf-63e9-40bc-a46f-a881e02e1ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:12.531533 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236fc8cf-63e9-40bc-a46f-a881e02e1ce4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:12.544016 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236fc8cf-63e9-40bc-a46f-a881e02e1ce4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:12.545550 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236fc8cf-63e9-40bc-a46f-a881e02e1ce4 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:12.563040 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888f85d6-25f6-43d4-b111-34b663e5297b None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:12.564014 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-236fc8cf-63e9-40bc-a46f-a881e02e1ce4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:12.564014 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:12.564014 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:12.564014 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:12.564014 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:12.564014 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:12.564014 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:12.564014 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:12.564014 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:12.564014 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:12.564014 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:12.564014 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:12.564014 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:16:12.564014 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:16:12.564014 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:16:12.565066 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:16:12.565066 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:12.565066 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:12.565066 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:12.565066 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:12.565066 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:12.565066 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:12.565066 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:12.565066 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:12.565066 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:12.565066 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:12.565066 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:12.565066 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:12.565066 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:12.565066 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:12.565066 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:12.565066 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:12.566143 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:16:12.566143 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:16:12.566143 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:12.566143 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:12.569991 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 290/596] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:16:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:12.570945 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236fc8cf-63e9-40bc-a46f-a881e02e1ce4 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:12.596050 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:12.610261 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80fb0ba-42b2-4b04-a0f3-d6be88380bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:12.611161 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80fb0ba-42b2-4b04-a0f3-d6be88380bf1 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:12.611741 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80fb0ba-42b2-4b04-a0f3-d6be88380bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:12.612194 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80fb0ba-42b2-4b04-a0f3-d6be88380bf1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:12.625664 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80fb0ba-42b2-4b04-a0f3-d6be88380bf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:12.627713 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80fb0ba-42b2-4b04-a0f3-d6be88380bf1 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:12.645918 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-e80fb0ba-42b2-4b04-a0f3-d6be88380bf1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:12.645918 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:12.645918 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:12.645918 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:12.645918 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:12.645918 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:12.645918 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:12.645918 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:12.645918 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:12.645918 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:12.645918 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:12.645918 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:12.645918 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:16:12.645918 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:16:12.645918 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:16:12.646933 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:16:12.646933 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:12.646933 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:12.646933 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:12.646933 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:12.646933 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:12.646933 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:12.646933 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:12.646933 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:12.646933 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:12.646933 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:12.646933 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:12.646933 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:12.646933 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:12.646933 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:12.646933 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:12.646933 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:12.647956 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:16:12.647956 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:16:12.647956 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:12.647956 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:12.650347 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 307/597] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:16:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:12.651417 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80fb0ba-42b2-4b04-a0f3-d6be88380bf1 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:12.701024 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236fc8cf-63e9-40bc-a46f-a881e02e1ce4 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:12.720161 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:12.745347 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49152f17-6dd6-4c92-9fbc-8db436e5cf94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:12.746359 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49152f17-6dd6-4c92-9fbc-8db436e5cf94 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:12.746843 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49152f17-6dd6-4c92-9fbc-8db436e5cf94 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:12.747358 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49152f17-6dd6-4c92-9fbc-8db436e5cf94 None admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:12.748315 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49152f17-6dd6-4c92-9fbc-8db436e5cf94 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:12.748825 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49152f17-6dd6-4c92-9fbc-8db436e5cf94 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:12.750564 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49152f17-6dd6-4c92-9fbc-8db436e5cf94 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:12.765094 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 291/598] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 2 15:16:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:12.766347 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49152f17-6dd6-4c92-9fbc-8db436e5cf94 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:12.796852 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80fb0ba-42b2-4b04-a0f3-d6be88380bf1 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:12.835569 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b8e0f-281e-4de6-965c-dcadf071b85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:12.836198 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b8e0f-281e-4de6-965c-dcadf071b85f None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:12.836483 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b8e0f-281e-4de6-965c-dcadf071b85f None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:12.836759 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b8e0f-281e-4de6-965c-dcadf071b85f None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:12.837487 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1b8e0f-281e-4de6-965c-dcadf071b85f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:12.837794 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1b8e0f-281e-4de6-965c-dcadf071b85f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:12.839282 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1b8e0f-281e-4de6-965c-dcadf071b85f None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:12.856607 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 308/599] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:16:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:12.856607 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b8e0f-281e-4de6-965c-dcadf071b85f None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:12.894874 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:12.902975 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49152f17-6dd6-4c92-9fbc-8db436e5cf94 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:12.946677 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392d0c0-d99c-49e5-804b-36207b9ead30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:12.947335 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392d0c0-d99c-49e5-804b-36207b9ead30 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:12.947624 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392d0c0-d99c-49e5-804b-36207b9ead30 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:12.948084 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392d0c0-d99c-49e5-804b-36207b9ead30 None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:12.948778 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4392d0c0-d99c-49e5-804b-36207b9ead30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:12.949088 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4392d0c0-d99c-49e5-804b-36207b9ead30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:12.950622 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4392d0c0-d99c-49e5-804b-36207b9ead30 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:12.968851 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 292/600] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:16:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:12.968851 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9bcd1-66d4-47db-8598-fd914987a248 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:12.968851 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9bcd1-66d4-47db-8598-fd914987a248 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:12.968851 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9bcd1-66d4-47db-8598-fd914987a248 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:12.968851 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 293/601] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:16:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:16:12.968851 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab9bcd1-66d4-47db-8598-fd914987a248 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:12.980834 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b8e0f-281e-4de6-965c-dcadf071b85f None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:13.015245 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:13.022374 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d77344e-e144-4008-a641-57a03bb70739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:13.023065 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77344e-e144-4008-a641-57a03bb70739 None admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:13.023397 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77344e-e144-4008-a641-57a03bb70739 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:13.023670 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77344e-e144-4008-a641-57a03bb70739 None admin] PATH_INFO: `/v3/projects/cc19d22b4cd64dd1bc89ed78155d2732/users/946af31d75ca41a2a4301e0294cf98f3/roles/532162a00de849cea5c27767c8acd018` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:13.041831 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d77344e-e144-4008-a641-57a03bb70739 None admin] RBAC: Authorizing `identity:create_grant(project_id=cc19d22b4cd64dd1bc89ed78155d2732, user_id=946af31d75ca41a2a4301e0294cf98f3, role_id=532162a00de849cea5c27767c8acd018)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:13.043352 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d77344e-e144-4008-a641-57a03bb70739 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:13.057886 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 309/602] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 2 15:16:12 2022] PUT /identity/v3/projects/cc19d22b4cd64dd1bc89ed78155d2732/users/946af31d75ca41a2a4301e0294cf98f3/roles/532162a00de849cea5c27767c8acd018 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:16:13.058584 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d77344e-e144-4008-a641-57a03bb70739 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:13.106752 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab9bcd1-66d4-47db-8598-fd914987a248 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:13.163280 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe72f1d1-fd5b-4a24-a470-000d7566e6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:13.164288 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72f1d1-fd5b-4a24-a470-000d7566e6a2 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:13.164560 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72f1d1-fd5b-4a24-a470-000d7566e6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:13.164841 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72f1d1-fd5b-4a24-a470-000d7566e6a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:13.173457 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe72f1d1-fd5b-4a24-a470-000d7566e6a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:13.175018 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe72f1d1-fd5b-4a24-a470-000d7566e6a2 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:13.189704 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-fe72f1d1-fd5b-4a24-a470-000d7566e6a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:16:13.189704 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:13.189704 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:13.189704 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:13.189704 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:13.189704 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:13.189704 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:13.189704 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:13.189704 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:13.189704 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:13.189704 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:13.189704 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:13.189704 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 15:16:13.189704 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 15:16:13.189704 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 15:16:13.190812 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 15:16:13.190812 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:13.190812 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:13.190812 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:13.190812 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:13.190812 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:13.190812 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:13.190812 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:13.190812 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:13.190812 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:13.190812 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:13.190812 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:13.190812 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:13.190812 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:13.190812 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:13.190812 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:13.190812 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:13.191816 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 15:16:13.191816 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 15:16:13.191816 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 15:16:13.191816 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 15:16:13.191816 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 15:16:13.191816 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 15:16:13.191816 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:16:13.191816 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:13.191816 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 294/603] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 2 15:16:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:13.193569 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402e8de-4dee-4fbc-a706-cf758f1fc136 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:13.193569 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402e8de-4dee-4fbc-a706-cf758f1fc136 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:13.193569 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402e8de-4dee-4fbc-a706-cf758f1fc136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:13.203103 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:13.214905 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-4402e8de-4dee-4fbc-a706-cf758f1fc136 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:16:13.217069 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-4402e8de-4dee-4fbc-a706-cf758f1fc136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:16:13.226523 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d77344e-e144-4008-a641-57a03bb70739 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:13.271145 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0b2cc1-5a3a-426d-9126-3d17e083834a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:13.272149 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b2cc1-5a3a-426d-9126-3d17e083834a None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:13.272488 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b2cc1-5a3a-426d-9126-3d17e083834a None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:13.272823 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b2cc1-5a3a-426d-9126-3d17e083834a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:13.280238 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0b2cc1-5a3a-426d-9126-3d17e083834a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:13.281708 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0b2cc1-5a3a-426d-9126-3d17e083834a None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:13.294431 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-2b0b2cc1-5a3a-426d-9126-3d17e083834a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:16:13.294431 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:13.294431 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:13.294431 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:13.294431 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:13.294431 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:13.294431 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:13.294431 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:13.294431 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:13.294431 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:13.294431 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:13.294431 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:13.294431 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 15:16:13.294431 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 15:16:13.294431 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 15:16:13.295417 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 15:16:13.295417 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:13.295417 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:13.295417 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:13.295417 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:13.295417 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:13.295417 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:13.295417 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:13.295417 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:13.295417 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:13.295417 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:13.295417 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:13.295417 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:13.295417 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:13.295417 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:13.295417 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:13.295417 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:13.296339 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 15:16:13.296339 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 15:16:13.296339 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 15:16:13.296339 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 15:16:13.296339 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 15:16:13.296339 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 15:16:13.296339 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:16:13.296339 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:13.296339 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 310/604] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 2 15:16:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:13.297364 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee2a4e7-c8f7-4ddc-be0f-95c923da4595 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:13.297549 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee2a4e7-c8f7-4ddc-be0f-95c923da4595 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:13.297789 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee2a4e7-c8f7-4ddc-be0f-95c923da4595 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:13.299178 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 311/605] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:16:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:16:13.303906 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee2a4e7-c8f7-4ddc-be0f-95c923da4595 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:13.314825 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 295/606] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:16:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:16:13.315903 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4402e8de-4dee-4fbc-a706-cf758f1fc136 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:13.347820 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:13.432339 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4402e8de-4dee-4fbc-a706-cf758f1fc136 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:13.432537 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee2a4e7-c8f7-4ddc-be0f-95c923da4595 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:13.471208 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f694ad-ee2b-4212-88ae-6d05745b7c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:13.471483 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed86cd33-ee65-4e6b-a94a-40d28ab90799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:13.471851 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f694ad-ee2b-4212-88ae-6d05745b7c03 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:13.472034 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86cd33-ee65-4e6b-a94a-40d28ab90799 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:13.472363 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f694ad-ee2b-4212-88ae-6d05745b7c03 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:13.472464 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86cd33-ee65-4e6b-a94a-40d28ab90799 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:13.472539 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f694ad-ee2b-4212-88ae-6d05745b7c03 None admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:13.472608 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86cd33-ee65-4e6b-a94a-40d28ab90799 None admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:13.473269 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f694ad-ee2b-4212-88ae-6d05745b7c03 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:13.473930 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed86cd33-ee65-4e6b-a94a-40d28ab90799 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:13.474077 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f694ad-ee2b-4212-88ae-6d05745b7c03 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:13.474200 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed86cd33-ee65-4e6b-a94a-40d28ab90799 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:13.475414 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f694ad-ee2b-4212-88ae-6d05745b7c03 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:13.475685 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed86cd33-ee65-4e6b-a94a-40d28ab90799 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:13.488286 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 296/607] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 2 15:16:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:13.490734 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 312/608] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 2 15:16:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:13.494678 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed86cd33-ee65-4e6b-a94a-40d28ab90799 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:13.494839 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78688b44-cd8d-4177-bb69-61723f579e9f None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:13.495284 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78688b44-cd8d-4177-bb69-61723f579e9f None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:13.495362 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78688b44-cd8d-4177-bb69-61723f579e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:13.507919 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:13.515483 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-78688b44-cd8d-4177-bb69-61723f579e9f None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:16:13.516685 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-78688b44-cd8d-4177-bb69-61723f579e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:16:13.619341 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 297/609] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:16:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:16:13.619341 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78688b44-cd8d-4177-bb69-61723f579e9f None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:13.637194 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:13.638685 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed86cd33-ee65-4e6b-a94a-40d28ab90799 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:13.684825 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2006cb33-b546-43b0-987e-bfc35dab2211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:13.685494 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2006cb33-b546-43b0-987e-bfc35dab2211 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:13.685775 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2006cb33-b546-43b0-987e-bfc35dab2211 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:13.686052 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2006cb33-b546-43b0-987e-bfc35dab2211 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:13.698585 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2006cb33-b546-43b0-987e-bfc35dab2211 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:16:13.704147 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-2006cb33-b546-43b0-987e-bfc35dab2211 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 15:16:13.704147 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:13.704147 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:13.704147 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:13.704147 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:13.704147 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:13.704147 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:13.704147 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:13.704147 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:13.704147 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:13.704147 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:13.704147 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:13.704147 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:16:13.704147 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:16:13.704147 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:16:13.704147 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:16:13.705227 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:16:13.705227 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:16:13.705227 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:16:13.705227 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:16:13.705227 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:13.705227 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:13.705227 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:13.705227 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:13.705227 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:13.705227 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:13.705227 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:13.705227 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:13.705227 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:13.705227 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:13.705227 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:13.705227 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:13.706606 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:13.706606 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:13.706606 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:13.706606 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:13.706606 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:16:13.706606 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:16:13.706606 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:16:13.706606 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:16:13.706606 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:16:13.706606 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:16:13.706606 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 15:16:13.706606 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:13.706606 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 313/610] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 2 15:16:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:13.706606 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2006cb33-b546-43b0-987e-bfc35dab2211 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:13.745521 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78688b44-cd8d-4177-bb69-61723f579e9f None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:13.786935 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:13.790044 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f7716e-2a28-400a-9d8c-6233bedde0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:13.791145 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f7716e-2a28-400a-9d8c-6233bedde0a7 None admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:13.791689 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f7716e-2a28-400a-9d8c-6233bedde0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:13.791980 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f7716e-2a28-400a-9d8c-6233bedde0a7 None admin] PATH_INFO: `/v3/projects/cc19d22b4cd64dd1bc89ed78155d2732/users/f6d1caa34f2b41bfbcc95fa58d85f004/roles/532162a00de849cea5c27767c8acd018` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:13.815029 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f7716e-2a28-400a-9d8c-6233bedde0a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=cc19d22b4cd64dd1bc89ed78155d2732, user_id=f6d1caa34f2b41bfbcc95fa58d85f004, role_id=532162a00de849cea5c27767c8acd018)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:13.816737 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f7716e-2a28-400a-9d8c-6233bedde0a7 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:13.834160 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 298/611] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 2 15:16:13 2022] PUT /identity/v3/projects/cc19d22b4cd64dd1bc89ed78155d2732/users/f6d1caa34f2b41bfbcc95fa58d85f004/roles/532162a00de849cea5c27767c8acd018 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:16:13.835469 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f7716e-2a28-400a-9d8c-6233bedde0a7 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:13.837348 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2006cb33-b546-43b0-987e-bfc35dab2211 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:13.885955 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60412b7-cc00-41f1-a568-94d5606224f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:13.887287 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60412b7-cc00-41f1-a568-94d5606224f6 None admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:13.887820 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60412b7-cc00-41f1-a568-94d5606224f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:13.888329 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60412b7-cc00-41f1-a568-94d5606224f6 None admin] PATH_INFO: `/v3/projects/cc19d22b4cd64dd1bc89ed78155d2732/users/8d09126f1821420bb4218b611c89402a/roles/532162a00de849cea5c27767c8acd018` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:13.912034 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60412b7-cc00-41f1-a568-94d5606224f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=cc19d22b4cd64dd1bc89ed78155d2732, user_id=8d09126f1821420bb4218b611c89402a, role_id=532162a00de849cea5c27767c8acd018)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:13.914338 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60412b7-cc00-41f1-a568-94d5606224f6 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:13.943806 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 314/612] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 2 15:16:13 2022] PUT /identity/v3/projects/cc19d22b4cd64dd1bc89ed78155d2732/users/8d09126f1821420bb4218b611c89402a/roles/532162a00de849cea5c27767c8acd018 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:16:13.944893 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60412b7-cc00-41f1-a568-94d5606224f6 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:13.948637 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:14.033400 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f7716e-2a28-400a-9d8c-6233bedde0a7 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:14.081097 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a3878e-eded-472f-9cf8-9ef92be74e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:14.081762 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3878e-eded-472f-9cf8-9ef92be74e1e None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:14.082042 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3878e-eded-472f-9cf8-9ef92be74e1e None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:14.082314 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3878e-eded-472f-9cf8-9ef92be74e1e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:14.096041 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a3878e-eded-472f-9cf8-9ef92be74e1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:16:14.101892 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-c0a3878e-eded-472f-9cf8-9ef92be74e1e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 15:16:14.101892 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:14.101892 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:14.101892 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:14.101892 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:14.101892 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:14.101892 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:14.101892 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:14.101892 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:14.101892 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:14.101892 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:14.101892 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:14.101892 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:16:14.101892 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:16:14.101892 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:16:14.101892 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:16:14.102975 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:16:14.102975 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:16:14.102975 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:16:14.102975 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:16:14.102975 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:14.102975 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:14.102975 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:14.102975 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:14.102975 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:14.102975 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:14.102975 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:14.102975 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:14.102975 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:14.102975 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:14.102975 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:14.102975 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:14.103898 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:14.103898 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:14.103898 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:14.103898 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:14.103898 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:16:14.103898 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:16:14.103898 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:16:14.103898 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:16:14.103898 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:16:14.103898 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:16:14.103898 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 15:16:14.103898 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:14.110873 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 299/613] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 2 15:16:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:14.111894 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a3878e-eded-472f-9cf8-9ef92be74e1e None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:14.137709 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60412b7-cc00-41f1-a568-94d5606224f6 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:14.162008 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:14.193473 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b40f3d3-0796-453a-8d7f-7f5166fae99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:14.194315 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b40f3d3-0796-453a-8d7f-7f5166fae99e None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:14.194744 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b40f3d3-0796-453a-8d7f-7f5166fae99e None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:14.195030 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b40f3d3-0796-453a-8d7f-7f5166fae99e None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:14.196114 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b40f3d3-0796-453a-8d7f-7f5166fae99e None admin] RBAC: Adding query filter params (name=service) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:14.196433 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b40f3d3-0796-453a-8d7f-7f5166fae99e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:14.198649 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b40f3d3-0796-453a-8d7f-7f5166fae99e None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:14.210735 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 315/614] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Aug 2 15:16:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:14.216483 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b40f3d3-0796-453a-8d7f-7f5166fae99e None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:14.247006 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a3878e-eded-472f-9cf8-9ef92be74e1e None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:14.275993 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:14.285841 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75b5f8-86aa-45cf-8c47-88a9de34c9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:14.287003 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75b5f8-86aa-45cf-8c47-88a9de34c9d7 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:14.287317 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75b5f8-86aa-45cf-8c47-88a9de34c9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:14.287598 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75b5f8-86aa-45cf-8c47-88a9de34c9d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:14.288315 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c75b5f8-86aa-45cf-8c47-88a9de34c9d7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:14.288890 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c75b5f8-86aa-45cf-8c47-88a9de34c9d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:14.290276 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c75b5f8-86aa-45cf-8c47-88a9de34c9d7 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:14.299351 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 300/615] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Aug 2 15:16:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:14.305152 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75b5f8-86aa-45cf-8c47-88a9de34c9d7 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:14.338136 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b40f3d3-0796-453a-8d7f-7f5166fae99e None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:14.382426 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e6dc6-bc39-4a89-9e27-f44db0237baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:14.383369 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e6dc6-bc39-4a89-9e27-f44db0237baa None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:14.383836 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e6dc6-bc39-4a89-9e27-f44db0237baa None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:14.384264 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e6dc6-bc39-4a89-9e27-f44db0237baa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:14.397668 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372e6dc6-bc39-4a89-9e27-f44db0237baa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:14.399937 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372e6dc6-bc39-4a89-9e27-f44db0237baa None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:14.417881 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-372e6dc6-bc39-4a89-9e27-f44db0237baa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:14.417881 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:14.417881 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:14.417881 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:14.417881 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:14.417881 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:14.417881 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:14.417881 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:14.417881 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:14.417881 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:14.417881 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:14.417881 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:14.417881 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:16:14.417881 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:16:14.417881 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:16:14.419035 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:16:14.419035 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:14.419035 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:14.419035 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:14.419035 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:14.419035 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:14.419035 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:14.419035 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:14.419035 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:14.419035 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:14.419035 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:14.419035 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:14.419035 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:14.419035 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:14.419035 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:14.419035 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:14.419035 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:14.420160 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:16:14.420160 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:16:14.420160 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:14.420160 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:14.421969 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 316/616] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:16:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:14.428619 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e6dc6-bc39-4a89-9e27-f44db0237baa None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:14.467635 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:14.533121 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75b5f8-86aa-45cf-8c47-88a9de34c9d7 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:14.578362 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e6dc6-bc39-4a89-9e27-f44db0237baa None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:14.597683 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c25de8-baed-4607-8d02-55ee53978b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:14.598717 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c25de8-baed-4607-8d02-55ee53978b40 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:14.599348 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c25de8-baed-4607-8d02-55ee53978b40 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:14.601286 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c25de8-baed-4607-8d02-55ee53978b40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:14.617383 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c25de8-baed-4607-8d02-55ee53978b40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:14.618990 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c25de8-baed-4607-8d02-55ee53978b40 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:14.632942 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68be4629-0a60-404e-9e3a-8cc09c3eaa95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:14.633850 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be4629-0a60-404e-9e3a-8cc09c3eaa95 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:14.634309 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be4629-0a60-404e-9e3a-8cc09c3eaa95 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:14.634738 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be4629-0a60-404e-9e3a-8cc09c3eaa95 None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:14.635618 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68be4629-0a60-404e-9e3a-8cc09c3eaa95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:14.636133 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68be4629-0a60-404e-9e3a-8cc09c3eaa95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:14.637732 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68be4629-0a60-404e-9e3a-8cc09c3eaa95 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:14.651841 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 317/617] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:16:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:16:14.656340 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-c6c25de8-baed-4607-8d02-55ee53978b40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:14.656340 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:14.656340 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:14.656340 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:14.656340 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:14.656340 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:14.656340 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:14.656340 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:14.656340 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:14.656340 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:14.656340 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:14.656340 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:14.656340 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:16:14.656340 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:16:14.656340 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:16:14.657407 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:16:14.657407 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:14.657407 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:14.657407 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:14.657407 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:14.657407 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:14.657407 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:14.657407 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:14.657407 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:14.657407 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:14.657407 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:14.657407 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:14.657407 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:14.657407 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:14.657407 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:14.657407 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:14.657407 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:14.658496 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:16:14.658496 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:16:14.658496 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:14.658496 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:14.658496 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 301/618] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:16:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 15:16:14.660026 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68be4629-0a60-404e-9e3a-8cc09c3eaa95 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:14.664484 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c25de8-baed-4607-8d02-55ee53978b40 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:14.772839 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:14.781520 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:14.793538 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68be4629-0a60-404e-9e3a-8cc09c3eaa95 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:14.886630 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7c9654-bf28-4e16-9427-6578452b9b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:14.887817 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c9654-bf28-4e16-9427-6578452b9b9c None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:14.888309 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c9654-bf28-4e16-9427-6578452b9b9c None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:14.888702 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c25de8-baed-4607-8d02-55ee53978b40 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:14.890639 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c9654-bf28-4e16-9427-6578452b9b9c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:14.909858 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7c9654-bf28-4e16-9427-6578452b9b9c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:14.912976 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7c9654-bf28-4e16-9427-6578452b9b9c None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:14.931956 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-6d7c9654-bf28-4e16-9427-6578452b9b9c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 02 15:16:14.931956 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:14.931956 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:14.931956 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:14.931956 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:14.931956 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:14.931956 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:14.931956 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:14.931956 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:14.931956 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:14.931956 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:14.931956 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:14.931956 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 15:16:14.931956 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 15:16:14.931956 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 15:16:14.931956 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 15:16:14.933946 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:14.933946 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:14.933946 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 15:16:14.933946 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:16:14.933946 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 15:16:14.933946 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:16:14.933946 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:14.933946 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:14.933946 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:14.933946 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:14.933946 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:14.933946 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:14.933946 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:14.933946 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:14.933946 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:14.933946 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:14.933946 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:14.933946 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:14.935036 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:14.935036 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:14.935036 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 15:16:14.935036 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 15:16:14.935036 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 15:16:14.935036 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 15:16:14.935036 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 15:16:14.935036 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 15:16:14.935036 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 02 15:16:14.935036 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:14.937958 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 318/619] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 2 15:16:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:14.943740 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7c9654-bf28-4e16-9427-6578452b9b9c None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:15.011976 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba5a044-00ba-44a3-968b-9ca7d17fb337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:15.012633 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5a044-00ba-44a3-968b-9ca7d17fb337 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:15.012918 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5a044-00ba-44a3-968b-9ca7d17fb337 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:15.013196 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5a044-00ba-44a3-968b-9ca7d17fb337 None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:15.013981 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba5a044-00ba-44a3-968b-9ca7d17fb337 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:15.014208 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba5a044-00ba-44a3-968b-9ca7d17fb337 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:15.015630 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba5a044-00ba-44a3-968b-9ca7d17fb337 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:15.034600 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 302/620] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:16:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:15.040479 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba5a044-00ba-44a3-968b-9ca7d17fb337 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:15.057658 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7c9654-bf28-4e16-9427-6578452b9b9c None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:15.095581 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad33dbdf-805c-479b-bbc9-719b8d19ac48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:15.096490 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33dbdf-805c-479b-bbc9-719b8d19ac48 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:15.096926 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33dbdf-805c-479b-bbc9-719b8d19ac48 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:15.097361 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33dbdf-805c-479b-bbc9-719b8d19ac48 None admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:15.098345 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad33dbdf-805c-479b-bbc9-719b8d19ac48 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:15.098830 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad33dbdf-805c-479b-bbc9-719b8d19ac48 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:15.100462 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad33dbdf-805c-479b-bbc9-719b8d19ac48 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:15.121425 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 319/621] 10.222.0.42 () {56 vars in 1135 bytes} [Tue Aug 2 15:16:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:15.127046 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad33dbdf-805c-479b-bbc9-719b8d19ac48 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:15.139816 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:15.241059 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad33dbdf-805c-479b-bbc9-719b8d19ac48 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:15.303319 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d311d909-58fb-43da-870a-9b1db88cc568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:15.304510 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311d909-58fb-43da-870a-9b1db88cc568 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:15.306380 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311d909-58fb-43da-870a-9b1db88cc568 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:15.306837 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311d909-58fb-43da-870a-9b1db88cc568 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:15.324728 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:15.325169 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d311d909-58fb-43da-870a-9b1db88cc568 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:15.326711 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d311d909-58fb-43da-870a-9b1db88cc568 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:15.330174 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba5a044-00ba-44a3-968b-9ca7d17fb337 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:15.360855 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-d311d909-58fb-43da-870a-9b1db88cc568 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:15.360855 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:15.360855 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:15.360855 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:15.360855 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:15.360855 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:15.360855 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:15.360855 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:15.360855 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:15.360855 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:15.360855 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:15.360855 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:15.360855 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:16:15.360855 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:16:15.360855 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:16:15.362165 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:16:15.362165 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:15.362165 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:15.362165 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:15.362165 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:15.362165 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:15.362165 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:15.362165 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:15.362165 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:15.362165 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:15.362165 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:15.362165 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:15.362165 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:15.362165 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:15.362165 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:15.362165 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:15.362165 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:15.363823 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:16:15.363823 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:16:15.363823 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:15.363823 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:15.363823 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 320/622] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:16:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 15:16:15.372935 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d311d909-58fb-43da-870a-9b1db88cc568 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:15.407202 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93314398-3b76-4967-a4cd-d1f5b08f938f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:15.408280 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93314398-3b76-4967-a4cd-d1f5b08f938f None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:15.408857 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93314398-3b76-4967-a4cd-d1f5b08f938f None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:15.409143 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93314398-3b76-4967-a4cd-d1f5b08f938f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:15.420437 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93314398-3b76-4967-a4cd-d1f5b08f938f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:15.421918 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93314398-3b76-4967-a4cd-d1f5b08f938f None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:15.439628 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-93314398-3b76-4967-a4cd-d1f5b08f938f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 15:16:15.439628 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:15.439628 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:15.439628 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:15.439628 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:15.439628 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:15.439628 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:15.439628 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:15.439628 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:15.439628 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:15.439628 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:15.439628 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:15.439628 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 15:16:15.439628 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 15:16:15.439628 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 15:16:15.439628 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 15:16:15.440636 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:15.440636 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:15.440636 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 15:16:15.440636 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:16:15.440636 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 15:16:15.440636 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:16:15.440636 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:15.440636 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:15.440636 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:15.440636 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:15.440636 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:15.440636 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:15.440636 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:15.440636 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:15.440636 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:15.440636 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:15.440636 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:15.440636 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:15.442172 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:15.442172 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:15.442172 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 15:16:15.442172 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 15:16:15.442172 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 15:16:15.442172 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 15:16:15.442172 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 15:16:15.442172 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 15:16:15.442172 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 15:16:15.442172 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:15.442172 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 303/623] 10.222.0.42 () {56 vars in 1093 bytes} [Tue Aug 2 15:16:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 401 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:15.442980 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc94f9-67db-4084-ba1d-0c4020c44218 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:15.443265 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc94f9-67db-4084-ba1d-0c4020c44218 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:15.445008 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc94f9-67db-4084-ba1d-0c4020c44218 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:15.445008 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 304/624] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:16:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:16:15.447110 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fc94f9-67db-4084-ba1d-0c4020c44218 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:15.467892 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:15.532484 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d311d909-58fb-43da-870a-9b1db88cc568 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:15.578417 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49526ed1-c958-4c43-85eb-9381780b09c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:15.579244 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49526ed1-c958-4c43-85eb-9381780b09c2 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:15.579621 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49526ed1-c958-4c43-85eb-9381780b09c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:15.580228 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49526ed1-c958-4c43-85eb-9381780b09c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:15.581207 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49526ed1-c958-4c43-85eb-9381780b09c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:15.581522 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49526ed1-c958-4c43-85eb-9381780b09c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:15.583761 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49526ed1-c958-4c43-85eb-9381780b09c2 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:15.591100 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fc94f9-67db-4084-ba1d-0c4020c44218 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:15.598184 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 321/625] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:16:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:15.599887 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d5871-d634-47f1-a031-931d5da841db None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:15.600003 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d5871-d634-47f1-a031-931d5da841db None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:15.600216 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d5871-d634-47f1-a031-931d5da841db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:15.619861 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-fa5d5871-d634-47f1-a031-931d5da841db None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:16:15.621136 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-fa5d5871-d634-47f1-a031-931d5da841db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:16:15.629482 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8949e7c0-c135-467d-84b6-828a3ff3dbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:15.630968 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949e7c0-c135-467d-84b6-828a3ff3dbdb None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:15.631508 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949e7c0-c135-467d-84b6-828a3ff3dbdb None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:15.632017 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949e7c0-c135-467d-84b6-828a3ff3dbdb None admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:15.633011 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8949e7c0-c135-467d-84b6-828a3ff3dbdb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:15.633532 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8949e7c0-c135-467d-84b6-828a3ff3dbdb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:15.635176 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8949e7c0-c135-467d-84b6-828a3ff3dbdb None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:15.658325 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 305/626] 10.222.0.42 () {56 vars in 1133 bytes} [Tue Aug 2 15:16:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:16:15.659652 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8949e7c0-c135-467d-84b6-828a3ff3dbdb None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:15.680528 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:15.703239 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 322/627] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:16:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:16:15.703239 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5d5871-d634-47f1-a031-931d5da841db None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:15.764340 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:15.790636 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8949e7c0-c135-467d-84b6-828a3ff3dbdb None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:15.820592 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5d5871-d634-47f1-a031-931d5da841db None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:15.831502 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b7c1f2-7b48-4757-92ed-fce9fbd62615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:15.832485 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b7c1f2-7b48-4757-92ed-fce9fbd62615 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:15.833552 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b7c1f2-7b48-4757-92ed-fce9fbd62615 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:15.834040 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b7c1f2-7b48-4757-92ed-fce9fbd62615 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:15.841744 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b7c1f2-7b48-4757-92ed-fce9fbd62615 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:15.843609 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b7c1f2-7b48-4757-92ed-fce9fbd62615 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:15.856831 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-c8b7c1f2-7b48-4757-92ed-fce9fbd62615 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:16:15.856831 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:15.856831 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:15.856831 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:15.856831 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:15.856831 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:15.856831 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:15.856831 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:15.856831 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:15.856831 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:15.856831 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:15.856831 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:15.856831 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 15:16:15.856831 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 15:16:15.856831 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 15:16:15.857824 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 15:16:15.857824 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:15.857824 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:15.857824 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:15.857824 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:15.857824 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:15.857824 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:15.857824 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:15.857824 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:15.857824 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:15.857824 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:15.857824 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:15.857824 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:15.857824 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:15.857824 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:15.857824 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:15.857824 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:15.858808 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 15:16:15.858808 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 15:16:15.858808 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 15:16:15.858808 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 15:16:15.858808 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 15:16:15.858808 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 15:16:15.858808 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:16:15.858808 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:15.861449 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 306/628] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 2 15:16:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:15.862474 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b7c1f2-7b48-4757-92ed-fce9fbd62615 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:15.891082 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07817bdd-e0a3-45ac-815c-f21f8561b85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:15.891883 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07817bdd-e0a3-45ac-815c-f21f8561b85b None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:15.892334 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07817bdd-e0a3-45ac-815c-f21f8561b85b None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:15.892631 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07817bdd-e0a3-45ac-815c-f21f8561b85b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:15.970374 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:15.985051 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07817bdd-e0a3-45ac-815c-f21f8561b85b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:15.986662 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07817bdd-e0a3-45ac-815c-f21f8561b85b None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:15.997617 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b7c1f2-7b48-4757-92ed-fce9fbd62615 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:16.038070 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c76093e-6cbd-4a72-9f75-723ea2431473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:16.039454 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c76093e-6cbd-4a72-9f75-723ea2431473 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:16.039924 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c76093e-6cbd-4a72-9f75-723ea2431473 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:16.040351 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:16.041544 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c76093e-6cbd-4a72-9f75-723ea2431473 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:16.055353 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c76093e-6cbd-4a72-9f75-723ea2431473 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:16:16.060761 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-9c76093e-6cbd-4a72-9f75-723ea2431473 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 15:16:16.060761 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:16.060761 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:16.060761 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:16.060761 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:16.060761 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:16.060761 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:16.060761 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:16.060761 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:16.060761 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:16.060761 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:16.060761 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:16.060761 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:16:16.060761 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:16:16.060761 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:16:16.060761 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:16:16.061905 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:16:16.061905 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:16:16.061905 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:16:16.061905 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:16:16.061905 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:16.061905 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:16.061905 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:16.061905 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:16.061905 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:16.061905 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:16.061905 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:16.061905 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:16.061905 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:16.061905 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:16.061905 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:16.061905 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:16.062894 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:16.062894 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:16.062894 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:16.062894 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:16.062894 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:16:16.062894 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:16:16.062894 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:16:16.062894 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:16:16.062894 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:16:16.062894 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:16:16.062894 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 15:16:16.062894 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:16.070515 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 307/629] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 2 15:16:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:16.071775 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c76093e-6cbd-4a72-9f75-723ea2431473 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:16.101482 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 323/630] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 2 15:16:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 15:16:16.101482 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07817bdd-e0a3-45ac-815c-f21f8561b85b None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:16.191135 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c76093e-6cbd-4a72-9f75-723ea2431473 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:16.206512 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07817bdd-e0a3-45ac-815c-f21f8561b85b None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:16.230531 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27db18a-83a2-48bf-a4b8-113907560cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:16.231458 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27db18a-83a2-48bf-a4b8-113907560cae None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:16.231895 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27db18a-83a2-48bf-a4b8-113907560cae None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:16.232400 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27db18a-83a2-48bf-a4b8-113907560cae None admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:16.233408 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27db18a-83a2-48bf-a4b8-113907560cae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:16.233864 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27db18a-83a2-48bf-a4b8-113907560cae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:16.235629 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27db18a-83a2-48bf-a4b8-113907560cae None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:16.243859 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:16.244677 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2149f66d-bc41-43c0-badf-8d9529e56016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:16.245507 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2149f66d-bc41-43c0-badf-8d9529e56016 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:16.245507 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2149f66d-bc41-43c0-badf-8d9529e56016 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:16.245784 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2149f66d-bc41-43c0-badf-8d9529e56016 None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:16.246568 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2149f66d-bc41-43c0-badf-8d9529e56016 None admin] RBAC: Adding query filter params (name=service) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:16.246940 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2149f66d-bc41-43c0-badf-8d9529e56016 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:16.249048 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2149f66d-bc41-43c0-badf-8d9529e56016 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:16.252881 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 308/631] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 2 15:16:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:16.254303 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27db18a-83a2-48bf-a4b8-113907560cae None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:16.261823 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 324/632] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Aug 2 15:16:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:16.263132 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6469ed31-5a32-45f2-bbc0-f76c57dcc72f None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:16.263431 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6469ed31-5a32-45f2-bbc0-f76c57dcc72f None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:16.263715 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6469ed31-5a32-45f2-bbc0-f76c57dcc72f None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:16.265070 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 325/633] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:16:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:16:16.265599 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6469ed31-5a32-45f2-bbc0-f76c57dcc72f None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:16.282506 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:16.374987 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27db18a-83a2-48bf-a4b8-113907560cae None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:16.380614 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6469ed31-5a32-45f2-bbc0-f76c57dcc72f None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:16.409261 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84c341-1a1c-4db3-be45-ad6ae50cc957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:16.409900 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84c341-1a1c-4db3-be45-ad6ae50cc957 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:16.410180 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84c341-1a1c-4db3-be45-ad6ae50cc957 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:16.410451 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84c341-1a1c-4db3-be45-ad6ae50cc957 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:16.419059 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f334c-f945-495a-aed3-6664a4e1c117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:16.419792 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f334c-f945-495a-aed3-6664a4e1c117 None admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:16.420078 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f334c-f945-495a-aed3-6664a4e1c117 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:16.420356 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f334c-f945-495a-aed3-6664a4e1c117 None admin] PATH_INFO: `/v3/projects/cc19d22b4cd64dd1bc89ed78155d2732/users/6f4de590df474c8b95f2b1193f7dbcb5/roles/532162a00de849cea5c27767c8acd018` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:16.421772 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c84c341-1a1c-4db3-be45-ad6ae50cc957 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:16.423204 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c84c341-1a1c-4db3-be45-ad6ae50cc957 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:16.437122 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f334c-f945-495a-aed3-6664a4e1c117 None admin] RBAC: Authorizing `identity:create_grant(project_id=cc19d22b4cd64dd1bc89ed78155d2732, user_id=6f4de590df474c8b95f2b1193f7dbcb5, role_id=532162a00de849cea5c27767c8acd018)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:16.438364 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-0c84c341-1a1c-4db3-be45-ad6ae50cc957 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:16.438364 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:16.438364 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:16.438364 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:16.438364 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:16.438364 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:16.438364 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:16.438364 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:16.438364 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:16.438364 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:16.438364 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:16.438364 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:16.438364 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:16:16.438364 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:16:16.438364 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:16:16.439386 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:16:16.439386 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:16.439386 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:16.439386 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:16.439386 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:16.439386 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:16.439386 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:16.439386 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:16.439386 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:16.439386 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:16.439386 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:16.439386 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:16.439386 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:16.439386 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:16.439386 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:16.439386 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:16.439386 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:16.440268 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:16:16.440268 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:16:16.440268 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:16.440268 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:16.440504 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f334c-f945-495a-aed3-6664a4e1c117 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:16.440574 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 309/634] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:16:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:16.440574 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84c341-1a1c-4db3-be45-ad6ae50cc957 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:16.454559 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 326/635] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 2 15:16:16 2022] PUT /identity/v3/projects/cc19d22b4cd64dd1bc89ed78155d2732/users/6f4de590df474c8b95f2b1193f7dbcb5/roles/532162a00de849cea5c27767c8acd018 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:16:16.456137 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f24da-045a-46ce-a922-bd680e1ba271 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:16.456430 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f24da-045a-46ce-a922-bd680e1ba271 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:16.456712 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f24da-045a-46ce-a922-bd680e1ba271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:16.481692 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-f22f24da-045a-46ce-a922-bd680e1ba271 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:16:16.482964 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-f22f24da-045a-46ce-a922-bd680e1ba271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:16:16.503388 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:16.549711 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:16.563767 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 327/636] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:16:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:16:16.564895 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136cff7-48ce-4fc1-b371-c83c7521f84e None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:16.565189 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136cff7-48ce-4fc1-b371-c83c7521f84e None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:16.565481 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136cff7-48ce-4fc1-b371-c83c7521f84e None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:16.566738 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 328/637] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:16:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:16:16.567462 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3136cff7-48ce-4fc1-b371-c83c7521f84e None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:16.578348 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84c341-1a1c-4db3-be45-ad6ae50cc957 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:16.625457 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ce74a-b826-48b7-b0e7-d6ad7c9dbb14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:16.626950 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ce74a-b826-48b7-b0e7-d6ad7c9dbb14 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:16.627504 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ce74a-b826-48b7-b0e7-d6ad7c9dbb14 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:16.628167 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ce74a-b826-48b7-b0e7-d6ad7c9dbb14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:16.641931 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25ce74a-b826-48b7-b0e7-d6ad7c9dbb14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:16.643443 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25ce74a-b826-48b7-b0e7-d6ad7c9dbb14 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:16.659978 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-e25ce74a-b826-48b7-b0e7-d6ad7c9dbb14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:16.659978 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:16.659978 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:16.659978 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:16.659978 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:16.659978 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:16.659978 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:16.659978 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:16.659978 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:16.659978 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:16.659978 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:16.659978 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:16.659978 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:16:16.659978 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:16:16.659978 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:16:16.661496 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:16:16.661496 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:16.661496 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:16.661496 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:16.661496 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:16.661496 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:16.661496 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:16.661496 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:16.661496 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:16.661496 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:16.661496 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:16.661496 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:16.661496 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:16.661496 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:16.661496 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:16.661496 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:16.661496 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:16.662369 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:16:16.662369 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:16:16.662369 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:16.662369 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:16.663837 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 310/638] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:16:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:16.665407 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f254c-289f-4d8b-8a35-7e3da8a32764 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:16.665907 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f254c-289f-4d8b-8a35-7e3da8a32764 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:16.666448 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f254c-289f-4d8b-8a35-7e3da8a32764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:16.686100 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-c04f254c-289f-4d8b-8a35-7e3da8a32764 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:16:16.687329 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-c04f254c-289f-4d8b-8a35-7e3da8a32764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:16:16.694571 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3136cff7-48ce-4fc1-b371-c83c7521f84e None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:16.732939 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be3e5a-e633-4e44-9def-6dafcd96719c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:16.733560 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be3e5a-e633-4e44-9def-6dafcd96719c None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:16.733841 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be3e5a-e633-4e44-9def-6dafcd96719c None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:16.734117 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be3e5a-e633-4e44-9def-6dafcd96719c None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:16.734814 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81be3e5a-e633-4e44-9def-6dafcd96719c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:16.735122 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81be3e5a-e633-4e44-9def-6dafcd96719c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:16.736543 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81be3e5a-e633-4e44-9def-6dafcd96719c None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:16.749267 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 329/639] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:16:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:16.750011 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be3e5a-e633-4e44-9def-6dafcd96719c None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:16.769308 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 311/640] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:16:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:16:16.770071 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f254c-289f-4d8b-8a35-7e3da8a32764 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:16.816166 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:16.830006 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:16.887002 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be3e5a-e633-4e44-9def-6dafcd96719c None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:16.896595 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f254c-289f-4d8b-8a35-7e3da8a32764 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:16.925659 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea8feb1-6f04-403e-962e-2b19d296a026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:16.926309 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea8feb1-6f04-403e-962e-2b19d296a026 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:16.927116 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea8feb1-6f04-403e-962e-2b19d296a026 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:16.927425 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea8feb1-6f04-403e-962e-2b19d296a026 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:16.940376 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea8feb1-6f04-403e-962e-2b19d296a026 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:16:16.940694 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f3aed-1052-4a42-abf3-b35a39900fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:16.941523 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f3aed-1052-4a42-abf3-b35a39900fd6 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:16.941960 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f3aed-1052-4a42-abf3-b35a39900fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:16.942999 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f3aed-1052-4a42-abf3-b35a39900fd6 None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:16.943914 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176f3aed-1052-4a42-abf3-b35a39900fd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:16.944353 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176f3aed-1052-4a42-abf3-b35a39900fd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:16.945973 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176f3aed-1052-4a42-abf3-b35a39900fd6 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:16.946460 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-2ea8feb1-6f04-403e-962e-2b19d296a026 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 15:16:16.946460 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:16.946460 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:16.946460 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:16.946460 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:16.946460 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:16.946460 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:16.946460 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:16.946460 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:16.946460 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:16.946460 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:16.946460 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:16.946460 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:16:16.946460 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:16:16.946460 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:16:16.946460 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:16:16.947539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:16:16.947539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:16:16.947539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:16:16.947539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:16:16.947539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:16.947539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:16.947539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:16.947539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:16.947539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:16.947539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:16.947539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:16.947539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:16.947539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:16.947539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:16.947539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:16.947539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:16.948518 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:16.948518 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:16.948518 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:16.948518 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:16.948518 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:16:16.948518 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:16:16.948518 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:16:16.948518 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:16:16.948518 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:16:16.948518 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:16:16.948518 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 15:16:16.948518 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:16.952549 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 330/641] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 2 15:16:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:16.953520 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea8feb1-6f04-403e-962e-2b19d296a026 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:16.962579 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 312/642] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:16:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:16.963719 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f3aed-1052-4a42-abf3-b35a39900fd6 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:17.060947 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:17.070700 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea8feb1-6f04-403e-962e-2b19d296a026 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:17.071072 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f3aed-1052-4a42-abf3-b35a39900fd6 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:17.085657 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:17.110471 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c4d43b-89f3-4d2a-8852-f21e8bb99e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:17.110718 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1dce37-c931-4478-8618-d9cf3bb51e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:17.111108 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c4d43b-89f3-4d2a-8852-f21e8bb99e17 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:17.111445 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c4d43b-89f3-4d2a-8852-f21e8bb99e17 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:17.111542 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1dce37-c931-4478-8618-d9cf3bb51e78 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:17.111724 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c4d43b-89f3-4d2a-8852-f21e8bb99e17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:17.111982 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1dce37-c931-4478-8618-d9cf3bb51e78 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:17.112352 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1dce37-c931-4478-8618-d9cf3bb51e78 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:17.119751 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c4d43b-89f3-4d2a-8852-f21e8bb99e17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:17.121478 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c4d43b-89f3-4d2a-8852-f21e8bb99e17 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:17.125378 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1dce37-c931-4478-8618-d9cf3bb51e78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:16:17.130779 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-6f1dce37-c931-4478-8618-d9cf3bb51e78 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 15:16:17.130779 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:17.130779 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:17.130779 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:17.130779 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:17.130779 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:17.130779 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:17.130779 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:17.130779 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:17.130779 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:17.130779 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:17.130779 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:17.130779 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:16:17.130779 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:16:17.130779 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:16:17.130779 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:16:17.132072 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:16:17.132072 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:16:17.132072 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:16:17.132072 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:16:17.132072 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:17.132072 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:17.132072 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:17.132072 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:17.132072 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:17.132072 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:17.132072 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:17.132072 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:17.132072 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:17.132072 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:17.132072 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:17.132072 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:17.133182 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:17.133182 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:17.133182 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:17.133182 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:17.133182 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:16:17.133182 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:16:17.133182 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:16:17.133182 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:16:17.133182 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:16:17.133182 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:16:17.133182 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 15:16:17.133182 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:17.135645 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 313/643] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 2 15:16:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:17.136476 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-a4c4d43b-89f3-4d2a-8852-f21e8bb99e17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:16:17.136476 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:17.136476 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:17.136476 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:17.136476 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:17.136476 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:17.136476 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:17.136476 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:17.136476 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:17.136476 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:17.136476 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:17.136476 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:17.136476 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 15:16:17.136476 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 15:16:17.136476 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 15:16:17.137539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 15:16:17.137539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:17.137539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:17.137539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:17.137539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:17.137539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:17.137539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:17.137539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:17.137539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:17.137539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:17.137539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:17.137539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:17.137539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:17.137539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:17.137539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:17.137539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:17.137539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:17.138715 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 15:16:17.138715 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 15:16:17.138715 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 15:16:17.138715 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 15:16:17.138715 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 15:16:17.138715 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 15:16:17.138715 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:16:17.138715 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:17.138715 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 331/644] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 2 15:16:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:17.139326 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c4d43b-89f3-4d2a-8852-f21e8bb99e17 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:17.139707 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1dce37-c931-4478-8618-d9cf3bb51e78 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:17.249909 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c4d43b-89f3-4d2a-8852-f21e8bb99e17 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:17.253069 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1dce37-c931-4478-8618-d9cf3bb51e78 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:17.283948 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba7e7a-72a1-473d-a4c0-ee427b4009bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:17.284590 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba7e7a-72a1-473d-a4c0-ee427b4009bf None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:17.284870 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba7e7a-72a1-473d-a4c0-ee427b4009bf None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:17.285145 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba7e7a-72a1-473d-a4c0-ee427b4009bf None admin] PATH_INFO: `/v3/users/glance` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:17.294097 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ba7e7a-72a1-473d-a4c0-ee427b4009bf None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:17.295595 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ba7e7a-72a1-473d-a4c0-ee427b4009bf None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:17.298327 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c703c-ad93-4b68-8f15-77cc63b6862c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:17.298951 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c703c-ad93-4b68-8f15-77cc63b6862c None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:17.299257 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c703c-ad93-4b68-8f15-77cc63b6862c None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:17.299538 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c703c-ad93-4b68-8f15-77cc63b6862c None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:17.300258 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174c703c-ad93-4b68-8f15-77cc63b6862c None admin] RBAC: Adding query filter params (name=service) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:17.300564 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174c703c-ad93-4b68-8f15-77cc63b6862c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:17.302517 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174c703c-ad93-4b68-8f15-77cc63b6862c None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:17.307884 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-54ba7e7a-72a1-473d-a4c0-ee427b4009bf None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 02 15:16:17.307884 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:17.307884 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:17.307884 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:17.307884 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:17.307884 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:17.307884 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:17.307884 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:17.307884 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:17.307884 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:17.307884 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:17.307884 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:17.307884 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 15:16:17.307884 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 15:16:17.307884 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 15:16:17.307884 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 15:16:17.308853 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:17.308853 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:17.308853 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 15:16:17.308853 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:16:17.308853 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 15:16:17.308853 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:16:17.308853 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:17.308853 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:17.308853 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:17.308853 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:17.308853 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:17.308853 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:17.308853 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:17.308853 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:17.308853 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:17.308853 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:17.308853 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:17.308853 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:17.309793 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:17.309793 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:17.309793 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 15:16:17.309793 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 15:16:17.309793 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 15:16:17.309793 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 15:16:17.309793 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 15:16:17.309793 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 15:16:17.309793 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 02 15:16:17.309793 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:17.309793 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 332/645] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 2 15:16:17 2022] GET /identity/v3/users/glance => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:17.309793 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba7e7a-72a1-473d-a4c0-ee427b4009bf None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:17.314032 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 314/646] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Aug 2 15:16:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:17.315105 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c703c-ad93-4b68-8f15-77cc63b6862c None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:17.332452 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:17.353544 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:17.436820 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c703c-ad93-4b68-8f15-77cc63b6862c None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:17.437432 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba7e7a-72a1-473d-a4c0-ee427b4009bf None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:17.475238 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd9849-cd10-4266-bbdb-e9861f3c3c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:17.475861 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ae12c0-8ac6-4cad-8076-a2bd23790994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:17.475973 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd9849-cd10-4266-bbdb-e9861f3c3c02 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:17.476143 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd9849-cd10-4266-bbdb-e9861f3c3c02 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:17.476421 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd9849-cd10-4266-bbdb-e9861f3c3c02 None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:17.476830 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae12c0-8ac6-4cad-8076-a2bd23790994 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:17.477135 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd9849-cd10-4266-bbdb-e9861f3c3c02 None admin] RBAC: Adding query filter params (name=service) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:17.477299 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae12c0-8ac6-4cad-8076-a2bd23790994 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:17.477501 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd9849-cd10-4266-bbdb-e9861f3c3c02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:17.477606 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae12c0-8ac6-4cad-8076-a2bd23790994 None admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:17.478350 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ae12c0-8ac6-4cad-8076-a2bd23790994 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:17.478666 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ae12c0-8ac6-4cad-8076-a2bd23790994 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:17.478884 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd9849-cd10-4266-bbdb-e9861f3c3c02 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:17.480269 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ae12c0-8ac6-4cad-8076-a2bd23790994 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:17.487841 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 333/647] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Aug 2 15:16:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:17.488666 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd9849-cd10-4266-bbdb-e9861f3c3c02 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:17.497634 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 315/648] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 2 15:16:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:17.498452 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ae12c0-8ac6-4cad-8076-a2bd23790994 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:17.597558 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:17.610962 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:17.618527 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd9849-cd10-4266-bbdb-e9861f3c3c02 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:17.630344 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ae12c0-8ac6-4cad-8076-a2bd23790994 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:17.655012 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59159379-4ad2-4e15-a726-df8b41c84b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:17.655676 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59159379-4ad2-4e15-a726-df8b41c84b71 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:17.655961 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59159379-4ad2-4e15-a726-df8b41c84b71 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:17.656244 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59159379-4ad2-4e15-a726-df8b41c84b71 None admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:17.657036 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59159379-4ad2-4e15-a726-df8b41c84b71 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:17.657348 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59159379-4ad2-4e15-a726-df8b41c84b71 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:17.658805 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59159379-4ad2-4e15-a726-df8b41c84b71 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:17.668555 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef2ebf-5ccb-4022-8714-9ae064a0d23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:17.669463 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef2ebf-5ccb-4022-8714-9ae064a0d23c None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:17.669741 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef2ebf-5ccb-4022-8714-9ae064a0d23c None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:17.670079 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef2ebf-5ccb-4022-8714-9ae064a0d23c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:17.679134 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 334/649] 10.222.0.42 () {56 vars in 1137 bytes} [Tue Aug 2 15:16:17 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:17.680348 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59159379-4ad2-4e15-a726-df8b41c84b71 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:17.686937 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ef2ebf-5ccb-4022-8714-9ae064a0d23c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:17.688157 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ef2ebf-5ccb-4022-8714-9ae064a0d23c None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:17.705743 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-e5ef2ebf-5ccb-4022-8714-9ae064a0d23c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:17.705743 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:17.705743 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:17.705743 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:17.705743 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:17.705743 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:17.705743 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:17.705743 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:17.705743 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:17.705743 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:17.705743 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:17.705743 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:17.705743 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:16:17.705743 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:16:17.705743 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:16:17.706789 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:16:17.706789 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:17.706789 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:17.706789 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:17.706789 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:17.706789 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:17.706789 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:17.706789 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:17.706789 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:17.706789 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:17.706789 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:17.706789 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:17.706789 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:17.706789 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:17.706789 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:17.706789 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:17.706789 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:17.714762 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:16:17.714762 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:16:17.714762 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:17.714762 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:17.714762 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 316/650] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:16:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:17.714762 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef2ebf-5ccb-4022-8714-9ae064a0d23c None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:17.808524 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59159379-4ad2-4e15-a726-df8b41c84b71 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:17.833823 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef2ebf-5ccb-4022-8714-9ae064a0d23c None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:17.850287 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfedad0d-9a9f-4e0d-8fb1-93b35104605d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:17.850994 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfedad0d-9a9f-4e0d-8fb1-93b35104605d None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:17.851320 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfedad0d-9a9f-4e0d-8fb1-93b35104605d None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:17.851612 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfedad0d-9a9f-4e0d-8fb1-93b35104605d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:17.862704 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfedad0d-9a9f-4e0d-8fb1-93b35104605d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:17.862905 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:17.864361 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfedad0d-9a9f-4e0d-8fb1-93b35104605d None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:17.874162 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cff777-0de9-4633-ba92-c6abc16c781d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:17.874892 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cff777-0de9-4633-ba92-c6abc16c781d None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:17.875177 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cff777-0de9-4633-ba92-c6abc16c781d None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:17.875504 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cff777-0de9-4633-ba92-c6abc16c781d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:17.876269 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cff777-0de9-4633-ba92-c6abc16c781d None admin] RBAC: Adding query filter params (role.id=532162a00de849cea5c27767c8acd018, scope.project.id=cc19d22b4cd64dd1bc89ed78155d2732, user.id=4c0865af59bf43dfa4c84213d7db53c5) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:17.876585 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cff777-0de9-4633-ba92-c6abc16c781d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:17.878147 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cff777-0de9-4633-ba92-c6abc16c781d None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:17.881482 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-dfedad0d-9a9f-4e0d-8fb1-93b35104605d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:17.881482 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:17.881482 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:17.881482 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:17.881482 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:17.881482 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:17.881482 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:17.881482 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:17.881482 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:17.881482 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:17.881482 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:17.881482 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:17.881482 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:16:17.881482 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:16:17.881482 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:16:17.882353 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:16:17.882353 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:17.882353 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:17.882353 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:17.882353 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:17.882353 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:17.882353 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:17.882353 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:17.882353 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:17.882353 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:17.882353 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:17.882353 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:17.882353 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:17.882353 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:17.882353 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:17.882353 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:17.882353 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:17.883297 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:16:17.883297 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:16:17.883297 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:17.883297 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:17.883297 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 335/651] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:16:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:17.883603 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfedad0d-9a9f-4e0d-8fb1-93b35104605d None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:17.888401 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:17.899247 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 317/652] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 2 15:16:17 2022] GET /identity/v3/role_assignments?user.id=4c0865af59bf43dfa4c84213d7db53c5&scope.project.id=cc19d22b4cd64dd1bc89ed78155d2732&role.id=532162a00de849cea5c27767c8acd018 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:17.899247 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cff777-0de9-4633-ba92-c6abc16c781d None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:18.030273 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfedad0d-9a9f-4e0d-8fb1-93b35104605d None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:18.032497 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cff777-0de9-4633-ba92-c6abc16c781d None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:18.075513 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b8d648-42fc-4515-8e19-865d4ed858bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:18.076386 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8d648-42fc-4515-8e19-865d4ed858bb None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:18.076858 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8d648-42fc-4515-8e19-865d4ed858bb None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:18.077197 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8d648-42fc-4515-8e19-865d4ed858bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:18.090442 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eca6389-eb1f-4b33-a1cc-8eeec4b19036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:18.091077 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca6389-eb1f-4b33-a1cc-8eeec4b19036 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:18.091448 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca6389-eb1f-4b33-a1cc-8eeec4b19036 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:18.091720 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca6389-eb1f-4b33-a1cc-8eeec4b19036 None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:18.092412 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eca6389-eb1f-4b33-a1cc-8eeec4b19036 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:18.092723 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eca6389-eb1f-4b33-a1cc-8eeec4b19036 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:18.094124 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eca6389-eb1f-4b33-a1cc-8eeec4b19036 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:18.109828 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 318/653] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:16:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:18.110514 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eca6389-eb1f-4b33-a1cc-8eeec4b19036 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:18.167713 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b8d648-42fc-4515-8e19-865d4ed858bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:18.169216 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b8d648-42fc-4515-8e19-865d4ed858bb None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:18.173858 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:18.187787 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:18.262720 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eca6389-eb1f-4b33-a1cc-8eeec4b19036 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:18.296878 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 336/654] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 2 15:16:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 15:16:18.296878 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b8d648-42fc-4515-8e19-865d4ed858bb None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:18.320480 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0eebed-1ada-4920-857e-c131bcdeaee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:18.321377 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0eebed-1ada-4920-857e-c131bcdeaee5 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:18.322085 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0eebed-1ada-4920-857e-c131bcdeaee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:18.322513 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0eebed-1ada-4920-857e-c131bcdeaee5 None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:18.324384 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0eebed-1ada-4920-857e-c131bcdeaee5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:18.324651 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0eebed-1ada-4920-857e-c131bcdeaee5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:18.326057 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0eebed-1ada-4920-857e-c131bcdeaee5 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:18.339137 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 319/655] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:16:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:18.340785 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0eebed-1ada-4920-857e-c131bcdeaee5 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:18.427650 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b8d648-42fc-4515-8e19-865d4ed858bb None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:18.431171 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:18.448109 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0eebed-1ada-4920-857e-c131bcdeaee5 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:18.459897 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:18.475716 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0e30af-283e-4c80-88c3-9e4ed53379a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:18.477136 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e30af-283e-4c80-88c3-9e4ed53379a3 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:18.477943 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e30af-283e-4c80-88c3-9e4ed53379a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:18.478650 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e30af-283e-4c80-88c3-9e4ed53379a3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:18.488630 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0e30af-283e-4c80-88c3-9e4ed53379a3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:18.488903 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b64fff-b16a-4d89-a75f-4a44c1cec6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:18.489694 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b64fff-b16a-4d89-a75f-4a44c1cec6d8 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:18.490048 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b64fff-b16a-4d89-a75f-4a44c1cec6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:18.490417 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b64fff-b16a-4d89-a75f-4a44c1cec6d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:18.492371 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0e30af-283e-4c80-88c3-9e4ed53379a3 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:18.505709 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b64fff-b16a-4d89-a75f-4a44c1cec6d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:18.506347 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-6a0e30af-283e-4c80-88c3-9e4ed53379a3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 02 15:16:18.506347 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:18.506347 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:18.506347 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:18.506347 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:18.506347 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:18.506347 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:18.506347 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:18.506347 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:18.506347 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:18.506347 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:18.506347 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:18.506347 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 15:16:18.506347 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 15:16:18.506347 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 15:16:18.506347 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 15:16:18.507259 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:18.507259 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:18.507259 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 15:16:18.507259 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:16:18.507259 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 15:16:18.507259 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:16:18.507259 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:18.507259 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:18.507259 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:18.507259 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:18.507259 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:18.507259 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:18.507259 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:18.507259 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:18.507259 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:18.507259 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:18.507259 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:18.507259 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:18.508194 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:18.508194 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:18.508194 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 15:16:18.508194 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 15:16:18.508194 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 15:16:18.508194 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 15:16:18.508194 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 15:16:18.508194 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 15:16:18.508194 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 02 15:16:18.508194 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:18.508194 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 337/656] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 2 15:16:18 2022] GET /identity/v3/users/neutron => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:18.509346 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0e30af-283e-4c80-88c3-9e4ed53379a3 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:18.510839 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b64fff-b16a-4d89-a75f-4a44c1cec6d8 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:18.531940 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-45b64fff-b16a-4d89-a75f-4a44c1cec6d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:18.531940 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:18.531940 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:18.531940 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:18.531940 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:18.531940 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:18.531940 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:18.531940 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:18.531940 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:18.531940 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:18.531940 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:18.531940 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:18.531940 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:16:18.531940 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:16:18.531940 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:16:18.532877 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:16:18.532877 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:18.532877 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:18.532877 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:18.532877 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:18.532877 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:18.532877 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:18.532877 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:18.532877 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:18.532877 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:18.532877 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:18.532877 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:18.532877 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:18.532877 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:18.532877 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:18.532877 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:18.532877 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:18.533753 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:16:18.533753 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:16:18.533753 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:18.533753 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:18.533753 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 320/657] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:16:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:18.535392 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b64fff-b16a-4d89-a75f-4a44c1cec6d8 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:18.649435 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b64fff-b16a-4d89-a75f-4a44c1cec6d8 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:18.659596 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0e30af-283e-4c80-88c3-9e4ed53379a3 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:18.691252 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4722c2-6a0e-4b33-9d0b-983b40355506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:18.692636 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4722c2-6a0e-4b33-9d0b-983b40355506 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:18.693125 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4722c2-6a0e-4b33-9d0b-983b40355506 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:18.693425 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4722c2-6a0e-4b33-9d0b-983b40355506 None admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:18.694232 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4722c2-6a0e-4b33-9d0b-983b40355506 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:18.694546 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4722c2-6a0e-4b33-9d0b-983b40355506 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:18.696050 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4722c2-6a0e-4b33-9d0b-983b40355506 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:18.703479 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acd4d18-27ee-4524-a35d-ef459a75c051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:18.704521 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd4d18-27ee-4524-a35d-ef459a75c051 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:18.705312 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd4d18-27ee-4524-a35d-ef459a75c051 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:18.705771 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd4d18-27ee-4524-a35d-ef459a75c051 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:18.717917 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acd4d18-27ee-4524-a35d-ef459a75c051 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:18.719000 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 321/658] 10.222.0.42 () {56 vars in 1139 bytes} [Tue Aug 2 15:16:18 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:18.720337 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482091c8-3735-461e-97cc-c868f99e4b7f None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:18.720626 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482091c8-3735-461e-97cc-c868f99e4b7f None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:18.720834 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acd4d18-27ee-4524-a35d-ef459a75c051 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:18.720932 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482091c8-3735-461e-97cc-c868f99e4b7f None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:18.722307 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 322/659] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:16:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:16:18.723999 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482091c8-3735-461e-97cc-c868f99e4b7f None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:18.739947 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-4acd4d18-27ee-4524-a35d-ef459a75c051 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 02 15:16:18.739947 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:18.739947 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:18.739947 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:18.739947 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:18.739947 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:18.739947 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:18.739947 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:18.739947 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:18.739947 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:18.739947 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:18.739947 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:18.739947 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 15:16:18.739947 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 15:16:18.739947 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 15:16:18.739947 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 15:16:18.740970 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:18.740970 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:18.740970 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 15:16:18.740970 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:16:18.740970 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 15:16:18.740970 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:16:18.740970 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:18.740970 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:18.740970 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:18.740970 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:18.740970 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:18.740970 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:18.740970 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:18.740970 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:18.740970 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:18.740970 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:18.740970 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:18.740970 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:18.741899 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:18.741899 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:18.741899 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 15:16:18.741899 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 15:16:18.741899 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 15:16:18.741899 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 15:16:18.741899 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 15:16:18.741899 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 15:16:18.741899 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 02 15:16:18.741899 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:18.741899 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 338/660] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 2 15:16:18 2022] GET /identity/v3/users/cinder => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:18.741899 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acd4d18-27ee-4524-a35d-ef459a75c051 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:18.755019 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:18.772272 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:18.851649 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482091c8-3735-461e-97cc-c868f99e4b7f None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:18.854111 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acd4d18-27ee-4524-a35d-ef459a75c051 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:18.888875 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d76b2-2d96-4bb5-9acd-8b42d8e8ab6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:18.889612 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d76b2-2d96-4bb5-9acd-8b42d8e8ab6f None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:18.889953 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d76b2-2d96-4bb5-9acd-8b42d8e8ab6f None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:18.890299 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d76b2-2d96-4bb5-9acd-8b42d8e8ab6f None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:18.890996 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9d76b2-2d96-4bb5-9acd-8b42d8e8ab6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:18.891338 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9d76b2-2d96-4bb5-9acd-8b42d8e8ab6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:18.892778 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9d76b2-2d96-4bb5-9acd-8b42d8e8ab6f None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:18.893259 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e9b85-4da8-4962-96c5-71ea5df71123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:18.894106 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e9b85-4da8-4962-96c5-71ea5df71123 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:18.894873 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e9b85-4da8-4962-96c5-71ea5df71123 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:18.895987 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e9b85-4da8-4962-96c5-71ea5df71123 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:18.905330 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 323/661] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:16:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:18.906514 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d530cf-264d-48e7-985b-ef1460f745e4 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:18.906800 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d530cf-264d-48e7-985b-ef1460f745e4 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:18.907078 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d530cf-264d-48e7-985b-ef1460f745e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:18.926291 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-13d530cf-264d-48e7-985b-ef1460f745e4 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:16:18.928121 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-13d530cf-264d-48e7-985b-ef1460f745e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:16:18.983305 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9e9b85-4da8-4962-96c5-71ea5df71123 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:18.985121 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9e9b85-4da8-4962-96c5-71ea5df71123 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:19.003527 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 324/662] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:16:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:16:19.004321 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d530cf-264d-48e7-985b-ef1460f745e4 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:19.016720 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:19.031041 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:19.108970 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 339/663] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 2 15:16:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 15:16:19.114341 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e9b85-4da8-4962-96c5-71ea5df71123 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:19.166005 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d530cf-264d-48e7-985b-ef1460f745e4 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:19.210010 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dace928e-a007-49ba-8b1f-766a4052fcf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:19.211095 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace928e-a007-49ba-8b1f-766a4052fcf0 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:19.212180 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace928e-a007-49ba-8b1f-766a4052fcf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:19.212906 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace928e-a007-49ba-8b1f-766a4052fcf0 None admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:19.213891 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dace928e-a007-49ba-8b1f-766a4052fcf0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:19.214495 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dace928e-a007-49ba-8b1f-766a4052fcf0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:19.216488 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dace928e-a007-49ba-8b1f-766a4052fcf0 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:19.231561 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e9b85-4da8-4962-96c5-71ea5df71123 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:19.247438 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 325/664] 10.222.0.42 () {56 vars in 1137 bytes} [Tue Aug 2 15:16:19 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:19.247438 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dace928e-a007-49ba-8b1f-766a4052fcf0 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:19.258595 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:19.274265 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4498ca7b-2982-475f-adec-c1b46d8b5c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:19.274923 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498ca7b-2982-475f-adec-c1b46d8b5c8f None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:19.275229 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498ca7b-2982-475f-adec-c1b46d8b5c8f None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:19.275527 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498ca7b-2982-475f-adec-c1b46d8b5c8f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:19.282948 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4498ca7b-2982-475f-adec-c1b46d8b5c8f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:19.284478 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4498ca7b-2982-475f-adec-c1b46d8b5c8f None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:19.298411 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-4498ca7b-2982-475f-adec-c1b46d8b5c8f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:16:19.298411 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:19.298411 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:19.298411 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:19.298411 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:19.298411 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:19.298411 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:19.298411 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:19.298411 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:19.298411 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:19.298411 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:19.298411 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:19.298411 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 15:16:19.298411 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 15:16:19.298411 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 15:16:19.299511 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 15:16:19.299511 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:19.299511 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:19.299511 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:19.299511 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:19.299511 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:19.299511 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:19.299511 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:19.299511 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:19.299511 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:19.299511 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:19.299511 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:19.299511 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:19.299511 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:19.299511 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:19.299511 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:19.299511 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:19.300526 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 15:16:19.300526 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 15:16:19.300526 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 15:16:19.300526 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 15:16:19.300526 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 15:16:19.300526 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 15:16:19.300526 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:16:19.300526 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:19.300526 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 340/665] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 2 15:16:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:19.300526 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4498ca7b-2982-475f-adec-c1b46d8b5c8f None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:19.323423 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:19.360840 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dace928e-a007-49ba-8b1f-766a4052fcf0 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:19.407379 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65c4280-417b-4fb5-886f-3e32978eefb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:19.408028 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c4280-417b-4fb5-886f-3e32978eefb6 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:19.408307 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c4280-417b-4fb5-886f-3e32978eefb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:19.408593 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c4280-417b-4fb5-886f-3e32978eefb6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:19.419837 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65c4280-417b-4fb5-886f-3e32978eefb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:16:19.420732 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4498ca7b-2982-475f-adec-c1b46d8b5c8f None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:19.424596 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-b65c4280-417b-4fb5-886f-3e32978eefb6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 15:16:19.424596 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:19.424596 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:19.424596 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:19.424596 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:19.424596 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:19.424596 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:19.424596 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:19.424596 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:19.424596 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:19.424596 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:19.424596 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:19.424596 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:16:19.424596 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:16:19.424596 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:16:19.424596 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:16:19.425517 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:16:19.425517 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:16:19.425517 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:16:19.425517 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:16:19.425517 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:19.425517 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:19.425517 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:19.425517 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:19.425517 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:19.425517 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:19.425517 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:19.425517 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:19.425517 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:19.425517 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:19.425517 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:19.425517 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:19.426386 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:19.426386 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:19.426386 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:19.426386 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:19.426386 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:16:19.426386 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:16:19.426386 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:16:19.426386 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:16:19.426386 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:16:19.426386 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:16:19.426386 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 15:16:19.426386 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:19.426386 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 326/666] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 2 15:16:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:19.427071 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65c4280-417b-4fb5-886f-3e32978eefb6 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:19.467120 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b3cf4d-1de2-4cbc-bce3-0b6e63b58296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:19.468145 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3cf4d-1de2-4cbc-bce3-0b6e63b58296 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:19.469089 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3cf4d-1de2-4cbc-bce3-0b6e63b58296 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:19.469589 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3cf4d-1de2-4cbc-bce3-0b6e63b58296 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:19.480676 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b3cf4d-1de2-4cbc-bce3-0b6e63b58296 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:19.483283 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b3cf4d-1de2-4cbc-bce3-0b6e63b58296 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:19.498676 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-b0b3cf4d-1de2-4cbc-bce3-0b6e63b58296 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:19.498676 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:19.498676 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:19.498676 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:19.498676 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:19.498676 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:19.498676 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:19.498676 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:19.498676 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:19.498676 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:19.498676 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:19.498676 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:19.498676 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:16:19.498676 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:16:19.498676 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:16:19.499798 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:16:19.499798 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:19.499798 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:19.499798 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:19.499798 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:19.499798 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:19.499798 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:19.499798 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:19.499798 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:19.499798 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:19.499798 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:19.499798 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:19.499798 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:19.499798 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:19.499798 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:19.499798 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:19.499798 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:19.500911 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:16:19.500911 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:16:19.500911 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:19.500911 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:19.502412 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 341/667] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:16:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:19.503474 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b3cf4d-1de2-4cbc-bce3-0b6e63b58296 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:19.534499 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65c4280-417b-4fb5-886f-3e32978eefb6 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:19.544275 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:19.564123 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:19.573742 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf8b37-5d65-402c-b11b-10aa436339f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:19.574715 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf8b37-5d65-402c-b11b-10aa436339f3 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:19.574984 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf8b37-5d65-402c-b11b-10aa436339f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:19.575275 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf8b37-5d65-402c-b11b-10aa436339f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:19.616221 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b3cf4d-1de2-4cbc-bce3-0b6e63b58296 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:19.652301 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdf8b37-5d65-402c-b11b-10aa436339f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:19.653854 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdf8b37-5d65-402c-b11b-10aa436339f3 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:19.655681 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bbabd4-32ec-42c0-add1-2938d2c7ee3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:19.656187 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bbabd4-32ec-42c0-add1-2938d2c7ee3d None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:19.657653 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bbabd4-32ec-42c0-add1-2938d2c7ee3d None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:19.657653 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bbabd4-32ec-42c0-add1-2938d2c7ee3d None admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:19.657653 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bbabd4-32ec-42c0-add1-2938d2c7ee3d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:19.658023 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bbabd4-32ec-42c0-add1-2938d2c7ee3d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:19.659316 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bbabd4-32ec-42c0-add1-2938d2c7ee3d None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:19.679535 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 342/668] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 2 15:16:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:19.679535 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bbabd4-32ec-42c0-add1-2938d2c7ee3d None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:19.765482 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 327/669] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 2 15:16:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 15:16:19.766684 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf8b37-5d65-402c-b11b-10aa436339f3 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:19.789332 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:19.797158 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bbabd4-32ec-42c0-add1-2938d2c7ee3d None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:19.797359 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:19.836678 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9a5977-5855-42c3-a964-ff45deb9d24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:19.837300 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a5977-5855-42c3-a964-ff45deb9d24e None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:19.837579 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a5977-5855-42c3-a964-ff45deb9d24e None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:19.837854 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a5977-5855-42c3-a964-ff45deb9d24e None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:19.838568 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9a5977-5855-42c3-a964-ff45deb9d24e None admin] RBAC: Adding query filter params (name=service) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:19.838875 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9a5977-5855-42c3-a964-ff45deb9d24e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:19.840292 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9a5977-5855-42c3-a964-ff45deb9d24e None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:19.848643 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 343/670] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Aug 2 15:16:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:19.853727 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9a5977-5855-42c3-a964-ff45deb9d24e None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:19.883710 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf8b37-5d65-402c-b11b-10aa436339f3 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:19.918779 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f7be7-f376-41bd-93e0-85b516609fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:19.919435 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f7be7-f376-41bd-93e0-85b516609fc8 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:19.919717 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f7be7-f376-41bd-93e0-85b516609fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:19.919989 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f7be7-f376-41bd-93e0-85b516609fc8 None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:19.920671 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8f7be7-f376-41bd-93e0-85b516609fc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:19.920973 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8f7be7-f376-41bd-93e0-85b516609fc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:19.922324 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8f7be7-f376-41bd-93e0-85b516609fc8 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:19.935201 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 328/671] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:16:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:19.940074 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f7be7-f376-41bd-93e0-85b516609fc8 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:19.967181 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9a5977-5855-42c3-a964-ff45deb9d24e None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:20.009933 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc81822-fa29-42a1-9531-657cfc6e3147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:20.010720 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc81822-fa29-42a1-9531-657cfc6e3147 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:20.011126 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc81822-fa29-42a1-9531-657cfc6e3147 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:20.011537 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc81822-fa29-42a1-9531-657cfc6e3147 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:20.012400 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc81822-fa29-42a1-9531-657cfc6e3147 None admin] RBAC: Adding query filter params (role.id=532162a00de849cea5c27767c8acd018, scope.project.id=cc19d22b4cd64dd1bc89ed78155d2732, user.id=946af31d75ca41a2a4301e0294cf98f3) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:20.013100 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc81822-fa29-42a1-9531-657cfc6e3147 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:20.014597 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc81822-fa29-42a1-9531-657cfc6e3147 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:20.031248 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 344/672] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 2 15:16:19 2022] GET /identity/v3/role_assignments?user.id=946af31d75ca41a2a4301e0294cf98f3&scope.project.id=cc19d22b4cd64dd1bc89ed78155d2732&role.id=532162a00de849cea5c27767c8acd018 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:20.031248 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc81822-fa29-42a1-9531-657cfc6e3147 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:20.047778 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:20.065434 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f7be7-f376-41bd-93e0-85b516609fc8 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:20.067549 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:20.122615 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b598cd-9465-4a31-986f-74fd182a6c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:20.123905 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b598cd-9465-4a31-986f-74fd182a6c76 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:20.124171 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b598cd-9465-4a31-986f-74fd182a6c76 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:20.124518 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b598cd-9465-4a31-986f-74fd182a6c76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:20.137366 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b598cd-9465-4a31-986f-74fd182a6c76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:20.138962 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b598cd-9465-4a31-986f-74fd182a6c76 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:20.155788 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-c8b598cd-9465-4a31-986f-74fd182a6c76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:20.155788 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:20.155788 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:20.155788 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:20.155788 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:20.155788 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:20.155788 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:20.155788 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:20.155788 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:20.155788 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:20.155788 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:20.155788 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:20.155788 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:16:20.155788 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:16:20.155788 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:16:20.157034 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:16:20.157034 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:20.157034 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:20.157034 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:20.157034 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:20.157034 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:20.157034 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:20.157034 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:20.157034 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:20.157034 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:20.157034 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:20.157034 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:20.157034 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:20.157034 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:20.157034 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:20.157034 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:20.157034 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:20.158128 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:16:20.158128 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:16:20.158128 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:20.158128 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:20.159826 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 329/673] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:16:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:20.162144 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b598cd-9465-4a31-986f-74fd182a6c76 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:20.179886 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc81822-fa29-42a1-9531-657cfc6e3147 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:20.222081 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb015c-cd25-46dc-b94c-49bb9cf03144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:20.222669 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb015c-cd25-46dc-b94c-49bb9cf03144 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:20.222955 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb015c-cd25-46dc-b94c-49bb9cf03144 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:20.223980 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb015c-cd25-46dc-b94c-49bb9cf03144 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:20.236546 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cb015c-cd25-46dc-b94c-49bb9cf03144 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:20.238035 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cb015c-cd25-46dc-b94c-49bb9cf03144 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:20.254214 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-74cb015c-cd25-46dc-b94c-49bb9cf03144 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:20.254214 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:20.254214 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:20.254214 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:20.254214 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:20.254214 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:20.254214 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:20.254214 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:20.254214 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:20.254214 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:20.254214 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:20.254214 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:20.254214 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:16:20.254214 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:16:20.254214 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:16:20.255406 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:16:20.255406 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:20.255406 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:20.255406 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:20.255406 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:20.255406 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:20.255406 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:20.255406 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:20.255406 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:20.255406 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:20.255406 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:20.255406 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:20.255406 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:20.255406 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:20.255406 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:20.255406 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:20.255406 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:20.256467 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:16:20.256467 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:16:20.256467 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:20.256467 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:20.256467 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 345/674] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:16:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:20.256796 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b6dd0-2e4f-4594-af25-756c07bc9e4c None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:20.257760 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b6dd0-2e4f-4594-af25-756c07bc9e4c None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:20.257760 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b6dd0-2e4f-4594-af25-756c07bc9e4c None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:20.259676 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 346/675] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:16:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:16:20.259676 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b6dd0-2e4f-4594-af25-756c07bc9e4c None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:20.291658 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b598cd-9465-4a31-986f-74fd182a6c76 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:20.328242 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e8c876-d78e-4f0a-b1ef-7c7b500d7600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:20.329010 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e8c876-d78e-4f0a-b1ef-7c7b500d7600 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:20.329302 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e8c876-d78e-4f0a-b1ef-7c7b500d7600 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:20.329579 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e8c876-d78e-4f0a-b1ef-7c7b500d7600 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:20.337872 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e8c876-d78e-4f0a-b1ef-7c7b500d7600 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:20.339387 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e8c876-d78e-4f0a-b1ef-7c7b500d7600 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:20.344110 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:20.348850 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:20.359789 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-75e8c876-d78e-4f0a-b1ef-7c7b500d7600 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:16:20.359789 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:20.359789 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:20.359789 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:20.359789 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:20.359789 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:20.359789 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:20.359789 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:20.359789 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:20.359789 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:20.359789 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:20.359789 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:20.359789 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 15:16:20.359789 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 15:16:20.359789 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 15:16:20.360941 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 15:16:20.360941 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:20.360941 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:20.360941 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:20.360941 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:20.360941 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:20.360941 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:20.360941 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:20.360941 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:20.360941 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:20.360941 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:20.360941 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:20.360941 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:20.360941 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:20.360941 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:20.360941 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:20.360941 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:20.361819 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 15:16:20.361819 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 15:16:20.361819 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 15:16:20.361819 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 15:16:20.361819 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 15:16:20.361819 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 15:16:20.361819 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:16:20.361819 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:20.361819 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 330/676] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 2 15:16:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:20.361819 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e8c876-d78e-4f0a-b1ef-7c7b500d7600 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:20.381412 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b6dd0-2e4f-4594-af25-756c07bc9e4c None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:20.424223 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aa10bd-f02f-4bcf-b785-3134d50da5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:20.424847 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa10bd-f02f-4bcf-b785-3134d50da5b0 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:20.425126 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa10bd-f02f-4bcf-b785-3134d50da5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:20.425402 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa10bd-f02f-4bcf-b785-3134d50da5b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:20.426092 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aa10bd-f02f-4bcf-b785-3134d50da5b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:20.426904 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aa10bd-f02f-4bcf-b785-3134d50da5b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:20.428347 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aa10bd-f02f-4bcf-b785-3134d50da5b0 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:20.442794 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 347/677] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:16:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:20.444456 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0ebae-e8ad-4daf-992c-d23b67b7869d None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:20.444954 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0ebae-e8ad-4daf-992c-d23b67b7869d None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:20.445449 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0ebae-e8ad-4daf-992c-d23b67b7869d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:20.464843 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-78a0ebae-e8ad-4daf-992c-d23b67b7869d None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:16:20.466018 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-78a0ebae-e8ad-4daf-992c-d23b67b7869d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:16:20.483871 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e8c876-d78e-4f0a-b1ef-7c7b500d7600 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:20.529167 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d57f5-c645-4a7e-9e9b-b4dd3208080b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:20.529920 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d57f5-c645-4a7e-9e9b-b4dd3208080b None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:20.530196 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d57f5-c645-4a7e-9e9b-b4dd3208080b None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:20.530474 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d57f5-c645-4a7e-9e9b-b4dd3208080b None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:20.531159 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776d57f5-c645-4a7e-9e9b-b4dd3208080b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:20.531491 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776d57f5-c645-4a7e-9e9b-b4dd3208080b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:20.533103 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776d57f5-c645-4a7e-9e9b-b4dd3208080b None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:20.543432 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 348/678] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:16:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:16:20.543432 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a0ebae-e8ad-4daf-992c-d23b67b7869d None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:20.557935 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 331/679] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:16:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:20.557935 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d57f5-c645-4a7e-9e9b-b4dd3208080b None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:20.614666 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:20.630151 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:20.656303 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a0ebae-e8ad-4daf-992c-d23b67b7869d None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:20.675913 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d57f5-c645-4a7e-9e9b-b4dd3208080b None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:20.698250 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d603ad00-eda0-4283-ae39-5dd765208697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:20.699107 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603ad00-eda0-4283-ae39-5dd765208697 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:20.699427 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603ad00-eda0-4283-ae39-5dd765208697 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:20.699704 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603ad00-eda0-4283-ae39-5dd765208697 None admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:20.700619 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d603ad00-eda0-4283-ae39-5dd765208697 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:20.701353 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d603ad00-eda0-4283-ae39-5dd765208697 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:20.703131 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d603ad00-eda0-4283-ae39-5dd765208697 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:20.719558 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 349/680] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 2 15:16:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:20.723675 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d603ad00-eda0-4283-ae39-5dd765208697 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:20.727440 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571ca89e-a8f4-4885-be25-5bb946f73e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:20.729023 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ca89e-a8f4-4885-be25-5bb946f73e3b None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:20.729342 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ca89e-a8f4-4885-be25-5bb946f73e3b None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:20.729573 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ca89e-a8f4-4885-be25-5bb946f73e3b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:20.738397 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571ca89e-a8f4-4885-be25-5bb946f73e3b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:20.740365 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571ca89e-a8f4-4885-be25-5bb946f73e3b None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:20.755933 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-571ca89e-a8f4-4885-be25-5bb946f73e3b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:16:20.755933 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:20.755933 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:20.755933 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:20.755933 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:20.755933 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:20.755933 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:20.755933 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:20.755933 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:20.755933 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:20.755933 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:20.755933 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:20.755933 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 15:16:20.755933 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 15:16:20.755933 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 15:16:20.757026 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 15:16:20.757026 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:20.757026 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:20.757026 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:20.757026 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:20.757026 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:20.757026 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:20.757026 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:20.757026 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:20.757026 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:20.757026 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:20.757026 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:20.757026 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:20.757026 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:20.757026 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:20.757026 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:20.757026 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:20.758097 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 15:16:20.758097 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 15:16:20.758097 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 15:16:20.758097 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 15:16:20.758097 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 15:16:20.758097 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 15:16:20.758097 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:16:20.758097 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:20.760496 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 332/681] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 2 15:16:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:20.761992 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571ca89e-a8f4-4885-be25-5bb946f73e3b None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:20.838982 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d603ad00-eda0-4283-ae39-5dd765208697 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:20.866974 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:20.881957 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b17cfd-0be4-4c7b-8e7f-1979db761fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:20.883016 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b17cfd-0be4-4c7b-8e7f-1979db761fa0 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:20.883519 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b17cfd-0be4-4c7b-8e7f-1979db761fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:20.883991 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b17cfd-0be4-4c7b-8e7f-1979db761fa0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:20.890218 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571ca89e-a8f4-4885-be25-5bb946f73e3b None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:20.892849 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b17cfd-0be4-4c7b-8e7f-1979db761fa0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:20.894324 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b17cfd-0be4-4c7b-8e7f-1979db761fa0 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:20.906470 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-14b17cfd-0be4-4c7b-8e7f-1979db761fa0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 02 15:16:20.906470 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:20.906470 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:20.906470 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:20.906470 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:20.906470 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:20.906470 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:20.906470 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:20.906470 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:20.906470 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:20.906470 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:20.906470 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:20.906470 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 15:16:20.906470 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 15:16:20.906470 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 15:16:20.906470 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 15:16:20.907631 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:20.907631 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:20.907631 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 15:16:20.907631 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:16:20.907631 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 15:16:20.907631 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:16:20.907631 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:20.907631 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:20.907631 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:20.907631 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:20.907631 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:20.907631 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:20.907631 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:20.907631 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:20.907631 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:20.907631 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:20.907631 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:20.907631 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:20.908583 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:20.908583 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:20.908583 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 15:16:20.908583 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 15:16:20.908583 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 15:16:20.908583 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 15:16:20.908583 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 15:16:20.908583 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 15:16:20.908583 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 02 15:16:20.908583 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:20.908583 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 350/682] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 2 15:16:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:20.908583 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b17cfd-0be4-4c7b-8e7f-1979db761fa0 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:20.919284 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:20.937223 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1a7f56-a337-44b6-b10e-8fa111437faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:20.937862 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a7f56-a337-44b6-b10e-8fa111437faa None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:20.938183 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a7f56-a337-44b6-b10e-8fa111437faa None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:20.938414 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a7f56-a337-44b6-b10e-8fa111437faa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:20.949411 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1a7f56-a337-44b6-b10e-8fa111437faa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:16:20.954775 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-1c1a7f56-a337-44b6-b10e-8fa111437faa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 15:16:20.954775 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:20.954775 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:20.954775 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:20.954775 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:20.954775 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:20.954775 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:20.954775 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:20.954775 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:20.954775 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:20.954775 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:20.954775 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:20.954775 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:16:20.954775 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:16:20.954775 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:16:20.954775 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:16:20.955736 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:16:20.955736 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:16:20.955736 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:16:20.955736 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:16:20.955736 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:20.955736 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:20.955736 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:20.955736 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:20.955736 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:20.955736 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:20.955736 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:20.955736 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:20.955736 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:20.955736 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:20.955736 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:20.955736 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:20.956556 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:20.956556 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:20.956556 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:20.956556 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:20.956556 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:16:20.956556 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:16:20.956556 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:16:20.956556 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:16:20.956556 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:16:20.956556 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:16:20.956556 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 15:16:20.956556 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:20.956556 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 333/683] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 2 15:16:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:20.957250 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1a7f56-a337-44b6-b10e-8fa111437faa None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:21.024410 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b17cfd-0be4-4c7b-8e7f-1979db761fa0 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:21.068889 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd21bd-7797-45b4-97f4-9ddb2603da07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:21.069509 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd21bd-7797-45b4-97f4-9ddb2603da07 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:21.069787 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd21bd-7797-45b4-97f4-9ddb2603da07 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:21.070059 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd21bd-7797-45b4-97f4-9ddb2603da07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:21.070849 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bd21bd-7797-45b4-97f4-9ddb2603da07 None admin] RBAC: Adding query filter params (role.id=532162a00de849cea5c27767c8acd018, scope.project.id=cc19d22b4cd64dd1bc89ed78155d2732, user.id=f6d1caa34f2b41bfbcc95fa58d85f004) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:21.071396 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bd21bd-7797-45b4-97f4-9ddb2603da07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:21.072878 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bd21bd-7797-45b4-97f4-9ddb2603da07 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:21.079408 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 351/684] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 2 15:16:20 2022] GET /identity/v3/role_assignments?user.id=f6d1caa34f2b41bfbcc95fa58d85f004&scope.project.id=cc19d22b4cd64dd1bc89ed78155d2732&role.id=532162a00de849cea5c27767c8acd018 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:21.080335 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd21bd-7797-45b4-97f4-9ddb2603da07 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:21.107934 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1a7f56-a337-44b6-b10e-8fa111437faa None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:21.162184 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:21.162957 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b6e19-c309-4958-ad36-e74c4779c48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:21.164447 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b6e19-c309-4958-ad36-e74c4779c48f None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:21.165138 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b6e19-c309-4958-ad36-e74c4779c48f None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:21.165602 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b6e19-c309-4958-ad36-e74c4779c48f None admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:21.166651 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5b6e19-c309-4958-ad36-e74c4779c48f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:21.167232 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5b6e19-c309-4958-ad36-e74c4779c48f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:21.169002 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5b6e19-c309-4958-ad36-e74c4779c48f None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:21.191971 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 334/685] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 2 15:16:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:21.191971 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b6e19-c309-4958-ad36-e74c4779c48f None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:21.232259 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd21bd-7797-45b4-97f4-9ddb2603da07 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:21.278562 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c00c45-d88b-49e6-9b59-94523e3c6e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:21.279473 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c00c45-d88b-49e6-9b59-94523e3c6e47 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:21.279899 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c00c45-d88b-49e6-9b59-94523e3c6e47 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:21.280317 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c00c45-d88b-49e6-9b59-94523e3c6e47 None admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:21.281293 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c00c45-d88b-49e6-9b59-94523e3c6e47 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:21.281797 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c00c45-d88b-49e6-9b59-94523e3c6e47 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:21.283493 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c00c45-d88b-49e6-9b59-94523e3c6e47 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:21.306506 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 352/686] 10.222.0.42 () {56 vars in 1135 bytes} [Tue Aug 2 15:16:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:21.307959 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c00c45-d88b-49e6-9b59-94523e3c6e47 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:21.367666 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:21.440609 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b6e19-c309-4958-ad36-e74c4779c48f None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:21.448255 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c00c45-d88b-49e6-9b59-94523e3c6e47 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:21.460093 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:21.485940 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9fa5fd-6a27-4fac-a0bd-21b415dcf582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:21.486829 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9fa5fd-6a27-4fac-a0bd-21b415dcf582 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:21.487112 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9fa5fd-6a27-4fac-a0bd-21b415dcf582 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:21.487417 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9fa5fd-6a27-4fac-a0bd-21b415dcf582 None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:21.488301 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9fa5fd-6a27-4fac-a0bd-21b415dcf582 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:21.488945 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9fa5fd-6a27-4fac-a0bd-21b415dcf582 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:21.491196 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9fa5fd-6a27-4fac-a0bd-21b415dcf582 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:21.497994 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2fb324-4b89-4324-a1b4-0ae6918f9260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:21.498729 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2fb324-4b89-4324-a1b4-0ae6918f9260 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:21.499651 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2fb324-4b89-4324-a1b4-0ae6918f9260 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:21.500094 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2fb324-4b89-4324-a1b4-0ae6918f9260 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:21.501262 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2fb324-4b89-4324-a1b4-0ae6918f9260 None admin] RBAC: Adding query filter params (role.id=532162a00de849cea5c27767c8acd018, scope.project.id=cc19d22b4cd64dd1bc89ed78155d2732, user.id=8d09126f1821420bb4218b611c89402a) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:21.501643 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2fb324-4b89-4324-a1b4-0ae6918f9260 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:21.503508 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2fb324-4b89-4324-a1b4-0ae6918f9260 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:21.507306 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 335/687] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 2 15:16:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:21.511759 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9fa5fd-6a27-4fac-a0bd-21b415dcf582 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:21.516502 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 353/688] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 2 15:16:21 2022] GET /identity/v3/role_assignments?user.id=8d09126f1821420bb4218b611c89402a&scope.project.id=cc19d22b4cd64dd1bc89ed78155d2732&role.id=532162a00de849cea5c27767c8acd018 => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:21.517434 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2fb324-4b89-4324-a1b4-0ae6918f9260 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:21.631189 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9fa5fd-6a27-4fac-a0bd-21b415dcf582 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:21.631390 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2fb324-4b89-4324-a1b4-0ae6918f9260 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:21.632727 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:21.669608 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ecbbe7-05c7-4fea-8c7e-93bd52845abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:21.670269 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ecbbe7-05c7-4fea-8c7e-93bd52845abc None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:21.670549 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ecbbe7-05c7-4fea-8c7e-93bd52845abc None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:21.670822 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ecbbe7-05c7-4fea-8c7e-93bd52845abc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:21.680800 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b837ef-fadf-4d79-9b76-7eda44a0c232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:21.681482 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b837ef-fadf-4d79-9b76-7eda44a0c232 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:21.681801 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b837ef-fadf-4d79-9b76-7eda44a0c232 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:21.682079 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b837ef-fadf-4d79-9b76-7eda44a0c232 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:21.684180 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ecbbe7-05c7-4fea-8c7e-93bd52845abc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:21.685704 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ecbbe7-05c7-4fea-8c7e-93bd52845abc None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:21.702198 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-f5ecbbe7-05c7-4fea-8c7e-93bd52845abc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:21.702198 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:21.702198 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:21.702198 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:21.702198 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:21.702198 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:21.702198 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:21.702198 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:21.702198 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:21.702198 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:21.702198 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:21.702198 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:21.702198 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:16:21.702198 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:16:21.702198 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:16:21.704444 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:16:21.704444 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:21.704444 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:21.704444 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:21.704444 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:21.704444 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:21.704444 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:21.704444 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:21.704444 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:21.704444 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:21.704444 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:21.704444 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:21.704444 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:21.704444 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:21.704444 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:21.704444 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:21.704444 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:21.706617 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:16:21.706617 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:16:21.706617 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:21.706617 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:21.706617 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 354/689] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:16:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:21.709940 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ecbbe7-05c7-4fea-8c7e-93bd52845abc None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:21.737714 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:21.838957 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b837ef-fadf-4d79-9b76-7eda44a0c232 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:21.840669 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b837ef-fadf-4d79-9b76-7eda44a0c232 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:21.850127 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ecbbe7-05c7-4fea-8c7e-93bd52845abc None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:21.887147 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79102ce-736e-4178-9e94-a8ef86f22474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:21.887947 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79102ce-736e-4178-9e94-a8ef86f22474 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:21.888236 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79102ce-736e-4178-9e94-a8ef86f22474 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:21.888514 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79102ce-736e-4178-9e94-a8ef86f22474 None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:21.889265 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79102ce-736e-4178-9e94-a8ef86f22474 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:21.889574 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79102ce-736e-4178-9e94-a8ef86f22474 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:21.890963 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79102ce-736e-4178-9e94-a8ef86f22474 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:21.905106 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 355/690] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:16:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:16:21.911088 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79102ce-736e-4178-9e94-a8ef86f22474 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:21.964656 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 336/691] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 2 15:16:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 15:16:21.972574 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b837ef-fadf-4d79-9b76-7eda44a0c232 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:21.975475 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:22.010374 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:22.034724 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79102ce-736e-4178-9e94-a8ef86f22474 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:22.077093 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa5316-76ca-4897-8818-e58b62a79a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:22.078246 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa5316-76ca-4897-8818-e58b62a79a92 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:22.078757 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa5316-76ca-4897-8818-e58b62a79a92 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:22.079297 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa5316-76ca-4897-8818-e58b62a79a92 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:22.088863 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aa5316-76ca-4897-8818-e58b62a79a92 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:22.090772 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aa5316-76ca-4897-8818-e58b62a79a92 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:22.105117 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-e2aa5316-76ca-4897-8818-e58b62a79a92 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 15:16:22.105117 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:22.105117 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:22.105117 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:22.105117 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:22.105117 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:22.105117 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:22.105117 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:22.105117 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:22.105117 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:22.105117 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:22.105117 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:22.105117 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 15:16:22.105117 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 15:16:22.105117 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 15:16:22.105117 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 15:16:22.106244 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:22.106244 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:22.106244 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 15:16:22.106244 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:16:22.106244 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 15:16:22.106244 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:16:22.106244 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:22.106244 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:22.106244 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:22.106244 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:22.106244 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:22.106244 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:22.106244 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:22.106244 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:22.106244 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:22.106244 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:22.106244 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:22.106244 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:22.107193 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:22.107193 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:22.107193 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 15:16:22.107193 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 15:16:22.107193 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 15:16:22.107193 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 15:16:22.107193 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 15:16:22.107193 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 15:16:22.107193 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 15:16:22.107193 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:22.109985 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 356/692] 10.222.0.42 () {56 vars in 1093 bytes} [Tue Aug 2 15:16:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 15:16:22.115997 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa5316-76ca-4897-8818-e58b62a79a92 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:22.134256 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b837ef-fadf-4d79-9b76-7eda44a0c232 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:22.216257 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eddacf4-b24a-42a0-9641-53309bfa0799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:22.217235 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eddacf4-b24a-42a0-9641-53309bfa0799 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:22.217653 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eddacf4-b24a-42a0-9641-53309bfa0799 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:22.218064 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eddacf4-b24a-42a0-9641-53309bfa0799 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:22.248383 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eddacf4-b24a-42a0-9641-53309bfa0799 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:22.249842 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eddacf4-b24a-42a0-9641-53309bfa0799 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:22.252455 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa5316-76ca-4897-8818-e58b62a79a92 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:22.278047 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-1eddacf4-b24a-42a0-9641-53309bfa0799 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:22.278047 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:22.278047 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:22.278047 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:22.278047 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:22.278047 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:22.278047 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:22.278047 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:22.278047 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:22.278047 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:22.278047 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:22.278047 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:22.278047 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:16:22.278047 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:16:22.278047 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:16:22.279058 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:16:22.279058 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:22.279058 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:22.279058 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:22.279058 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:22.279058 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:22.279058 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:22.279058 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:22.279058 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:22.279058 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:22.279058 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:22.279058 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:22.279058 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:22.279058 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:22.279058 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:22.279058 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:22.279058 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:22.279987 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:16:22.279987 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:16:22.279987 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:22.279987 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:22.279987 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 337/693] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:16:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:22.288051 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eddacf4-b24a-42a0-9641-53309bfa0799 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:22.300293 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa78c41-bfe8-4121-a2a1-05e6af820bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:22.301410 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa78c41-bfe8-4121-a2a1-05e6af820bbc None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:22.301901 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa78c41-bfe8-4121-a2a1-05e6af820bbc None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:22.302381 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa78c41-bfe8-4121-a2a1-05e6af820bbc None admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:22.303438 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa78c41-bfe8-4121-a2a1-05e6af820bbc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:22.303956 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa78c41-bfe8-4121-a2a1-05e6af820bbc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:22.305673 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa78c41-bfe8-4121-a2a1-05e6af820bbc None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:22.322544 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:22.329125 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 357/694] 10.222.0.42 () {56 vars in 1133 bytes} [Tue Aug 2 15:16:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:22.338656 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa78c41-bfe8-4121-a2a1-05e6af820bbc None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:22.375274 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:22.427158 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eddacf4-b24a-42a0-9641-53309bfa0799 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:22.468205 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaf3c25-0d0b-4ccd-b2a8-104f97bf8c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:22.469117 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf3c25-0d0b-4ccd-b2a8-104f97bf8c34 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:22.469400 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf3c25-0d0b-4ccd-b2a8-104f97bf8c34 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:22.469671 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf3c25-0d0b-4ccd-b2a8-104f97bf8c34 None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:22.470359 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaf3c25-0d0b-4ccd-b2a8-104f97bf8c34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:22.470659 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaf3c25-0d0b-4ccd-b2a8-104f97bf8c34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:22.472305 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaf3c25-0d0b-4ccd-b2a8-104f97bf8c34 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:22.475846 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa78c41-bfe8-4121-a2a1-05e6af820bbc None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:22.488064 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 338/695] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:16:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:22.489401 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3184c3-bb5b-4e5c-825d-0bd9a76d9302 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:22.489810 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3184c3-bb5b-4e5c-825d-0bd9a76d9302 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:22.490117 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3184c3-bb5b-4e5c-825d-0bd9a76d9302 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:22.495581 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 339/696] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:16:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:16:22.496623 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3184c3-bb5b-4e5c-825d-0bd9a76d9302 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:22.524524 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7314a422-e119-4d12-829a-1b479bd997f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:22.525560 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7314a422-e119-4d12-829a-1b479bd997f5 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:22.526104 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7314a422-e119-4d12-829a-1b479bd997f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:22.526380 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7314a422-e119-4d12-829a-1b479bd997f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:22.596421 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:22.599374 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7314a422-e119-4d12-829a-1b479bd997f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:22.601266 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7314a422-e119-4d12-829a-1b479bd997f5 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:22.618094 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3184c3-bb5b-4e5c-825d-0bd9a76d9302 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:22.646615 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:22.679720 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9394497-dcde-4621-ae14-e09e5a07974a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:22.680621 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9394497-dcde-4621-ae14-e09e5a07974a None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:22.681196 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9394497-dcde-4621-ae14-e09e5a07974a None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:22.682127 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9394497-dcde-4621-ae14-e09e5a07974a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:22.692977 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9394497-dcde-4621-ae14-e09e5a07974a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:22.694794 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9394497-dcde-4621-ae14-e09e5a07974a None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:22.708070 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-b9394497-dcde-4621-ae14-e09e5a07974a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:16:22.708070 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:22.708070 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:22.708070 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:22.708070 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:22.708070 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:22.708070 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:22.708070 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:22.708070 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:22.708070 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:22.708070 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:22.708070 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:22.708070 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 15:16:22.708070 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 15:16:22.708070 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 15:16:22.709215 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 15:16:22.709215 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:22.709215 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:22.709215 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:22.709215 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:22.709215 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:22.709215 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:22.709215 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:22.709215 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:22.709215 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:22.709215 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:22.709215 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:22.709215 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:22.709215 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:22.709215 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:22.709215 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:22.709215 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:22.710307 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 15:16:22.710307 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 15:16:22.710307 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 15:16:22.710307 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 15:16:22.710307 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 15:16:22.710307 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 15:16:22.710307 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:16:22.710307 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:22.712714 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 340/697] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 2 15:16:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:22.714146 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06c791-e381-441a-8655-8511ae83a594 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:22.714580 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06c791-e381-441a-8655-8511ae83a594 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:22.715019 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06c791-e381-441a-8655-8511ae83a594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:22.734955 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 358/698] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 2 15:16:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 15:16:22.736063 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7314a422-e119-4d12-829a-1b479bd997f5 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:22.736671 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-5e06c791-e381-441a-8655-8511ae83a594 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:16:22.738014 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-5e06c791-e381-441a-8655-8511ae83a594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:16:22.814094 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 341/699] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:16:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:16:22.815493 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e06c791-e381-441a-8655-8511ae83a594 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:22.849171 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:22.852484 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7314a422-e119-4d12-829a-1b479bd997f5 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:22.890010 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b6eb19-c513-4017-ba8b-b10989ad1acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:22.890781 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6eb19-c513-4017-ba8b-b10989ad1acf None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:22.891165 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6eb19-c513-4017-ba8b-b10989ad1acf None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:22.891615 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6eb19-c513-4017-ba8b-b10989ad1acf None admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:22.892546 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b6eb19-c513-4017-ba8b-b10989ad1acf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:22.892955 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b6eb19-c513-4017-ba8b-b10989ad1acf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:22.894528 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b6eb19-c513-4017-ba8b-b10989ad1acf None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:22.908171 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 359/700] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 2 15:16:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:22.914930 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b6eb19-c513-4017-ba8b-b10989ad1acf None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:22.931253 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e06c791-e381-441a-8655-8511ae83a594 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:22.934008 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:22.970814 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9146b3-573b-4c05-b240-3e15850dff2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:22.971459 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9146b3-573b-4c05-b240-3e15850dff2a None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:22.971742 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9146b3-573b-4c05-b240-3e15850dff2a None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:22.972038 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9146b3-573b-4c05-b240-3e15850dff2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:22.987136 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9146b3-573b-4c05-b240-3e15850dff2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:22.988653 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9146b3-573b-4c05-b240-3e15850dff2a None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:23.006183 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-7e9146b3-573b-4c05-b240-3e15850dff2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:23.006183 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:23.006183 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:23.006183 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:23.006183 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:23.006183 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:23.006183 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:23.006183 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:23.006183 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:23.006183 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:23.006183 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:23.006183 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:23.006183 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:16:23.006183 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:16:23.006183 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:16:23.007125 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:16:23.007125 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:23.007125 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:23.007125 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:23.007125 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:23.007125 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:23.007125 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:23.007125 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:23.007125 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:23.007125 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:23.007125 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:23.007125 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:23.007125 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:23.007125 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:23.007125 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:23.007125 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:23.007125 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:23.008074 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:16:23.008074 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:16:23.008074 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:23.008074 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:23.008074 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 342/701] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:16:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:23.008797 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9146b3-573b-4c05-b240-3e15850dff2a None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:23.030659 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b6eb19-c513-4017-ba8b-b10989ad1acf None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:23.070433 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f30b07-0d5a-4d09-8060-01f0d88d5303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:23.074101 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f30b07-0d5a-4d09-8060-01f0d88d5303 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:23.074613 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f30b07-0d5a-4d09-8060-01f0d88d5303 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:23.075263 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f30b07-0d5a-4d09-8060-01f0d88d5303 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:23.089075 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f30b07-0d5a-4d09-8060-01f0d88d5303 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:23.091135 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f30b07-0d5a-4d09-8060-01f0d88d5303 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:23.107360 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-20f30b07-0d5a-4d09-8060-01f0d88d5303 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:23.107360 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:23.107360 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:23.107360 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:23.107360 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:23.107360 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:23.107360 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:23.107360 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:23.107360 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:23.107360 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:23.107360 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:23.107360 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:23.107360 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:16:23.107360 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:16:23.107360 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:16:23.108322 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:16:23.108322 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:23.108322 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:23.108322 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:23.108322 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:23.108322 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:23.108322 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:23.108322 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:23.108322 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:23.108322 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:23.108322 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:23.108322 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:23.108322 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:23.108322 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:23.108322 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:23.108322 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:23.108322 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:23.109253 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:16:23.109253 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:16:23.109253 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:23.109253 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:23.111646 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 360/702] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:16:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:23.112849 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f30b07-0d5a-4d09-8060-01f0d88d5303 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:23.128722 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9146b3-573b-4c05-b240-3e15850dff2a None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:23.131340 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:23.172690 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338d54d6-d569-4dd1-9dd8-28bf19811673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:23.173314 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d54d6-d569-4dd1-9dd8-28bf19811673 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:23.173604 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d54d6-d569-4dd1-9dd8-28bf19811673 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:23.173884 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d54d6-d569-4dd1-9dd8-28bf19811673 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:23.174678 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338d54d6-d569-4dd1-9dd8-28bf19811673 None admin] RBAC: Adding query filter params (role.id=532162a00de849cea5c27767c8acd018, scope.project.id=cc19d22b4cd64dd1bc89ed78155d2732, user.id=6f4de590df474c8b95f2b1193f7dbcb5) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:23.174990 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338d54d6-d569-4dd1-9dd8-28bf19811673 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:23.176796 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338d54d6-d569-4dd1-9dd8-28bf19811673 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:23.191264 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 343/703] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 2 15:16:23 2022] GET /identity/v3/role_assignments?user.id=6f4de590df474c8b95f2b1193f7dbcb5&scope.project.id=cc19d22b4cd64dd1bc89ed78155d2732&role.id=532162a00de849cea5c27767c8acd018 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:23.191264 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338d54d6-d569-4dd1-9dd8-28bf19811673 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:23.212470 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:23.296797 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f30b07-0d5a-4d09-8060-01f0d88d5303 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:23.342319 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338d54d6-d569-4dd1-9dd8-28bf19811673 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:23.369199 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c3320a-4639-44c7-9901-3fe1054f7bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:23.369845 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c3320a-4639-44c7-9901-3fe1054f7bde None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:23.370129 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c3320a-4639-44c7-9901-3fe1054f7bde None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:23.370407 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c3320a-4639-44c7-9901-3fe1054f7bde None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:23.371176 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c3320a-4639-44c7-9901-3fe1054f7bde None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:23.371521 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c3320a-4639-44c7-9901-3fe1054f7bde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:23.373138 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c3320a-4639-44c7-9901-3fe1054f7bde None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:23.389498 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 361/704] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:16:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:23.394715 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c3320a-4639-44c7-9901-3fe1054f7bde None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:23.444767 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3986064e-d725-485c-906a-65ba11055856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:23.445292 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3986064e-d725-485c-906a-65ba11055856 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:23.445580 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3986064e-d725-485c-906a-65ba11055856 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:23.445857 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3986064e-d725-485c-906a-65ba11055856 None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:23.446559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3986064e-d725-485c-906a-65ba11055856 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:23.446873 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3986064e-d725-485c-906a-65ba11055856 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:23.456439 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3986064e-d725-485c-906a-65ba11055856 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:23.471181 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 344/705] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:16:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:23.476593 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3986064e-d725-485c-906a-65ba11055856 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:23.481825 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:23.522901 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c3320a-4639-44c7-9901-3fe1054f7bde None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:23.569629 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e47ae-4668-4bb4-a8c0-b0aa862bb7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:23.570349 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e47ae-4668-4bb4-a8c0-b0aa862bb7f7 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:23.570637 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e47ae-4668-4bb4-a8c0-b0aa862bb7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:23.570914 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e47ae-4668-4bb4-a8c0-b0aa862bb7f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:23.580702 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9e47ae-4668-4bb4-a8c0-b0aa862bb7f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:23.582481 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9e47ae-4668-4bb4-a8c0-b0aa862bb7f7 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:23.582595 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:23.597317 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-3c9e47ae-4668-4bb4-a8c0-b0aa862bb7f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:16:23.597317 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:23.597317 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:23.597317 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:23.597317 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:23.597317 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:23.597317 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:23.597317 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:23.597317 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:23.597317 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:23.597317 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:23.597317 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:23.597317 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 15:16:23.597317 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 15:16:23.597317 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 15:16:23.598305 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 15:16:23.598305 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:23.598305 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:23.598305 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:23.598305 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:23.598305 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:23.598305 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:23.598305 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:23.598305 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:23.598305 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:23.598305 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:23.598305 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:23.598305 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:23.598305 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:23.598305 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:23.598305 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:23.598305 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:23.599183 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 15:16:23.599183 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 15:16:23.599183 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 15:16:23.599183 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 15:16:23.599183 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 15:16:23.599183 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 15:16:23.599183 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:16:23.599183 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:23.599183 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 362/706] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 2 15:16:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:23.600557 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f4893-ceab-4caa-bed9-a69e1832b2d3 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:23.600557 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f4893-ceab-4caa-bed9-a69e1832b2d3 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:23.600557 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f4893-ceab-4caa-bed9-a69e1832b2d3 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:23.602087 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 363/707] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:16:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:16:23.608535 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f4893-ceab-4caa-bed9-a69e1832b2d3 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:23.616036 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3986064e-d725-485c-906a-65ba11055856 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:23.655368 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dcc0b5-d58a-4a1a-873f-113e2cd2faad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:23.655996 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dcc0b5-d58a-4a1a-873f-113e2cd2faad None admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:23.656286 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dcc0b5-d58a-4a1a-873f-113e2cd2faad None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:23.656544 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dcc0b5-d58a-4a1a-873f-113e2cd2faad None admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:23.657227 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dcc0b5-d58a-4a1a-873f-113e2cd2faad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:23.658678 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dcc0b5-d58a-4a1a-873f-113e2cd2faad None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:23.685079 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 345/708] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Aug 2 15:16:23 2022] POST /identity/v3/users => generated 254 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:16:23.694461 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d552f-0887-45ee-9ea6-e09a37f2466f None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:23.695104 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d552f-0887-45ee-9ea6-e09a37f2466f None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:23.695610 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d552f-0887-45ee-9ea6-e09a37f2466f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:23.752365 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-cf3d552f-0887-45ee-9ea6-e09a37f2466f None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:16:23.753951 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-cf3d552f-0887-45ee-9ea6-e09a37f2466f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:16:23.755706 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f4893-ceab-4caa-bed9-a69e1832b2d3 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:23.802788 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:23.810587 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1a61a-3960-4a88-ab3b-bbcd4edc366b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:23.811798 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1a61a-3960-4a88-ab3b-bbcd4edc366b None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:23.812087 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1a61a-3960-4a88-ab3b-bbcd4edc366b None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:23.812365 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1a61a-3960-4a88-ab3b-bbcd4edc366b None admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:23.813268 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f1a61a-3960-4a88-ab3b-bbcd4edc366b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:23.819119 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f1a61a-3960-4a88-ab3b-bbcd4edc366b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:23.819119 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f1a61a-3960-4a88-ab3b-bbcd4edc366b None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:23.837306 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 364/709] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 2 15:16:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:23.843546 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1a61a-3960-4a88-ab3b-bbcd4edc366b None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:23.953075 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 346/710] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:16:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:16:23.974193 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1a61a-3960-4a88-ab3b-bbcd4edc366b None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:23.978416 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3d552f-0887-45ee-9ea6-e09a37f2466f None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:24.017606 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97859d4d-f54d-411c-83a1-26304b9ab4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:24.018239 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97859d4d-f54d-411c-83a1-26304b9ab4e5 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:24.018523 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97859d4d-f54d-411c-83a1-26304b9ab4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:24.018802 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97859d4d-f54d-411c-83a1-26304b9ab4e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:24.019679 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97859d4d-f54d-411c-83a1-26304b9ab4e5 None admin] RBAC: Adding query filter params (role.id=d75c9572cb294caeb8eb456521ff6f57, scope.project.id=cc19d22b4cd64dd1bc89ed78155d2732, user.id=4c0865af59bf43dfa4c84213d7db53c5) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:24.020138 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97859d4d-f54d-411c-83a1-26304b9ab4e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:24.022211 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97859d4d-f54d-411c-83a1-26304b9ab4e5 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:24.034229 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 365/711] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 2 15:16:23 2022] GET /identity/v3/role_assignments?user.id=4c0865af59bf43dfa4c84213d7db53c5&scope.project.id=cc19d22b4cd64dd1bc89ed78155d2732&role.id=d75c9572cb294caeb8eb456521ff6f57 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:16:24.086205 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:24.109960 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3d552f-0887-45ee-9ea6-e09a37f2466f None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:24.150013 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5971961-e24f-46c2-9cf4-a55ac626cbda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:24.151072 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5971961-e24f-46c2-9cf4-a55ac626cbda None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:24.151695 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5971961-e24f-46c2-9cf4-a55ac626cbda None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:24.152183 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5971961-e24f-46c2-9cf4-a55ac626cbda None admin] PATH_INFO: `/v3/services/network` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:24.153049 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5971961-e24f-46c2-9cf4-a55ac626cbda None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:24.154665 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5971961-e24f-46c2-9cf4-a55ac626cbda None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:24.167738 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-a5971961-e24f-46c2-9cf4-a55ac626cbda None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 15:16:24.167738 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:24.167738 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 15:16:24.167738 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 15:16:24.167738 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 15:16:24.167738 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 15:16:24.167738 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 15:16:24.167738 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 15:16:24.167738 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 15:16:24.167738 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:24.167738 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 15:16:24.167738 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:24.167738 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:24.167738 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:24.167738 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:24.167738 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:24.167738 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:24.168888 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:24.168888 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:24.168888 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:24.168888 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:24.168888 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:24.168888 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:24.168888 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 15:16:24.168888 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 15:16:24.168888 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 15:16:24.168888 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 15:16:24.168888 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:24.168888 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:24.168888 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:24.168888 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:24.168888 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:24.168888 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:24.169829 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:24.169829 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:24.169829 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:24.169829 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:24.169829 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:24.169829 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:24.169829 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:24.169829 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:24.169829 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:24.169829 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:24.169829 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 15:16:24.169829 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 15:16:24.169829 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 15:16:24.169829 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:24.169829 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 347/712] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 2 15:16:23 2022] GET /identity/v3/services/network => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 15:16:24.175474 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97859d4d-f54d-411c-83a1-26304b9ab4e5 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:24.214950 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec47caa-cb56-43c4-8539-92480fb8c0f5 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:24.215276 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec47caa-cb56-43c4-8539-92480fb8c0f5 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:24.215822 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec47caa-cb56-43c4-8539-92480fb8c0f5 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:24.217200 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 348/713] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:16:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 15:16:24.225275 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea002b5d-402b-47b7-a1f8-16042bbf5c44 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:24.225576 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea002b5d-402b-47b7-a1f8-16042bbf5c44 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:24.225782 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea002b5d-402b-47b7-a1f8-16042bbf5c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:24.249235 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-ea002b5d-402b-47b7-a1f8-16042bbf5c44 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:16:24.251719 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-ea002b5d-402b-47b7-a1f8-16042bbf5c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:16:24.257243 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:24.345671 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97859d4d-f54d-411c-83a1-26304b9ab4e5 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:24.386776 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12cf4a6-17db-4f67-accb-d221cd88dd3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:24.387567 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12cf4a6-17db-4f67-accb-d221cd88dd3d None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:24.387851 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12cf4a6-17db-4f67-accb-d221cd88dd3d None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:24.388127 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12cf4a6-17db-4f67-accb-d221cd88dd3d None admin] PATH_INFO: `/v3/services` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:24.388816 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12cf4a6-17db-4f67-accb-d221cd88dd3d None admin] RBAC: Adding query filter params (name=network) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:24.389121 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12cf4a6-17db-4f67-accb-d221cd88dd3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:24.390515 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12cf4a6-17db-4f67-accb-d221cd88dd3d None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:24.396020 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 366/714] 10.222.0.42 () {56 vars in 1112 bytes} [Tue Aug 2 15:16:24 2022] GET /identity/v3/services?name=network => generated 124 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:24.401667 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12cf4a6-17db-4f67-accb-d221cd88dd3d None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:24.402996 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 349/715] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:16:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:16:24.432964 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea002b5d-402b-47b7-a1f8-16042bbf5c44 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:24.518111 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12cf4a6-17db-4f67-accb-d221cd88dd3d None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:24.544537 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:24.569532 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b589fd7-b0af-411c-9776-62d4252eb04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:24.570192 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b589fd7-b0af-411c-9776-62d4252eb04b None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:24.570479 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b589fd7-b0af-411c-9776-62d4252eb04b None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:24.570755 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b589fd7-b0af-411c-9776-62d4252eb04b None admin] PATH_INFO: `/v3/services` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:24.571621 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b589fd7-b0af-411c-9776-62d4252eb04b None admin] RBAC: Adding query filter params (type=network) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:24.571938 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b589fd7-b0af-411c-9776-62d4252eb04b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:24.573374 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b589fd7-b0af-411c-9776-62d4252eb04b None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:24.584226 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 367/716] 10.222.0.42 () {56 vars in 1112 bytes} [Tue Aug 2 15:16:24 2022] GET /identity/v3/services?type=network => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:16:24.585338 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:24.665383 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea002b5d-402b-47b7-a1f8-16042bbf5c44 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:24.723572 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dde6ca-6c02-4c0e-b265-99ac4608529e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:24.724643 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dde6ca-6c02-4c0e-b265-99ac4608529e None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:24.724643 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dde6ca-6c02-4c0e-b265-99ac4608529e None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:24.724954 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dde6ca-6c02-4c0e-b265-99ac4608529e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:24.725405 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dde6ca-6c02-4c0e-b265-99ac4608529e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:24.727345 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dde6ca-6c02-4c0e-b265-99ac4608529e None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:24.740941 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-b7dde6ca-6c02-4c0e-b265-99ac4608529e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 15:16:24.740941 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:24.740941 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 15:16:24.740941 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 15:16:24.740941 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 15:16:24.740941 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 15:16:24.740941 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 15:16:24.740941 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 15:16:24.740941 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 15:16:24.740941 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:24.740941 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 15:16:24.740941 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:24.740941 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:24.740941 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:24.740941 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:24.740941 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:24.742864 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:24.742864 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:24.742864 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:24.742864 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:24.742864 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:24.742864 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:24.742864 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:24.742864 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 15:16:24.742864 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 15:16:24.742864 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 15:16:24.742864 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 15:16:24.742864 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:24.742864 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:24.742864 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:24.742864 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:24.742864 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:24.745164 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:24.745164 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:24.745164 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:24.745164 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:24.745164 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:24.745164 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:24.745164 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:24.745164 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:24.745164 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:24.745164 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:24.745164 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:24.745164 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 15:16:24.745164 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 15:16:24.745164 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 15:16:24.745164 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:24.745164 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 350/717] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Aug 2 15:16:24 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 15:16:24.750594 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b589fd7-b0af-411c-9776-62d4252eb04b None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:24.911854 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b589fd7-b0af-411c-9776-62d4252eb04b None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:24.947467 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733fd7b6-e646-40a8-9e85-98e32d10d004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:24.948094 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733fd7b6-e646-40a8-9e85-98e32d10d004 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:24.948383 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733fd7b6-e646-40a8-9e85-98e32d10d004 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:24.948702 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733fd7b6-e646-40a8-9e85-98e32d10d004 None admin] PATH_INFO: `/v3/services` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:24.949385 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733fd7b6-e646-40a8-9e85-98e32d10d004 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:24.949689 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733fd7b6-e646-40a8-9e85-98e32d10d004 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:24.951068 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733fd7b6-e646-40a8-9e85-98e32d10d004 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:24.955879 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 368/718] 10.222.0.42 () {56 vars in 1124 bytes} [Tue Aug 2 15:16:24 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:16:24.962159 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dde6ca-6c02-4c0e-b265-99ac4608529e None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:25.074137 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dde6ca-6c02-4c0e-b265-99ac4608529e None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:25.103319 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:25.118687 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed7dccc-d600-4371-a7d2-4144af8313f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:25.119352 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7dccc-d600-4371-a7d2-4144af8313f3 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:25.119643 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7dccc-d600-4371-a7d2-4144af8313f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:25.119902 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7dccc-d600-4371-a7d2-4144af8313f3 None admin] PATH_INFO: `/v3/services` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:25.120596 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed7dccc-d600-4371-a7d2-4144af8313f3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:25.120905 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed7dccc-d600-4371-a7d2-4144af8313f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:25.122288 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed7dccc-d600-4371-a7d2-4144af8313f3 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:25.128455 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 351/719] 10.222.0.42 () {56 vars in 1124 bytes} [Tue Aug 2 15:16:24 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:25.659162 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240d1dd-17da-4d9b-b7b3-9892f87bbe5c None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:25.659584 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240d1dd-17da-4d9b-b7b3-9892f87bbe5c None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:25.659763 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240d1dd-17da-4d9b-b7b3-9892f87bbe5c None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:25.661384 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 369/720] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:16:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:16:25.667188 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d21f8-5ea6-4c2c-9e6d-803edb9ed6af None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:25.667507 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d21f8-5ea6-4c2c-9e6d-803edb9ed6af None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:25.667790 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d21f8-5ea6-4c2c-9e6d-803edb9ed6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:25.696272 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-040d21f8-5ea6-4c2c-9e6d-803edb9ed6af None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:16:25.697491 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-040d21f8-5ea6-4c2c-9e6d-803edb9ed6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:16:25.785098 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 352/721] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:16:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 15:16:25.825189 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b240d1dd-17da-4d9b-b7b3-9892f87bbe5c None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:25.890189 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:25.949435 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b240d1dd-17da-4d9b-b7b3-9892f87bbe5c None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:25.986149 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91028b9f-3933-4042-9aa4-aa836350ab44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:25.986855 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91028b9f-3933-4042-9aa4-aa836350ab44 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:25.987142 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91028b9f-3933-4042-9aa4-aa836350ab44 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:25.987499 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91028b9f-3933-4042-9aa4-aa836350ab44 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:25.998783 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91028b9f-3933-4042-9aa4-aa836350ab44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:16:26.004353 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-91028b9f-3933-4042-9aa4-aa836350ab44 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 15:16:26.004353 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:26.004353 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:26.004353 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:26.004353 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:26.004353 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:26.004353 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:26.004353 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:26.004353 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:26.004353 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:26.004353 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:26.004353 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:26.004353 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:16:26.004353 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:16:26.004353 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:16:26.004353 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:16:26.005315 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:16:26.005315 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:16:26.005315 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:16:26.005315 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:16:26.005315 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:26.005315 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:26.005315 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:26.005315 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:26.005315 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:26.005315 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:26.005315 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:26.005315 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:26.005315 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:26.005315 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:26.005315 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:26.005315 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:26.006147 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:26.006147 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:26.006147 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:26.006147 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:26.006147 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:16:26.006147 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:16:26.006147 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:16:26.006147 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:16:26.006147 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:16:26.006147 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:16:26.006147 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 15:16:26.006147 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:26.006147 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 370/722] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 2 15:16:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:26.011817 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d21f8-5ea6-4c2c-9e6d-803edb9ed6af None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:26.146901 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d21f8-5ea6-4c2c-9e6d-803edb9ed6af None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:26.175499 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:26.202250 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8100cb-2cda-4ada-b54f-2e66d83490bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:26.202902 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8100cb-2cda-4ada-b54f-2e66d83490bf None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:26.203229 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8100cb-2cda-4ada-b54f-2e66d83490bf None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:26.203514 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8100cb-2cda-4ada-b54f-2e66d83490bf None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:26.204351 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8100cb-2cda-4ada-b54f-2e66d83490bf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:26.204667 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8100cb-2cda-4ada-b54f-2e66d83490bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:26.206172 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8100cb-2cda-4ada-b54f-2e66d83490bf None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:26.219938 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 353/723] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 2 15:16:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:26.226844 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91028b9f-3933-4042-9aa4-aa836350ab44 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:26.381396 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91028b9f-3933-4042-9aa4-aa836350ab44 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:26.394454 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dbee2b-3bdf-410f-9a5b-c7b391db5432 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:26.394742 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dbee2b-3bdf-410f-9a5b-c7b391db5432 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:26.395512 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dbee2b-3bdf-410f-9a5b-c7b391db5432 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:26.396419 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:26.399297 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 354/724] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:16:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:16:26.404720 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe3b6f2-db5d-4946-963d-420d272a0095 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:26.405011 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe3b6f2-db5d-4946-963d-420d272a0095 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:26.405294 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe3b6f2-db5d-4946-963d-420d272a0095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:26.430037 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8902f7b-0d3e-4284-b154-7e0f8875b7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:26.431056 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8902f7b-0d3e-4284-b154-7e0f8875b7be None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:26.431551 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8902f7b-0d3e-4284-b154-7e0f8875b7be None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:26.432016 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8902f7b-0d3e-4284-b154-7e0f8875b7be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:26.445784 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-6fe3b6f2-db5d-4946-963d-420d272a0095 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:16:26.449647 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-6fe3b6f2-db5d-4946-963d-420d272a0095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:16:26.454505 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8902f7b-0d3e-4284-b154-7e0f8875b7be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:26.456353 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8902f7b-0d3e-4284-b154-7e0f8875b7be None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:26.485482 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-b8902f7b-0d3e-4284-b154-7e0f8875b7be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:26.485482 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:26.485482 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:26.485482 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:26.485482 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:26.485482 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:26.485482 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:26.485482 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:26.485482 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:26.485482 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:26.485482 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:26.485482 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:26.485482 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:16:26.485482 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:16:26.485482 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:16:26.486443 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:16:26.486443 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:26.486443 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:26.486443 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:26.486443 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:26.486443 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:26.486443 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:26.486443 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:26.486443 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:26.486443 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:26.486443 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:26.486443 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:26.486443 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:26.486443 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:26.486443 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:26.486443 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:26.486443 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:26.487359 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:16:26.487359 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:16:26.487359 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:26.487359 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:26.489864 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 371/725] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:16:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:26.496136 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8902f7b-0d3e-4284-b154-7e0f8875b7be None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:26.552035 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 355/726] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:16:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:16:26.592071 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe3b6f2-db5d-4946-963d-420d272a0095 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:26.619908 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8902f7b-0d3e-4284-b154-7e0f8875b7be None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:26.665510 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44446724-1220-41cf-bccf-8044158a25c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:26.666527 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44446724-1220-41cf-bccf-8044158a25c7 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:26.666965 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44446724-1220-41cf-bccf-8044158a25c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:26.667411 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44446724-1220-41cf-bccf-8044158a25c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:26.668263 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44446724-1220-41cf-bccf-8044158a25c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:26.668712 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44446724-1220-41cf-bccf-8044158a25c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:26.670383 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44446724-1220-41cf-bccf-8044158a25c7 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:26.699353 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 372/727] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:16:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:26.700701 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44446724-1220-41cf-bccf-8044158a25c7 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:26.727331 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe3b6f2-db5d-4946-963d-420d272a0095 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:26.737059 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:26.739587 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:26.765830 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aa5d3a-6718-466a-8155-545c7087395c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:26.767646 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa5d3a-6718-466a-8155-545c7087395c None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:26.767646 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa5d3a-6718-466a-8155-545c7087395c None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:26.767646 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa5d3a-6718-466a-8155-545c7087395c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:26.780340 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aa5d3a-6718-466a-8155-545c7087395c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:16:26.791267 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-96aa5d3a-6718-466a-8155-545c7087395c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 15:16:26.791267 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:26.791267 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:26.791267 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:26.791267 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:26.791267 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:26.791267 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:26.791267 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:26.791267 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:26.791267 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:26.791267 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:26.791267 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:26.791267 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:16:26.791267 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:16:26.791267 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:16:26.791267 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:16:26.793100 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:16:26.793100 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:16:26.793100 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:16:26.793100 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:16:26.793100 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:26.793100 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:26.793100 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:26.793100 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:26.793100 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:26.793100 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:26.793100 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:26.793100 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:26.793100 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:26.793100 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:26.793100 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:26.793100 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:26.794035 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:26.794035 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:26.794035 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:26.794035 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:26.794035 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:16:26.794035 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:16:26.794035 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:16:26.794035 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:16:26.794035 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:16:26.794035 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:16:26.794035 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 15:16:26.794035 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:26.794035 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 356/728] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 2 15:16:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 15:16:26.797178 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aa5d3a-6718-466a-8155-545c7087395c None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:26.922125 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44446724-1220-41cf-bccf-8044158a25c7 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:27.004870 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aa5d3a-6718-466a-8155-545c7087395c None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:27.006405 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca2e8b7-c58c-486d-8235-3352e6a4ad90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:27.007742 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2e8b7-c58c-486d-8235-3352e6a4ad90 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:27.008266 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2e8b7-c58c-486d-8235-3352e6a4ad90 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:27.008743 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2e8b7-c58c-486d-8235-3352e6a4ad90 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:27.025908 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca2e8b7-c58c-486d-8235-3352e6a4ad90 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:27.028205 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca2e8b7-c58c-486d-8235-3352e6a4ad90 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:27.042382 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-3ca2e8b7-c58c-486d-8235-3352e6a4ad90 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 02 15:16:27.042382 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:27.042382 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:27.042382 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:27.042382 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:27.042382 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:27.042382 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:27.042382 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:27.042382 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:27.042382 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:27.042382 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:27.042382 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:27.042382 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 15:16:27.042382 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 15:16:27.042382 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 15:16:27.042382 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 15:16:27.043480 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:27.043480 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:27.043480 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 15:16:27.043480 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:16:27.043480 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 15:16:27.043480 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:16:27.043480 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:27.043480 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:27.043480 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:27.043480 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:27.043480 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:27.043480 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:27.043480 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:27.043480 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:27.043480 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:27.043480 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:27.043480 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:27.043480 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:27.044414 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:27.044414 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:27.044414 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 15:16:27.044414 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 15:16:27.044414 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 15:16:27.044414 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 15:16:27.044414 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 15:16:27.044414 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 15:16:27.044414 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 02 15:16:27.044414 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:27.047899 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 373/729] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 2 15:16:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:27.058128 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca2e8b7-c58c-486d-8235-3352e6a4ad90 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:27.085412 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220fd04e-25c8-4e6f-9491-845096a1afaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:27.086085 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220fd04e-25c8-4e6f-9491-845096a1afaf None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:27.086369 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220fd04e-25c8-4e6f-9491-845096a1afaf None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:27.086643 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220fd04e-25c8-4e6f-9491-845096a1afaf None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:27.087395 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220fd04e-25c8-4e6f-9491-845096a1afaf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:27.087699 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220fd04e-25c8-4e6f-9491-845096a1afaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:27.089086 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220fd04e-25c8-4e6f-9491-845096a1afaf None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:27.107380 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 357/730] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 2 15:16:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:27.111368 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220fd04e-25c8-4e6f-9491-845096a1afaf None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:27.163861 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:27.224072 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:27.242065 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca2e8b7-c58c-486d-8235-3352e6a4ad90 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:27.265578 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220fd04e-25c8-4e6f-9491-845096a1afaf None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:27.291121 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92031f2-e8c1-4c96-ac3f-e71049d0ad2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:27.292027 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92031f2-e8c1-4c96-ac3f-e71049d0ad2b None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:27.292738 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92031f2-e8c1-4c96-ac3f-e71049d0ad2b None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:27.293024 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92031f2-e8c1-4c96-ac3f-e71049d0ad2b None admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:27.294113 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92031f2-e8c1-4c96-ac3f-e71049d0ad2b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:27.294458 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92031f2-e8c1-4c96-ac3f-e71049d0ad2b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:27.296854 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92031f2-e8c1-4c96-ac3f-e71049d0ad2b None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:27.304134 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3e2c5-3ceb-4d86-a14d-ed0f4e27be8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:27.304779 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3e2c5-3ceb-4d86-a14d-ed0f4e27be8d None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:27.305061 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3e2c5-3ceb-4d86-a14d-ed0f4e27be8d None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:27.305338 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3e2c5-3ceb-4d86-a14d-ed0f4e27be8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:27.325035 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 374/731] 10.222.0.42 () {56 vars in 1135 bytes} [Tue Aug 2 15:16:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:16:27.326565 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd3e2c5-3ceb-4d86-a14d-ed0f4e27be8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:27.327317 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d045de-7544-4699-ba3a-19a55348b295 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:27.327859 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d045de-7544-4699-ba3a-19a55348b295 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:27.328124 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd3e2c5-3ceb-4d86-a14d-ed0f4e27be8d None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:27.328676 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d045de-7544-4699-ba3a-19a55348b295 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:27.330584 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 375/732] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:16:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:16:27.332978 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2e178-695c-4147-aaa5-a9dd2998e03d None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:27.333508 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2e178-695c-4147-aaa5-a9dd2998e03d None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:27.334001 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2e178-695c-4147-aaa5-a9dd2998e03d None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:27.335824 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 376/733] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:16:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:16:27.335824 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b2e178-695c-4147-aaa5-a9dd2998e03d None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:27.345661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-3bd3e2c5-3ceb-4d86-a14d-ed0f4e27be8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:27.345661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:27.345661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:27.345661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:27.345661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:27.345661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:27.345661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:27.345661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:27.345661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:27.345661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:27.345661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:27.345661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:27.345661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:16:27.345661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:16:27.345661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:16:27.347559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:16:27.347559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:27.347559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:27.347559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:27.347559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:27.347559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:27.347559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:27.347559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:27.347559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:27.347559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:27.347559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:27.347559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:27.347559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:27.347559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:27.347559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:27.347559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:27.347559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:27.349886 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:16:27.349886 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:16:27.349886 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:27.349886 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:27.349886 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 358/734] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:16:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:27.349886 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73affbb3-feaf-4673-957c-af9c05cc3c8a None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:27.349886 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73affbb3-feaf-4673-957c-af9c05cc3c8a None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:27.349886 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73affbb3-feaf-4673-957c-af9c05cc3c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:27.368087 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-73affbb3-feaf-4673-957c-af9c05cc3c8a None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:16:27.369280 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-73affbb3-feaf-4673-957c-af9c05cc3c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:16:27.451236 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 359/735] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:16:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:16:27.451236 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14329e93-fbe1-484c-ab90-25e1eca3f855 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:27.451236 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14329e93-fbe1-484c-ab90-25e1eca3f855 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:27.451236 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14329e93-fbe1-484c-ab90-25e1eca3f855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:27.468081 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-14329e93-fbe1-484c-ab90-25e1eca3f855 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:16:27.469531 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-14329e93-fbe1-484c-ab90-25e1eca3f855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:16:27.480253 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:27.484724 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b2e178-695c-4147-aaa5-a9dd2998e03d None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:27.523537 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27438ac0-7819-4447-bf33-9744aa6ba301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:27.524190 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27438ac0-7819-4447-bf33-9744aa6ba301 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:27.524479 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27438ac0-7819-4447-bf33-9744aa6ba301 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:27.524869 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27438ac0-7819-4447-bf33-9744aa6ba301 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:27.534571 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:27.542789 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 360/736] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:16:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:16:27.543953 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14329e93-fbe1-484c-ab90-25e1eca3f855 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:27.624094 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27438ac0-7819-4447-bf33-9744aa6ba301 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:27.625744 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27438ac0-7819-4447-bf33-9744aa6ba301 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:27.665243 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14329e93-fbe1-484c-ab90-25e1eca3f855 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:27.707321 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c5fd1-648d-44f0-88e5-9424e1520017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:27.708484 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c5fd1-648d-44f0-88e5-9424e1520017 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:27.708765 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c5fd1-648d-44f0-88e5-9424e1520017 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:27.709041 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c5fd1-648d-44f0-88e5-9424e1520017 None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:27.710189 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2c5fd1-648d-44f0-88e5-9424e1520017 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:27.710497 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2c5fd1-648d-44f0-88e5-9424e1520017 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:27.712285 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2c5fd1-648d-44f0-88e5-9424e1520017 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:27.732114 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 361/737] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:16:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:27.732114 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c5fd1-648d-44f0-88e5-9424e1520017 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:27.735285 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 377/738] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 2 15:16:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 15:16:27.736042 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27438ac0-7819-4447-bf33-9744aa6ba301 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:27.741014 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:27.797782 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:27.852985 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c5fd1-648d-44f0-88e5-9424e1520017 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:27.869785 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27438ac0-7819-4447-bf33-9744aa6ba301 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:27.886790 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d361afcb-b484-494b-bf25-16b270699168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:27.887468 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d361afcb-b484-494b-bf25-16b270699168 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:27.887752 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d361afcb-b484-494b-bf25-16b270699168 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:27.888033 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d361afcb-b484-494b-bf25-16b270699168 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:27.899914 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d361afcb-b484-494b-bf25-16b270699168 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:16:27.904839 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9419c-c30d-4614-93c8-9eb042ed1930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:27.905454 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9419c-c30d-4614-93c8-9eb042ed1930 None admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:27.905738 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9419c-c30d-4614-93c8-9eb042ed1930 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:27.906007 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9419c-c30d-4614-93c8-9eb042ed1930 None admin] PATH_INFO: `/v3/services` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:27.906698 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb9419c-c30d-4614-93c8-9eb042ed1930 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:27.907815 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-d361afcb-b484-494b-bf25-16b270699168 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 15:16:27.907815 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:27.907815 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:27.907815 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:27.907815 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:27.907815 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:27.907815 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:27.907815 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:27.907815 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:27.907815 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:27.907815 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:27.907815 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:27.907815 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:16:27.907815 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:16:27.907815 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:16:27.907815 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:16:27.908890 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:16:27.908890 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:16:27.908890 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:16:27.908890 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:16:27.908890 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:27.908890 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:27.908890 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:27.908890 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:27.908890 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:27.908890 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:27.908890 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:27.908890 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:27.908890 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:27.908890 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:27.908890 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:27.908890 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:27.909931 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:27.909931 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:27.909931 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:27.909931 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:27.909931 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:16:27.909931 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:16:27.909931 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:16:27.909931 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:16:27.909931 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:16:27.909931 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:16:27.909931 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 15:16:27.909931 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:27.910660 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb9419c-c30d-4614-93c8-9eb042ed1930 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:27.910732 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 362/739] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 2 15:16:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:27.911967 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d361afcb-b484-494b-bf25-16b270699168 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:27.932835 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 378/740] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Aug 2 15:16:27 2022] POST /identity/v3/services => generated 240 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:16:27.933915 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9419c-c30d-4614-93c8-9eb042ed1930 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:27.995389 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:28.040880 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d361afcb-b484-494b-bf25-16b270699168 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:28.048269 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:28.064480 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9419c-c30d-4614-93c8-9eb042ed1930 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:28.082496 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ac5ac9-a2f1-4bae-b19b-f5534fa11da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:28.083165 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac5ac9-a2f1-4bae-b19b-f5534fa11da7 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:28.083555 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac5ac9-a2f1-4bae-b19b-f5534fa11da7 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:28.083832 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac5ac9-a2f1-4bae-b19b-f5534fa11da7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:28.092552 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ac5ac9-a2f1-4bae-b19b-f5534fa11da7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:28.094053 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ac5ac9-a2f1-4bae-b19b-f5534fa11da7 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:28.106203 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74259749-3dc9-4c92-87e9-085ca4e1175e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:28.106851 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74259749-3dc9-4c92-87e9-085ca4e1175e None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:28.107137 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74259749-3dc9-4c92-87e9-085ca4e1175e None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:28.107444 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74259749-3dc9-4c92-87e9-085ca4e1175e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:28.107640 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-00ac5ac9-a2f1-4bae-b19b-f5534fa11da7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 15:16:28.107640 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:28.107640 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:28.107640 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:28.107640 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:28.107640 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:28.107640 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:28.107640 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:28.107640 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:28.107640 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:28.107640 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:28.107640 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:28.107640 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 15:16:28.107640 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 15:16:28.107640 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 15:16:28.107640 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 15:16:28.108559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:28.108559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:28.108559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 15:16:28.108559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:16:28.108559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 15:16:28.108559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:16:28.108559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:28.108559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:28.108559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:28.108559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:28.108559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:28.108559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:28.108559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:28.108559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:28.108559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:28.108559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:28.108559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:28.108559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:28.109538 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:28.109538 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:28.109538 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 15:16:28.109538 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 15:16:28.109538 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 15:16:28.109538 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 15:16:28.109538 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 15:16:28.109538 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 15:16:28.109538 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 15:16:28.109538 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:28.109538 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 363/741] 10.222.0.42 () {56 vars in 1093 bytes} [Tue Aug 2 15:16:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:28.110204 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96753774-e72c-4bd7-9bc5-9986212326dd None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:28.110282 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96753774-e72c-4bd7-9bc5-9986212326dd None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:28.110892 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96753774-e72c-4bd7-9bc5-9986212326dd None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:28.112174 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 364/742] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:16:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:16:28.113020 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96753774-e72c-4bd7-9bc5-9986212326dd None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:28.125853 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74259749-3dc9-4c92-87e9-085ca4e1175e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:28.127371 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74259749-3dc9-4c92-87e9-085ca4e1175e None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:28.146745 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-74259749-3dc9-4c92-87e9-085ca4e1175e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:28.146745 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:28.146745 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:28.146745 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:28.146745 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:28.146745 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:28.146745 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:28.146745 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:28.146745 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:28.146745 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:28.146745 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:28.146745 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:28.146745 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:16:28.146745 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:16:28.146745 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:16:28.147727 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:16:28.147727 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:28.147727 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:28.147727 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:28.147727 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:28.147727 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:28.147727 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:28.147727 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:28.147727 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:28.147727 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:28.147727 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:28.147727 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:28.147727 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:28.147727 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:28.147727 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:28.147727 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:28.147727 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:28.148622 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:16:28.148622 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:16:28.148622 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:28.148622 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:28.148622 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 379/743] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:16:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:28.148917 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74259749-3dc9-4c92-87e9-085ca4e1175e None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:28.237459 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96753774-e72c-4bd7-9bc5-9986212326dd None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:28.266633 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:28.273160 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74259749-3dc9-4c92-87e9-085ca4e1175e None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:28.281025 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f03a34-0ee0-4412-8c8d-76b7556cf8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:28.281668 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f03a34-0ee0-4412-8c8d-76b7556cf8b1 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:28.281948 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f03a34-0ee0-4412-8c8d-76b7556cf8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:28.282228 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f03a34-0ee0-4412-8c8d-76b7556cf8b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:28.284665 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f03a34-0ee0-4412-8c8d-76b7556cf8b1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:28.284665 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f03a34-0ee0-4412-8c8d-76b7556cf8b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:28.286548 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f03a34-0ee0-4412-8c8d-76b7556cf8b1 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:28.297672 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 365/744] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Aug 2 15:16:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:28.298986 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281e881-5ee9-4441-96ed-f79d174ce594 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:28.299250 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281e881-5ee9-4441-96ed-f79d174ce594 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:28.299532 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281e881-5ee9-4441-96ed-f79d174ce594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:28.317741 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07e5cd4-da5b-45fd-a912-c55cf03fa992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:28.318368 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e5cd4-da5b-45fd-a912-c55cf03fa992 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:28.318644 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e5cd4-da5b-45fd-a912-c55cf03fa992 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:28.318923 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e5cd4-da5b-45fd-a912-c55cf03fa992 None admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:28.319742 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07e5cd4-da5b-45fd-a912-c55cf03fa992 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:28.320048 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07e5cd4-da5b-45fd-a912-c55cf03fa992 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:28.320423 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-0281e881-5ee9-4441-96ed-f79d174ce594 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:16:28.321547 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07e5cd4-da5b-45fd-a912-c55cf03fa992 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:28.321734 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-0281e881-5ee9-4441-96ed-f79d174ce594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:16:28.341974 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 380/745] 10.222.0.42 () {56 vars in 1133 bytes} [Tue Aug 2 15:16:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:28.342836 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07e5cd4-da5b-45fd-a912-c55cf03fa992 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:28.347554 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:28.431244 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 366/746] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:16:28 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 15:16:28.431244 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0281e881-5ee9-4441-96ed-f79d174ce594 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:28.472772 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07e5cd4-da5b-45fd-a912-c55cf03fa992 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:28.514130 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a8710-c185-4c34-b7c5-f5eca03ebe3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:28.514765 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a8710-c185-4c34-b7c5-f5eca03ebe3f None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:28.515050 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a8710-c185-4c34-b7c5-f5eca03ebe3f None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:28.515363 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a8710-c185-4c34-b7c5-f5eca03ebe3f None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:28.516084 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833a8710-c185-4c34-b7c5-f5eca03ebe3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:28.517429 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833a8710-c185-4c34-b7c5-f5eca03ebe3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:28.517774 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833a8710-c185-4c34-b7c5-f5eca03ebe3f None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:28.534335 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 381/747] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:16:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:28.534335 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a8710-c185-4c34-b7c5-f5eca03ebe3f None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:28.557256 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0281e881-5ee9-4441-96ed-f79d174ce594 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:28.574661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:28.594903 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b3887-63d0-4798-8616-86a5d3dcc5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:28.596090 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b3887-63d0-4798-8616-86a5d3dcc5ea None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:28.596090 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b3887-63d0-4798-8616-86a5d3dcc5ea None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:28.596463 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b3887-63d0-4798-8616-86a5d3dcc5ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:28.607437 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158b3887-63d0-4798-8616-86a5d3dcc5ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:28.610481 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158b3887-63d0-4798-8616-86a5d3dcc5ea None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:28.611112 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:28.629484 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-158b3887-63d0-4798-8616-86a5d3dcc5ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:28.629484 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:28.629484 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:28.629484 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:28.629484 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:28.629484 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:28.629484 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:28.629484 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:28.629484 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:28.629484 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:28.629484 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:28.629484 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:28.629484 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:16:28.629484 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:16:28.629484 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:16:28.630627 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:16:28.630627 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:28.630627 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:28.630627 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:28.630627 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:28.630627 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:28.630627 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:28.630627 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:28.630627 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:28.630627 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:28.630627 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:28.630627 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:28.630627 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:28.630627 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:28.630627 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:28.630627 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:28.630627 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:28.631563 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:16:28.631563 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:16:28.631563 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:28.631563 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:28.631563 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 367/748] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:16:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:28.632046 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b3887-63d0-4798-8616-86a5d3dcc5ea None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:28.666015 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a8710-c185-4c34-b7c5-f5eca03ebe3f None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:28.705295 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676a0bea-e0d3-42d3-9bab-93ae1b9b1417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:28.706058 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a0bea-e0d3-42d3-9bab-93ae1b9b1417 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:28.706399 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a0bea-e0d3-42d3-9bab-93ae1b9b1417 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:28.706818 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a0bea-e0d3-42d3-9bab-93ae1b9b1417 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:28.726010 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676a0bea-e0d3-42d3-9bab-93ae1b9b1417 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:28.727536 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676a0bea-e0d3-42d3-9bab-93ae1b9b1417 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:28.747015 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-676a0bea-e0d3-42d3-9bab-93ae1b9b1417 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:28.747015 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:28.747015 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:28.747015 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:28.747015 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:28.747015 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:28.747015 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:28.747015 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:28.747015 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:28.747015 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:28.747015 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:28.747015 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:28.747015 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:16:28.747015 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:16:28.747015 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:16:28.748439 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:16:28.748439 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:28.748439 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:28.748439 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:28.748439 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:28.748439 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:28.748439 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:28.748439 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:28.748439 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:28.748439 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:28.748439 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:28.748439 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:28.748439 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:28.748439 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:28.748439 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:28.748439 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:28.748439 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:28.749453 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:16:28.749453 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:16:28.749453 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:28.749453 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:28.749453 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 382/749] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:16:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:28.750374 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676a0bea-e0d3-42d3-9bab-93ae1b9b1417 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:28.763086 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b3887-63d0-4798-8616-86a5d3dcc5ea None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:28.804726 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d0bdc-b5c4-4146-a0b4-ceabf96bb037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:28.805455 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d0bdc-b5c4-4146-a0b4-ceabf96bb037 None admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:28.805795 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d0bdc-b5c4-4146-a0b4-ceabf96bb037 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:28.806073 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d0bdc-b5c4-4146-a0b4-ceabf96bb037 None admin] PATH_INFO: `/v3/services` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:28.806762 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d0bdc-b5c4-4146-a0b4-ceabf96bb037 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:28.808448 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d0bdc-b5c4-4146-a0b4-ceabf96bb037 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:28.827669 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 368/750] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Aug 2 15:16:28 2022] POST /identity/v3/services => generated 251 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:16:28.828593 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d0bdc-b5c4-4146-a0b4-ceabf96bb037 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:28.875115 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:28.886894 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676a0bea-e0d3-42d3-9bab-93ae1b9b1417 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:28.915631 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:28.942117 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a12bd36-8954-4fb7-84fe-bffea5d39a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:28.942771 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a12bd36-8954-4fb7-84fe-bffea5d39a8b None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:28.943048 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a12bd36-8954-4fb7-84fe-bffea5d39a8b None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:28.943360 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a12bd36-8954-4fb7-84fe-bffea5d39a8b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:28.953282 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a12bd36-8954-4fb7-84fe-bffea5d39a8b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:28.955360 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a12bd36-8954-4fb7-84fe-bffea5d39a8b None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:28.971920 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-0a12bd36-8954-4fb7-84fe-bffea5d39a8b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:16:28.971920 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:28.971920 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:28.971920 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:28.971920 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:28.971920 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:28.971920 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:28.971920 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:28.971920 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:28.971920 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:28.971920 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:28.971920 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:28.971920 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 15:16:28.971920 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 15:16:28.971920 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 15:16:28.972979 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 15:16:28.972979 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:28.972979 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:28.972979 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:28.972979 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:28.972979 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:28.972979 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:28.972979 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:28.972979 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:28.972979 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:28.972979 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:28.972979 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:28.972979 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:28.972979 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:28.972979 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:28.972979 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:28.972979 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:28.974427 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 15:16:28.974427 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 15:16:28.974427 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 15:16:28.974427 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 15:16:28.974427 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 15:16:28.974427 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 15:16:28.974427 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:16:28.974427 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:28.979252 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 383/751] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 2 15:16:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:28.980551 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a12bd36-8954-4fb7-84fe-bffea5d39a8b None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:28.991913 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d0bdc-b5c4-4146-a0b4-ceabf96bb037 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:29.038562 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90dd47d-7443-4494-b9a5-be65f639be1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:29.039821 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90dd47d-7443-4494-b9a5-be65f639be1d None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:29.040286 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90dd47d-7443-4494-b9a5-be65f639be1d None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:29.040769 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90dd47d-7443-4494-b9a5-be65f639be1d None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:29.041708 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90dd47d-7443-4494-b9a5-be65f639be1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:29.042200 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90dd47d-7443-4494-b9a5-be65f639be1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:29.043931 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90dd47d-7443-4494-b9a5-be65f639be1d None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:29.058140 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 369/752] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:16:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:29.058867 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90dd47d-7443-4494-b9a5-be65f639be1d None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:29.111521 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a12bd36-8954-4fb7-84fe-bffea5d39a8b None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:29.162102 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eacedae-89b3-4197-9515-a6a7d64db2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:29.162732 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eacedae-89b3-4197-9515-a6a7d64db2fd None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:29.163009 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eacedae-89b3-4197-9515-a6a7d64db2fd None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:29.163325 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eacedae-89b3-4197-9515-a6a7d64db2fd None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:29.164350 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eacedae-89b3-4197-9515-a6a7d64db2fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:29.164659 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eacedae-89b3-4197-9515-a6a7d64db2fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:29.166536 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eacedae-89b3-4197-9515-a6a7d64db2fd None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:29.182872 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 384/753] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:16:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:29.183415 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:29.184404 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eacedae-89b3-4197-9515-a6a7d64db2fd None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:29.199128 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90dd47d-7443-4494-b9a5-be65f639be1d None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:29.219825 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:29.241288 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a42dfe-3d79-4da2-99e9-a9e20152a6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:29.242164 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a42dfe-3d79-4da2-99e9-a9e20152a6a5 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:29.242590 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a42dfe-3d79-4da2-99e9-a9e20152a6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:29.243041 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a42dfe-3d79-4da2-99e9-a9e20152a6a5 None admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:29.243980 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a42dfe-3d79-4da2-99e9-a9e20152a6a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:29.244534 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a42dfe-3d79-4da2-99e9-a9e20152a6a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:29.246175 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a42dfe-3d79-4da2-99e9-a9e20152a6a5 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:29.261659 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 370/754] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 2 15:16:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:29.262848 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a42dfe-3d79-4da2-99e9-a9e20152a6a5 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:29.300971 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eacedae-89b3-4197-9515-a6a7d64db2fd None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:29.338858 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3aad0e-a380-4e0a-9829-0b6aee28dcf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:29.339377 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3aad0e-a380-4e0a-9829-0b6aee28dcf6 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:29.339658 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3aad0e-a380-4e0a-9829-0b6aee28dcf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:29.339932 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3aad0e-a380-4e0a-9829-0b6aee28dcf6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:29.347710 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3aad0e-a380-4e0a-9829-0b6aee28dcf6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:29.349206 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3aad0e-a380-4e0a-9829-0b6aee28dcf6 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:29.362009 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-7e3aad0e-a380-4e0a-9829-0b6aee28dcf6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 15:16:29.362009 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:29.362009 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:29.362009 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:29.362009 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:29.362009 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:29.362009 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:29.362009 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:29.362009 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:29.362009 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:29.362009 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:29.362009 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:29.362009 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 15:16:29.362009 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 15:16:29.362009 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 15:16:29.362009 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 15:16:29.363182 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:29.363182 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:29.363182 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 15:16:29.363182 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:16:29.363182 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 15:16:29.363182 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:16:29.363182 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:29.363182 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:29.363182 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:29.363182 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:29.363182 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:29.363182 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:29.363182 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:29.363182 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:29.363182 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:29.363182 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:29.363182 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:29.363182 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:29.364308 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:29.364308 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:29.364308 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 15:16:29.364308 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 15:16:29.364308 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 15:16:29.364308 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 15:16:29.364308 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 15:16:29.364308 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 15:16:29.364308 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 15:16:29.364308 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:29.367477 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 385/755] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Aug 2 15:16:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:29.368430 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3aad0e-a380-4e0a-9829-0b6aee28dcf6 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:29.377691 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a42dfe-3d79-4da2-99e9-a9e20152a6a5 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:29.417393 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184f2f02-c9ab-4178-a14d-b741a07886e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:29.418283 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f2f02-c9ab-4178-a14d-b741a07886e8 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:29.418738 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f2f02-c9ab-4178-a14d-b741a07886e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:29.419159 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f2f02-c9ab-4178-a14d-b741a07886e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:29.427507 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184f2f02-c9ab-4178-a14d-b741a07886e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:29.429147 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184f2f02-c9ab-4178-a14d-b741a07886e8 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:29.442000 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-184f2f02-c9ab-4178-a14d-b741a07886e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:16:29.442000 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:29.442000 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:29.442000 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:29.442000 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:29.442000 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:29.442000 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:29.442000 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:29.442000 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:29.442000 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:29.442000 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:29.442000 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:29.442000 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 15:16:29.442000 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 15:16:29.442000 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 15:16:29.443112 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 15:16:29.443112 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:29.443112 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:29.443112 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:29.443112 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:29.443112 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:29.443112 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:29.443112 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:29.443112 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:29.443112 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:29.443112 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:29.443112 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:29.443112 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:29.443112 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:29.443112 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:29.443112 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:29.443112 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:29.444160 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 15:16:29.444160 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 15:16:29.444160 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 15:16:29.444160 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 15:16:29.444160 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 15:16:29.444160 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 15:16:29.444160 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:16:29.444160 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:29.446214 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 371/756] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 2 15:16:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:29.447257 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184f2f02-c9ab-4178-a14d-b741a07886e8 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:29.460180 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:29.475050 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:29.485413 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3aad0e-a380-4e0a-9829-0b6aee28dcf6 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:29.522637 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e232e7-9a1b-4289-a8c4-697440cb99d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:29.523549 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e232e7-9a1b-4289-a8c4-697440cb99d3 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:29.523690 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e232e7-9a1b-4289-a8c4-697440cb99d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:29.523919 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e232e7-9a1b-4289-a8c4-697440cb99d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:29.524712 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e232e7-9a1b-4289-a8c4-697440cb99d3 None admin] RBAC: Adding query filter params (role.id=d75c9572cb294caeb8eb456521ff6f57, scope.project.id=cc19d22b4cd64dd1bc89ed78155d2732, user.id=6f4de590df474c8b95f2b1193f7dbcb5) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:29.525018 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e232e7-9a1b-4289-a8c4-697440cb99d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:29.526458 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e232e7-9a1b-4289-a8c4-697440cb99d3 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:29.539550 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 386/757] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 2 15:16:29 2022] GET /identity/v3/role_assignments?user.id=6f4de590df474c8b95f2b1193f7dbcb5&scope.project.id=cc19d22b4cd64dd1bc89ed78155d2732&role.id=d75c9572cb294caeb8eb456521ff6f57 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:29.540559 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e232e7-9a1b-4289-a8c4-697440cb99d3 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:29.562559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184f2f02-c9ab-4178-a14d-b741a07886e8 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:29.603128 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca045190-faea-4488-b468-fdf8a405e7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:29.604113 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca045190-faea-4488-b468-fdf8a405e7cc None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:29.604589 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca045190-faea-4488-b468-fdf8a405e7cc None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:29.605040 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca045190-faea-4488-b468-fdf8a405e7cc None admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:29.606050 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca045190-faea-4488-b468-fdf8a405e7cc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:29.606551 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca045190-faea-4488-b468-fdf8a405e7cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:29.608720 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca045190-faea-4488-b468-fdf8a405e7cc None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:29.632522 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 372/758] 10.222.0.42 () {56 vars in 1149 bytes} [Tue Aug 2 15:16:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:29.640685 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca045190-faea-4488-b468-fdf8a405e7cc None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:29.777866 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:29.827563 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca045190-faea-4488-b468-fdf8a405e7cc None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:29.872026 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3cee9f-db47-43a6-8218-985546dbead3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:29.872869 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3cee9f-db47-43a6-8218-985546dbead3 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:29.872869 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3cee9f-db47-43a6-8218-985546dbead3 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:29.873158 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3cee9f-db47-43a6-8218-985546dbead3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:29.885816 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e232e7-9a1b-4289-a8c4-697440cb99d3 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:29.932101 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e3c1f-e5f9-4e38-a6ee-dcf90b07f916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:29.933113 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e3c1f-e5f9-4e38-a6ee-dcf90b07f916 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:29.933590 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e3c1f-e5f9-4e38-a6ee-dcf90b07f916 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:29.934350 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e3c1f-e5f9-4e38-a6ee-dcf90b07f916 None admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:29.935480 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e3c1f-e5f9-4e38-a6ee-dcf90b07f916 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:29.938349 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e3c1f-e5f9-4e38-a6ee-dcf90b07f916 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:29.940062 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e3c1f-e5f9-4e38-a6ee-dcf90b07f916 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:29.963952 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 387/759] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 2 15:16:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 424 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:29.972229 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e3c1f-e5f9-4e38-a6ee-dcf90b07f916 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:29.992986 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:30.031543 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3cee9f-db47-43a6-8218-985546dbead3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:30.033182 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3cee9f-db47-43a6-8218-985546dbead3 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:30.107872 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e3c1f-e5f9-4e38-a6ee-dcf90b07f916 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:30.138890 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:30.159985 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956c65c0-f178-447b-bc6e-95d5372a14ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:30.161478 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c65c0-f178-447b-bc6e-95d5372a14ab None admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:30.161478 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c65c0-f178-447b-bc6e-95d5372a14ab None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:30.162071 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c65c0-f178-447b-bc6e-95d5372a14ab None admin] PATH_INFO: `/v3/projects/cc19d22b4cd64dd1bc89ed78155d2732/users/4c0865af59bf43dfa4c84213d7db53c5/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:30.164917 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956c65c0-f178-447b-bc6e-95d5372a14ab None admin] RBAC: Authorizing `identity:create_grant(project_id=cc19d22b4cd64dd1bc89ed78155d2732, user_id=4c0865af59bf43dfa4c84213d7db53c5, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:30.167323 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956c65c0-f178-447b-bc6e-95d5372a14ab None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:30.185152 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 373/760] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 2 15:16:29 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 02 15:16:30.186657 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d58fb5-855f-4a58-a1d0-31b9fc31444f None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:30.187008 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d58fb5-855f-4a58-a1d0-31b9fc31444f None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:30.187312 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d58fb5-855f-4a58-a1d0-31b9fc31444f None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:30.192837 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 388/762] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 2 15:16:29 2022] PUT /identity/v3/projects/cc19d22b4cd64dd1bc89ed78155d2732/users/4c0865af59bf43dfa4c84213d7db53c5/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:16:30.193050 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 374/762] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:16:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:16:30.193856 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956c65c0-f178-447b-bc6e-95d5372a14ab None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:30.194415 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565b83a-510a-4276-9b68-1c44d5141370 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:30.194709 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565b83a-510a-4276-9b68-1c44d5141370 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:30.195064 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565b83a-510a-4276-9b68-1c44d5141370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:30.230564 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-c565b83a-510a-4276-9b68-1c44d5141370 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:16:30.232336 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-c565b83a-510a-4276-9b68-1c44d5141370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:16:30.374541 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:30.393753 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 375/763] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:16:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 15:16:30.404051 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956c65c0-f178-447b-bc6e-95d5372a14ab None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:30.430405 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c565b83a-510a-4276-9b68-1c44d5141370 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:30.464254 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e9ebc-c294-424c-9a33-4a335ba27f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:30.464911 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e9ebc-c294-424c-9a33-4a335ba27f0f None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:30.465193 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e9ebc-c294-424c-9a33-4a335ba27f0f None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:30.465470 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e9ebc-c294-424c-9a33-4a335ba27f0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:30.481891 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810e9ebc-c294-424c-9a33-4a335ba27f0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:30.483420 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810e9ebc-c294-424c-9a33-4a335ba27f0f None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:30.498862 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-810e9ebc-c294-424c-9a33-4a335ba27f0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:30.498862 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:30.498862 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:30.498862 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:30.498862 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:30.498862 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:30.498862 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:30.498862 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:30.498862 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:30.498862 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:30.498862 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:30.498862 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:30.498862 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:16:30.498862 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:16:30.498862 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:16:30.500808 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:16:30.500808 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:30.500808 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:30.500808 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:30.500808 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:30.500808 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:30.500808 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:30.500808 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:30.500808 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:30.500808 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:30.500808 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:30.500808 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:30.500808 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:30.500808 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:30.500808 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:30.500808 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:30.500808 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:30.501959 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:16:30.501959 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:16:30.501959 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:30.501959 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:30.501959 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 389/764] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:16:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:30.507695 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e9ebc-c294-424c-9a33-4a335ba27f0f None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:30.621489 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:30.633369 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c565b83a-510a-4276-9b68-1c44d5141370 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:30.686449 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e9ebc-c294-424c-9a33-4a335ba27f0f None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:30.692722 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f71dd5-db46-46e0-b4fb-13448f21af67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:30.693383 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f71dd5-db46-46e0-b4fb-13448f21af67 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:30.693652 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f71dd5-db46-46e0-b4fb-13448f21af67 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:30.693926 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f71dd5-db46-46e0-b4fb-13448f21af67 None admin] PATH_INFO: `/v3/services/network` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:30.694565 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f71dd5-db46-46e0-b4fb-13448f21af67 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:30.695968 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f71dd5-db46-46e0-b4fb-13448f21af67 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:30.713467 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-09f71dd5-db46-46e0-b4fb-13448f21af67 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 15:16:30.713467 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:30.713467 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 15:16:30.713467 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 15:16:30.713467 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 15:16:30.713467 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 15:16:30.713467 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 15:16:30.713467 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 15:16:30.713467 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 15:16:30.713467 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:30.713467 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 15:16:30.713467 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:30.713467 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:30.713467 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:30.713467 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:30.713467 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:30.713467 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:30.715946 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:30.715946 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:30.715946 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:30.715946 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:30.715946 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:30.715946 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:30.715946 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 15:16:30.715946 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 15:16:30.715946 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 15:16:30.715946 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 15:16:30.715946 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:30.715946 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:30.715946 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:30.715946 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:30.715946 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:30.715946 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:30.717897 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:30.717897 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:30.717897 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:30.717897 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:30.717897 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:30.717897 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:30.717897 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:30.717897 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:30.717897 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:30.717897 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:30.717897 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 15:16:30.717897 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 15:16:30.717897 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 15:16:30.717897 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:30.719595 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 376/765] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 2 15:16:30 2022] GET /identity/v3/services/network => generated 88 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:30.723419 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f71dd5-db46-46e0-b4fb-13448f21af67 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:30.743797 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:30.755797 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a6cea-8cf0-4902-847d-35fb3477e827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:30.756439 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a6cea-8cf0-4902-847d-35fb3477e827 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:30.756722 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a6cea-8cf0-4902-847d-35fb3477e827 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:30.757000 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a6cea-8cf0-4902-847d-35fb3477e827 None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:30.757718 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a6cea-8cf0-4902-847d-35fb3477e827 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:30.758030 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a6cea-8cf0-4902-847d-35fb3477e827 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:30.760282 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a6cea-8cf0-4902-847d-35fb3477e827 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:30.778266 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 390/766] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:16:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:30.783258 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a6cea-8cf0-4902-847d-35fb3477e827 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:30.919127 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a6cea-8cf0-4902-847d-35fb3477e827 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:30.947977 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f71dd5-db46-46e0-b4fb-13448f21af67 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:30.972930 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc45ca8-ad53-456e-bd8a-bdb5fc89956c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:30.974125 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc45ca8-ad53-456e-bd8a-bdb5fc89956c None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:30.974408 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc45ca8-ad53-456e-bd8a-bdb5fc89956c None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:30.974679 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc45ca8-ad53-456e-bd8a-bdb5fc89956c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:30.992884 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc45ca8-ad53-456e-bd8a-bdb5fc89956c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:30.996010 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc45ca8-ad53-456e-bd8a-bdb5fc89956c None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:31.018277 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-ccc45ca8-ad53-456e-bd8a-bdb5fc89956c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:16:31.018277 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:31.018277 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:31.018277 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:31.018277 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:31.018277 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:31.018277 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:31.018277 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:31.018277 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:31.018277 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:31.018277 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:31.018277 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:31.018277 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 15:16:31.018277 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 15:16:31.018277 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 15:16:31.019257 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 15:16:31.019257 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:31.019257 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:31.019257 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:31.019257 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:31.019257 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:31.019257 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:31.019257 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:31.019257 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:31.019257 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:31.019257 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:31.019257 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:31.019257 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:31.019257 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:31.019257 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:31.019257 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:31.019257 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:31.020700 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 15:16:31.020700 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 15:16:31.020700 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 15:16:31.020700 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 15:16:31.020700 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 15:16:31.020700 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 15:16:31.020700 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:16:31.020700 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:31.021121 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74940fdd-599e-4047-93cb-de403b21c5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:31.021210 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74940fdd-599e-4047-93cb-de403b21c5df None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:31.021814 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74940fdd-599e-4047-93cb-de403b21c5df None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:31.021814 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74940fdd-599e-4047-93cb-de403b21c5df None admin] PATH_INFO: `/v3/services` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:31.022429 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74940fdd-599e-4047-93cb-de403b21c5df None admin] RBAC: Adding query filter params (name=network) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:31.022735 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74940fdd-599e-4047-93cb-de403b21c5df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:31.023763 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 391/767] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 2 15:16:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:31.028541 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74940fdd-599e-4047-93cb-de403b21c5df None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:31.029724 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc45ca8-ad53-456e-bd8a-bdb5fc89956c None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:31.030128 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 377/768] 10.222.0.42 () {56 vars in 1112 bytes} [Tue Aug 2 15:16:30 2022] GET /identity/v3/services?name=network => generated 124 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:31.036249 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74940fdd-599e-4047-93cb-de403b21c5df None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:31.095420 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:31.155624 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:31.257043 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74940fdd-599e-4047-93cb-de403b21c5df None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:31.267155 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc45ca8-ad53-456e-bd8a-bdb5fc89956c None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:31.311051 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bfccb4-47b0-43a5-8821-f35e2015c457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:31.311714 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bfccb4-47b0-43a5-8821-f35e2015c457 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:31.312000 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bfccb4-47b0-43a5-8821-f35e2015c457 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:31.312285 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bfccb4-47b0-43a5-8821-f35e2015c457 None admin] PATH_INFO: `/v3/services` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:31.313235 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bfccb4-47b0-43a5-8821-f35e2015c457 None admin] RBAC: Adding query filter params (type=network) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:31.313551 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bfccb4-47b0-43a5-8821-f35e2015c457 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:31.315738 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bfccb4-47b0-43a5-8821-f35e2015c457 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:31.320295 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a6a0c-85d7-42ca-b11e-83c423987765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:31.321210 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a6a0c-85d7-42ca-b11e-83c423987765 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:31.321446 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 378/769] 10.222.0.42 () {56 vars in 1112 bytes} [Tue Aug 2 15:16:31 2022] GET /identity/v3/services?type=network => generated 350 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:16:31.321867 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a6a0c-85d7-42ca-b11e-83c423987765 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:31.322322 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a6a0c-85d7-42ca-b11e-83c423987765 None admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:31.322688 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d09bb-154a-4e3a-b2f6-df2428f675b8 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:31.322978 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d09bb-154a-4e3a-b2f6-df2428f675b8 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:31.323664 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3a6a0c-85d7-42ca-b11e-83c423987765 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:31.324169 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3a6a0c-85d7-42ca-b11e-83c423987765 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:31.325816 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3a6a0c-85d7-42ca-b11e-83c423987765 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:31.328449 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d09bb-154a-4e3a-b2f6-df2428f675b8 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:31.334848 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 379/770] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:16:31 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:16:31.334848 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998d09bb-154a-4e3a-b2f6-df2428f675b8 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:31.344692 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 392/771] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 2 15:16:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:31.346125 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1011ae96-5768-4646-ba7e-76ddef52d6dc None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:31.346888 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1011ae96-5768-4646-ba7e-76ddef52d6dc None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:31.346888 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1011ae96-5768-4646-ba7e-76ddef52d6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:31.367059 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-1011ae96-5768-4646-ba7e-76ddef52d6dc None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:16:31.368411 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-1011ae96-5768-4646-ba7e-76ddef52d6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:16:31.440358 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:31.447573 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 393/772] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:16:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 15:16:31.447573 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1011ae96-5768-4646-ba7e-76ddef52d6dc None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:31.472742 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998d09bb-154a-4e3a-b2f6-df2428f675b8 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:31.499339 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:31.516517 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1878bde0-0745-489e-aae3-699527d4951b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:31.517071 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878bde0-0745-489e-aae3-699527d4951b None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:31.517358 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878bde0-0745-489e-aae3-699527d4951b None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:31.517640 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878bde0-0745-489e-aae3-699527d4951b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:31.518401 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1878bde0-0745-489e-aae3-699527d4951b None admin] RBAC: Adding query filter params (interface=public, service_id=35fb2c58e27949ad847214bd724257d1, region_id=RegionOne) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:31.518717 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1878bde0-0745-489e-aae3-699527d4951b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:31.520925 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1878bde0-0745-489e-aae3-699527d4951b None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:31.532259 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 380/773] 10.222.0.42 () {56 vars in 1251 bytes} [Tue Aug 2 15:16:31 2022] GET /identity/v3/endpoints?service_id=35fb2c58e27949ad847214bd724257d1&interface=public®ion_id=RegionOne => generated 194 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:31.533207 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1878bde0-0745-489e-aae3-699527d4951b None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:31.584369 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1011ae96-5768-4646-ba7e-76ddef52d6dc None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:31.629338 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd8396-89a1-4544-9a1a-0a721af6f357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:31.630625 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd8396-89a1-4544-9a1a-0a721af6f357 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:31.631060 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd8396-89a1-4544-9a1a-0a721af6f357 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:31.631597 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd8396-89a1-4544-9a1a-0a721af6f357 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:31.632865 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cd8396-89a1-4544-9a1a-0a721af6f357 None admin] RBAC: Adding query filter params (role.id=532162a00de849cea5c27767c8acd018, scope.project.id=cc19d22b4cd64dd1bc89ed78155d2732, user.id=dfe8c00c0c3d4c4b8b6f36e39a3a2e71) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:31.633650 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cd8396-89a1-4544-9a1a-0a721af6f357 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:31.635647 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cd8396-89a1-4544-9a1a-0a721af6f357 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:31.643201 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 394/774] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 2 15:16:31 2022] GET /identity/v3/role_assignments?user.id=dfe8c00c0c3d4c4b8b6f36e39a3a2e71&scope.project.id=cc19d22b4cd64dd1bc89ed78155d2732&role.id=532162a00de849cea5c27767c8acd018 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:31.644239 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd8396-89a1-4544-9a1a-0a721af6f357 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:31.680049 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1878bde0-0745-489e-aae3-699527d4951b None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:31.756196 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a0c3d-4aaf-4e7f-bab4-96191e348199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:31.756877 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a0c3d-4aaf-4e7f-bab4-96191e348199 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:31.757165 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a0c3d-4aaf-4e7f-bab4-96191e348199 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:31.757447 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a0c3d-4aaf-4e7f-bab4-96191e348199 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:31.758195 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481a0c3d-4aaf-4e7f-bab4-96191e348199 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:31.759803 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481a0c3d-4aaf-4e7f-bab4-96191e348199 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:31.773341 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-481a0c3d-4aaf-4e7f-bab4-96191e348199 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 15:16:31.773341 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:31.773341 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 15:16:31.773341 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 15:16:31.773341 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 15:16:31.773341 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 15:16:31.773341 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 15:16:31.773341 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 15:16:31.773341 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 15:16:31.773341 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:31.773341 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 15:16:31.773341 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:31.773341 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:31.773341 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:31.773341 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:31.773341 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:31.774494 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:31.774494 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:31.774494 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:31.774494 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:31.774494 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:31.774494 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:31.774494 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:31.774494 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 15:16:31.774494 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 15:16:31.774494 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 15:16:31.774494 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 15:16:31.774494 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:31.774494 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:31.774494 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:31.774494 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:31.774494 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:31.775673 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:31.775673 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:31.775673 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:31.775673 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:31.775673 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:31.775673 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:31.775673 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:31.775673 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:31.775673 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:31.775673 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:31.775673 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:31.775673 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 15:16:31.775673 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 15:16:31.775673 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 15:16:31.775673 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:31.781307 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 381/775] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Aug 2 15:16:31 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:31.791204 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd8396-89a1-4544-9a1a-0a721af6f357 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:31.793635 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:31.795920 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a0c3d-4aaf-4e7f-bab4-96191e348199 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:31.836153 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:31.837933 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3be17-b33a-4fc6-b5e6-239ba560f431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:31.838925 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3be17-b33a-4fc6-b5e6-239ba560f431 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:31.839453 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3be17-b33a-4fc6-b5e6-239ba560f431 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:31.839910 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3be17-b33a-4fc6-b5e6-239ba560f431 None admin] PATH_INFO: `/v3/services` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:31.841632 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f3be17-b33a-4fc6-b5e6-239ba560f431 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:31.843244 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f3be17-b33a-4fc6-b5e6-239ba560f431 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:31.851675 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 395/776] 10.222.0.42 () {56 vars in 1087 bytes} [Tue Aug 2 15:16:31 2022] GET /identity/v3/services => generated 772 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:31.925089 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544365ea-55a1-492f-9189-0e8c51202a15 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:31.925637 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544365ea-55a1-492f-9189-0e8c51202a15 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:31.925953 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544365ea-55a1-492f-9189-0e8c51202a15 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:31.928154 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 396/777] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:16:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:16:31.933825 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db2401-2a89-4659-a80a-f360eed4798f None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:31.934102 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db2401-2a89-4659-a80a-f360eed4798f None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:31.934385 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db2401-2a89-4659-a80a-f360eed4798f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:31.954735 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a0c3d-4aaf-4e7f-bab4-96191e348199 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:31.959248 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-d1db2401-2a89-4659-a80a-f360eed4798f None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:16:31.959248 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-d1db2401-2a89-4659-a80a-f360eed4798f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:16:32.003985 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca652c78-638f-4a10-b231-de8ea13baebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:32.005198 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca652c78-638f-4a10-b231-de8ea13baebe None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:32.005483 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca652c78-638f-4a10-b231-de8ea13baebe None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:32.005762 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca652c78-638f-4a10-b231-de8ea13baebe None admin] PATH_INFO: `/v3/services` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:32.006456 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca652c78-638f-4a10-b231-de8ea13baebe None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:32.006763 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca652c78-638f-4a10-b231-de8ea13baebe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:32.008229 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca652c78-638f-4a10-b231-de8ea13baebe None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:32.024155 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 382/778] 10.222.0.42 () {56 vars in 1124 bytes} [Tue Aug 2 15:16:31 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:32.030566 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca652c78-638f-4a10-b231-de8ea13baebe None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:32.085614 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 397/779] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:16:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 15:16:32.122086 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db2401-2a89-4659-a80a-f360eed4798f None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:32.176852 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:32.229591 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca652c78-638f-4a10-b231-de8ea13baebe None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:32.287518 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db2401-2a89-4659-a80a-f360eed4798f None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:32.290236 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:32.315604 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19532b6-0dfc-4af8-b9ca-c545fd81ec5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:32.316279 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19532b6-0dfc-4af8-b9ca-c545fd81ec5c None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:32.317101 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19532b6-0dfc-4af8-b9ca-c545fd81ec5c None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:32.317381 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19532b6-0dfc-4af8-b9ca-c545fd81ec5c None admin] PATH_INFO: `/v3/services` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:32.318065 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19532b6-0dfc-4af8-b9ca-c545fd81ec5c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:32.318369 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19532b6-0dfc-4af8-b9ca-c545fd81ec5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:32.319806 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19532b6-0dfc-4af8-b9ca-c545fd81ec5c None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:32.334082 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 383/780] 10.222.0.42 () {56 vars in 1124 bytes} [Tue Aug 2 15:16:32 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:32.341227 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19532b6-0dfc-4af8-b9ca-c545fd81ec5c None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:32.366134 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf34a2d-d3b6-4685-9c27-06db512b32a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:32.366803 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf34a2d-d3b6-4685-9c27-06db512b32a7 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:32.367086 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf34a2d-d3b6-4685-9c27-06db512b32a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:32.367393 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf34a2d-d3b6-4685-9c27-06db512b32a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:32.383838 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf34a2d-d3b6-4685-9c27-06db512b32a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:16:32.389258 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-ecf34a2d-d3b6-4685-9c27-06db512b32a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 15:16:32.389258 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:32.389258 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:32.389258 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:32.389258 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:32.389258 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:32.389258 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:32.389258 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:32.389258 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:32.389258 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:32.389258 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:32.389258 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:32.389258 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:16:32.389258 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:16:32.389258 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:16:32.389258 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:16:32.390199 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:16:32.390199 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:16:32.390199 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:16:32.390199 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:16:32.390199 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:32.390199 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:32.390199 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:32.390199 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:32.390199 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:32.390199 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:32.390199 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:32.390199 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:32.390199 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:32.390199 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:32.390199 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:32.390199 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:32.391037 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:32.391037 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:32.391037 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:32.391037 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:32.391037 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:16:32.391037 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:16:32.391037 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:16:32.391037 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:16:32.391037 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:16:32.391037 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:16:32.391037 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 15:16:32.391037 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:32.399712 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 398/781] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 2 15:16:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 15:16:32.405375 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf34a2d-d3b6-4685-9c27-06db512b32a7 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:32.466573 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19532b6-0dfc-4af8-b9ca-c545fd81ec5c None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:32.514830 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66441e55-051f-4ca7-85a1-6175cae34bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:32.515490 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66441e55-051f-4ca7-85a1-6175cae34bd7 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:32.515775 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66441e55-051f-4ca7-85a1-6175cae34bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:32.516055 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66441e55-051f-4ca7-85a1-6175cae34bd7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:32.516820 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66441e55-051f-4ca7-85a1-6175cae34bd7 None admin] RBAC: Adding query filter params (interface=public, service_id=9789f1729da846b8a04a37bc5a184322, region_id=RegionOne) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:32.517134 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66441e55-051f-4ca7-85a1-6175cae34bd7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:32.518523 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66441e55-051f-4ca7-85a1-6175cae34bd7 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:32.529828 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 384/782] 10.222.0.42 () {56 vars in 1251 bytes} [Tue Aug 2 15:16:32 2022] GET /identity/v3/endpoints?service_id=9789f1729da846b8a04a37bc5a184322&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:16:32.540319 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66441e55-051f-4ca7-85a1-6175cae34bd7 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:32.571611 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:32.576030 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf34a2d-d3b6-4685-9c27-06db512b32a7 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:32.622810 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88cc8b9-d634-4435-9865-1dce94bb867e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:32.623598 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88cc8b9-d634-4435-9865-1dce94bb867e None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:32.623885 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88cc8b9-d634-4435-9865-1dce94bb867e None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:32.624166 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88cc8b9-d634-4435-9865-1dce94bb867e None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:32.624895 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88cc8b9-d634-4435-9865-1dce94bb867e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:32.625203 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88cc8b9-d634-4435-9865-1dce94bb867e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:32.626724 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88cc8b9-d634-4435-9865-1dce94bb867e None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:32.642027 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 399/783] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 2 15:16:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:16:32.643841 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf32d9-0028-4320-9a64-de764c874c42 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:32.644135 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf32d9-0028-4320-9a64-de764c874c42 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:32.644421 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf32d9-0028-4320-9a64-de764c874c42 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:32.646861 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 400/784] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:16:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:16:32.647770 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bf32d9-0028-4320-9a64-de764c874c42 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:32.672867 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:32.699068 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66441e55-051f-4ca7-85a1-6175cae34bd7 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:32.772555 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eabf3b-8567-44a6-ac8a-73537f0e67b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:32.774108 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eabf3b-8567-44a6-ac8a-73537f0e67b1 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:32.774848 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eabf3b-8567-44a6-ac8a-73537f0e67b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:32.775869 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eabf3b-8567-44a6-ac8a-73537f0e67b1 None admin] PATH_INFO: `/v3/services` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:32.777330 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eabf3b-8567-44a6-ac8a-73537f0e67b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:32.779786 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bf32d9-0028-4320-9a64-de764c874c42 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:32.780414 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eabf3b-8567-44a6-ac8a-73537f0e67b1 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:32.801109 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 385/785] 10.222.0.42 () {56 vars in 1087 bytes} [Tue Aug 2 15:16:32 2022] GET /identity/v3/services => generated 772 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:32.803302 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c15c2b-cc3a-41de-a33e-26dce3423c01 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:32.803664 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c15c2b-cc3a-41de-a33e-26dce3423c01 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:32.804021 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c15c2b-cc3a-41de-a33e-26dce3423c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:32.824362 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df335a1a-55a4-4fda-b374-0b7b5ff3e133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:32.825006 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df335a1a-55a4-4fda-b374-0b7b5ff3e133 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:32.825284 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df335a1a-55a4-4fda-b374-0b7b5ff3e133 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:32.825558 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df335a1a-55a4-4fda-b374-0b7b5ff3e133 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:32.836906 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-02c15c2b-cc3a-41de-a33e-26dce3423c01 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:16:32.838362 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-02c15c2b-cc3a-41de-a33e-26dce3423c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:16:32.838862 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df335a1a-55a4-4fda-b374-0b7b5ff3e133 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:32.840375 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df335a1a-55a4-4fda-b374-0b7b5ff3e133 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:32.874173 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-df335a1a-55a4-4fda-b374-0b7b5ff3e133 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:32.874173 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:32.874173 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:32.874173 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:32.874173 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:32.874173 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:32.874173 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:32.874173 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:32.874173 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:32.874173 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:32.874173 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:32.874173 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:32.874173 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:16:32.874173 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:16:32.874173 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:16:32.876329 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:16:32.876329 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:32.876329 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:32.876329 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:32.876329 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:32.876329 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:32.876329 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:32.876329 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:32.876329 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:32.876329 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:32.876329 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:32.876329 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:32.876329 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:32.876329 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:32.876329 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:32.876329 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:32.876329 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:32.878453 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:16:32.878453 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:16:32.878453 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:32.878453 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:32.883242 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 401/786] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:16:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 15:16:32.887979 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df335a1a-55a4-4fda-b374-0b7b5ff3e133 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:33.015255 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 386/787] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:16:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 15:16:33.040819 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:33.072262 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c15c2b-cc3a-41de-a33e-26dce3423c01 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:33.074327 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:33.119591 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df335a1a-55a4-4fda-b374-0b7b5ff3e133 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:33.186846 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7ceedc-f662-4e2b-b228-5a4b222d32e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:33.187457 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ceedc-f662-4e2b-b228-5a4b222d32e0 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:33.187743 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ceedc-f662-4e2b-b228-5a4b222d32e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:33.188020 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ceedc-f662-4e2b-b228-5a4b222d32e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:33.189009 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7ceedc-f662-4e2b-b228-5a4b222d32e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:33.189315 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7ceedc-f662-4e2b-b228-5a4b222d32e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:33.190887 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7ceedc-f662-4e2b-b228-5a4b222d32e0 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:33.206884 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 402/788] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:16:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:16:33.214666 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7ceedc-f662-4e2b-b228-5a4b222d32e0 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:33.340330 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c15c2b-cc3a-41de-a33e-26dce3423c01 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:33.417142 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76fae84-62bb-43b4-8c6b-e801a87fdfa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:33.417803 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76fae84-62bb-43b4-8c6b-e801a87fdfa2 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:33.418089 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76fae84-62bb-43b4-8c6b-e801a87fdfa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:33.418358 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76fae84-62bb-43b4-8c6b-e801a87fdfa2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:33.442898 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76fae84-62bb-43b4-8c6b-e801a87fdfa2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:16:33.453972 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7ceedc-f662-4e2b-b228-5a4b222d32e0 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:33.455708 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-b76fae84-62bb-43b4-8c6b-e801a87fdfa2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 15:16:33.455708 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:33.455708 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:33.455708 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:33.455708 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:33.455708 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:33.455708 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:33.455708 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:33.455708 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:33.455708 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:33.455708 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:33.455708 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:33.455708 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:16:33.455708 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:16:33.455708 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:16:33.455708 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:16:33.456621 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:16:33.456621 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:16:33.456621 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:16:33.456621 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:16:33.456621 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:33.456621 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:33.456621 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:33.456621 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:33.456621 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:33.456621 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:33.456621 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:33.456621 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:33.456621 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:33.456621 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:33.456621 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:33.456621 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:33.458023 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:33.458023 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:33.458023 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:33.458023 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:33.458023 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:16:33.458023 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:16:33.458023 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:16:33.458023 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:16:33.458023 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:16:33.458023 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:16:33.458023 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 15:16:33.458023 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:33.463572 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 387/789] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 2 15:16:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 392 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 15:16:33.464554 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76fae84-62bb-43b4-8c6b-e801a87fdfa2 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:33.516942 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:33.524702 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af516f-e009-45f7-ac7a-73aaa734b6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:33.525708 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af516f-e009-45f7-ac7a-73aaa734b6ad None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:33.526189 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af516f-e009-45f7-ac7a-73aaa734b6ad None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:33.526678 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af516f-e009-45f7-ac7a-73aaa734b6ad None admin] PATH_INFO: `/v3/users/swift` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:33.534631 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8af516f-e009-45f7-ac7a-73aaa734b6ad None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:33.536949 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8af516f-e009-45f7-ac7a-73aaa734b6ad None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:33.549806 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-f8af516f-e009-45f7-ac7a-73aaa734b6ad None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 02 15:16:33.549806 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:33.549806 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:33.549806 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:33.549806 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:33.549806 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:33.549806 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:33.549806 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:33.549806 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:33.549806 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:33.549806 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:33.549806 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:33.549806 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 15:16:33.549806 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 15:16:33.549806 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 15:16:33.549806 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 15:16:33.551543 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:33.551543 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:33.551543 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 15:16:33.551543 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:16:33.551543 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 15:16:33.551543 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:16:33.551543 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:33.551543 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:33.551543 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:33.551543 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:33.551543 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:33.551543 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:33.551543 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:33.551543 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:33.551543 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:33.551543 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:33.551543 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:33.551543 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:33.552512 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:33.552512 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:33.552512 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 15:16:33.552512 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 15:16:33.552512 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 15:16:33.552512 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 15:16:33.552512 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 15:16:33.552512 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 15:16:33.552512 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 02 15:16:33.552512 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:33.555499 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 403/790] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 2 15:16:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:33.561265 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af516f-e009-45f7-ac7a-73aaa734b6ad None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:33.631373 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:33.709847 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76fae84-62bb-43b4-8c6b-e801a87fdfa2 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:33.765399 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af516f-e009-45f7-ac7a-73aaa734b6ad None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:33.812571 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da850f-2e59-4a8f-a13e-a453a4362b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:33.813227 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da850f-2e59-4a8f-a13e-a453a4362b34 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:33.813509 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da850f-2e59-4a8f-a13e-a453a4362b34 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:33.813783 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da850f-2e59-4a8f-a13e-a453a4362b34 None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:33.814510 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05da850f-2e59-4a8f-a13e-a453a4362b34 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:33.814814 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05da850f-2e59-4a8f-a13e-a453a4362b34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:33.816261 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05da850f-2e59-4a8f-a13e-a453a4362b34 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:33.837057 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 388/791] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 2 15:16:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:33.839891 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50306871-e24e-43f4-bcc4-419f49cd0d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:33.840742 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50306871-e24e-43f4-bcc4-419f49cd0d7b None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:33.841208 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50306871-e24e-43f4-bcc4-419f49cd0d7b None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:33.841927 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50306871-e24e-43f4-bcc4-419f49cd0d7b None admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:33.843009 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da850f-2e59-4a8f-a13e-a453a4362b34 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:33.845494 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50306871-e24e-43f4-bcc4-419f49cd0d7b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:33.849043 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50306871-e24e-43f4-bcc4-419f49cd0d7b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:33.853858 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50306871-e24e-43f4-bcc4-419f49cd0d7b None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:33.903848 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 404/792] 10.222.0.42 () {56 vars in 1135 bytes} [Tue Aug 2 15:16:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:16:33.906186 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50306871-e24e-43f4-bcc4-419f49cd0d7b None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:34.000832 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:34.077559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da850f-2e59-4a8f-a13e-a453a4362b34 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:34.081204 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50306871-e24e-43f4-bcc4-419f49cd0d7b None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:34.109086 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:34.119708 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8041186f-1b09-4eb1-9364-8df8b61fd5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:34.120345 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041186f-1b09-4eb1-9364-8df8b61fd5e9 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:34.120625 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041186f-1b09-4eb1-9364-8df8b61fd5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:34.120899 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041186f-1b09-4eb1-9364-8df8b61fd5e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:34.124760 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd12ec-1231-42f1-870e-345996b5e1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:34.125402 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd12ec-1231-42f1-870e-345996b5e1ce None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:34.125680 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd12ec-1231-42f1-870e-345996b5e1ce None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:34.125959 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd12ec-1231-42f1-870e-345996b5e1ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:34.133070 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8041186f-1b09-4eb1-9364-8df8b61fd5e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:34.134536 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8041186f-1b09-4eb1-9364-8df8b61fd5e9 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:34.141031 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcd12ec-1231-42f1-870e-345996b5e1ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:34.143444 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcd12ec-1231-42f1-870e-345996b5e1ce None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:34.150800 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-8041186f-1b09-4eb1-9364-8df8b61fd5e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:34.150800 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:34.150800 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:34.150800 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:34.150800 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:34.150800 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:34.150800 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:34.150800 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:34.150800 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:34.150800 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:34.150800 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:34.150800 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:34.150800 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:16:34.150800 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:16:34.150800 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:16:34.151767 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:16:34.151767 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:34.151767 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:34.151767 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:34.151767 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:34.151767 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:34.151767 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:34.151767 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:34.151767 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:34.151767 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:34.151767 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:34.151767 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:34.151767 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:34.151767 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:34.151767 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:34.151767 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:34.151767 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:34.153048 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:16:34.153048 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:16:34.153048 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:34.153048 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:34.153048 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 405/793] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:16:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:34.154487 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e719f4-a504-4731-84ce-5f20d4dc71b6 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:34.154487 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e719f4-a504-4731-84ce-5f20d4dc71b6 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:34.154487 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e719f4-a504-4731-84ce-5f20d4dc71b6 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:34.159527 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 406/794] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:16:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:16:34.160503 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e719f4-a504-4731-84ce-5f20d4dc71b6 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:34.169559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-6dcd12ec-1231-42f1-870e-345996b5e1ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:34.169559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:34.169559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:34.169559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:34.169559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:34.169559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:34.169559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:34.169559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:34.169559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:34.169559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:34.169559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:34.169559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:34.169559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:16:34.169559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:16:34.169559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:16:34.170454 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:16:34.170454 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:34.170454 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:34.170454 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:34.170454 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:34.170454 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:34.170454 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:34.170454 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:34.170454 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:34.170454 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:34.170454 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:34.170454 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:34.170454 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:34.170454 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:34.170454 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:34.170454 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:34.170454 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:34.171342 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:16:34.171342 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:16:34.171342 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:34.171342 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:34.172761 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 389/795] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:16:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:34.178124 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0169bc4d-9a85-4c6a-b141-f268dde3ea68 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:34.178124 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0169bc4d-9a85-4c6a-b141-f268dde3ea68 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:34.178124 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0169bc4d-9a85-4c6a-b141-f268dde3ea68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:34.201304 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-0169bc4d-9a85-4c6a-b141-f268dde3ea68 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:16:34.203150 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-0169bc4d-9a85-4c6a-b141-f268dde3ea68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:16:34.280329 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:34.286048 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e719f4-a504-4731-84ce-5f20d4dc71b6 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:34.299334 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 390/796] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:16:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 15:16:34.300889 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0169bc4d-9a85-4c6a-b141-f268dde3ea68 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:34.344479 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fbff60-0688-478e-bf00-33d44be917c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:34.345100 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fbff60-0688-478e-bf00-33d44be917c2 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:34.345381 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fbff60-0688-478e-bf00-33d44be917c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:34.345658 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fbff60-0688-478e-bf00-33d44be917c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:34.346468 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fbff60-0688-478e-bf00-33d44be917c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:34.346876 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fbff60-0688-478e-bf00-33d44be917c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:34.348835 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fbff60-0688-478e-bf00-33d44be917c2 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:34.362117 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 407/797] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:16:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:34.363106 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fbff60-0688-478e-bf00-33d44be917c2 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:34.416837 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0169bc4d-9a85-4c6a-b141-f268dde3ea68 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:34.424555 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:34.454417 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252dd5e9-f2f6-4e60-b0fa-1b9e172d30ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:34.455043 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252dd5e9-f2f6-4e60-b0fa-1b9e172d30ca None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:34.455396 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252dd5e9-f2f6-4e60-b0fa-1b9e172d30ca None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:34.455681 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252dd5e9-f2f6-4e60-b0fa-1b9e172d30ca None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:34.456364 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252dd5e9-f2f6-4e60-b0fa-1b9e172d30ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:34.456669 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252dd5e9-f2f6-4e60-b0fa-1b9e172d30ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:34.458075 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252dd5e9-f2f6-4e60-b0fa-1b9e172d30ca None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:34.474628 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 391/798] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:16:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:34.474628 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252dd5e9-f2f6-4e60-b0fa-1b9e172d30ca None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:34.477398 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fbff60-0688-478e-bf00-33d44be917c2 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:34.519889 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f681629c-259b-40e0-b49e-a6c8375d3489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:34.522048 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681629c-259b-40e0-b49e-a6c8375d3489 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:34.523135 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681629c-259b-40e0-b49e-a6c8375d3489 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:34.524058 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681629c-259b-40e0-b49e-a6c8375d3489 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:34.541178 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f681629c-259b-40e0-b49e-a6c8375d3489 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:16:34.546055 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-f681629c-259b-40e0-b49e-a6c8375d3489 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 15:16:34.546055 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:34.546055 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:34.546055 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:34.546055 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:34.546055 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:34.546055 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:34.546055 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:34.546055 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:34.546055 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:34.546055 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:34.546055 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:34.546055 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:16:34.546055 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:16:34.546055 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:16:34.546055 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:16:34.547163 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:16:34.547163 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:16:34.547163 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:16:34.547163 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:16:34.547163 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:34.547163 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:34.547163 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:34.547163 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:34.547163 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:34.547163 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:34.547163 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:34.547163 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:34.547163 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:34.547163 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:34.547163 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:34.547163 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:34.548220 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:34.548220 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:34.548220 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:34.548220 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:34.548220 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:16:34.548220 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:16:34.548220 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:16:34.548220 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:16:34.548220 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:16:34.548220 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:16:34.548220 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 15:16:34.548220 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:34.552570 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 408/799] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 2 15:16:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:34.553802 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b0d4e3-74b7-4c37-8605-a3b390bee21d None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:34.554088 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b0d4e3-74b7-4c37-8605-a3b390bee21d None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:34.554364 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b0d4e3-74b7-4c37-8605-a3b390bee21d None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:34.555681 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 409/800] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:16:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:16:34.556370 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b0d4e3-74b7-4c37-8605-a3b390bee21d None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:34.580059 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:34.589513 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252dd5e9-f2f6-4e60-b0fa-1b9e172d30ca None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:34.627593 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e61f067-3d7a-4c00-b69d-776066710235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:34.628271 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61f067-3d7a-4c00-b69d-776066710235 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:34.628557 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61f067-3d7a-4c00-b69d-776066710235 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:34.628831 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61f067-3d7a-4c00-b69d-776066710235 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:34.636565 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e61f067-3d7a-4c00-b69d-776066710235 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:34.638056 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e61f067-3d7a-4c00-b69d-776066710235 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:34.650423 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-1e61f067-3d7a-4c00-b69d-776066710235 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:16:34.650423 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:34.650423 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:34.650423 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:34.650423 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:34.650423 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:34.650423 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:34.650423 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:34.650423 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:34.650423 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:34.650423 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:34.650423 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:34.650423 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 15:16:34.650423 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 15:16:34.650423 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 15:16:34.651399 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 15:16:34.651399 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:34.651399 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:34.651399 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:34.651399 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:34.651399 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:34.651399 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:34.651399 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:34.651399 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:34.651399 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:34.651399 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:34.651399 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:34.651399 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:34.651399 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:34.651399 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:34.651399 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:34.651399 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:34.657423 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 15:16:34.657423 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 15:16:34.657423 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 15:16:34.657423 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 15:16:34.657423 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 15:16:34.657423 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 15:16:34.657423 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:16:34.657423 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:34.657423 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 392/801] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 2 15:16:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:34.657423 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e61f067-3d7a-4c00-b69d-776066710235 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:34.675392 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b0d4e3-74b7-4c37-8605-a3b390bee21d None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:34.686257 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:34.720700 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da49ea9-d23a-4014-a57d-dc973e2c727c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:34.721348 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da49ea9-d23a-4014-a57d-dc973e2c727c None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:34.721638 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da49ea9-d23a-4014-a57d-dc973e2c727c None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:34.722147 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da49ea9-d23a-4014-a57d-dc973e2c727c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:34.731419 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da49ea9-d23a-4014-a57d-dc973e2c727c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:34.732905 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da49ea9-d23a-4014-a57d-dc973e2c727c None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:34.744607 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-5da49ea9-d23a-4014-a57d-dc973e2c727c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 15:16:34.744607 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:34.744607 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:34.744607 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:34.744607 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:34.744607 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:34.744607 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:34.744607 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:34.744607 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:34.744607 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:34.744607 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:34.744607 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:34.744607 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 15:16:34.744607 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 15:16:34.744607 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 15:16:34.744607 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 15:16:34.745705 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:34.745705 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:34.745705 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 15:16:34.745705 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:16:34.745705 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 15:16:34.745705 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:16:34.745705 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:34.745705 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:34.745705 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:34.745705 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:34.745705 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:34.745705 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:34.745705 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:34.745705 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:34.745705 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:34.745705 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:34.745705 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:34.745705 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:34.746744 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:34.746744 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:34.746744 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 15:16:34.746744 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 15:16:34.746744 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 15:16:34.746744 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 15:16:34.746744 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 15:16:34.746744 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 15:16:34.746744 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 15:16:34.746744 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:34.746744 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 410/802] 10.222.0.42 () {56 vars in 1093 bytes} [Tue Aug 2 15:16:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:34.748012 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7843f6-85e3-45d5-8fa8-d42778e9420f None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:34.748012 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7843f6-85e3-45d5-8fa8-d42778e9420f None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:34.748012 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7843f6-85e3-45d5-8fa8-d42778e9420f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:34.766785 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-ff7843f6-85e3-45d5-8fa8-d42778e9420f None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:16:34.768017 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-ff7843f6-85e3-45d5-8fa8-d42778e9420f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:16:34.775737 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e61f067-3d7a-4c00-b69d-776066710235 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:34.813586 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d97cb5-e82a-4e9d-b2db-0bcbf0fb09ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:34.814233 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d97cb5-e82a-4e9d-b2db-0bcbf0fb09ef None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:34.814513 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d97cb5-e82a-4e9d-b2db-0bcbf0fb09ef None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:34.814790 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d97cb5-e82a-4e9d-b2db-0bcbf0fb09ef None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:34.815536 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d97cb5-e82a-4e9d-b2db-0bcbf0fb09ef None admin] RBAC: Adding query filter params (name=service) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:34.815842 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d97cb5-e82a-4e9d-b2db-0bcbf0fb09ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:34.817636 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d97cb5-e82a-4e9d-b2db-0bcbf0fb09ef None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:34.833080 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 393/803] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Aug 2 15:16:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:34.834189 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d97cb5-e82a-4e9d-b2db-0bcbf0fb09ef None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:34.865964 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 411/804] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:16:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 15:16:34.868488 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7843f6-85e3-45d5-8fa8-d42778e9420f None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:34.892565 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:34.943968 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:34.958410 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d97cb5-e82a-4e9d-b2db-0bcbf0fb09ef None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:34.999833 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5832db-6b01-49c5-be87-c7adbe4aad9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:35.000780 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5832db-6b01-49c5-be87-c7adbe4aad9e None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:35.001075 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5832db-6b01-49c5-be87-c7adbe4aad9e None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:35.001350 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5832db-6b01-49c5-be87-c7adbe4aad9e None admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:35.002090 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5832db-6b01-49c5-be87-c7adbe4aad9e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:35.002397 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5832db-6b01-49c5-be87-c7adbe4aad9e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:35.003861 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5832db-6b01-49c5-be87-c7adbe4aad9e None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:35.010913 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7843f6-85e3-45d5-8fa8-d42778e9420f None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:35.024299 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 394/805] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 2 15:16:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:35.024299 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5832db-6b01-49c5-be87-c7adbe4aad9e None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:35.058141 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18987ede-7603-44b3-9c19-23afd6f4e01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:35.058771 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18987ede-7603-44b3-9c19-23afd6f4e01b None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:35.059058 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18987ede-7603-44b3-9c19-23afd6f4e01b None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:35.059368 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18987ede-7603-44b3-9c19-23afd6f4e01b None admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:35.060164 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18987ede-7603-44b3-9c19-23afd6f4e01b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:35.060476 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18987ede-7603-44b3-9c19-23afd6f4e01b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:35.061933 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18987ede-7603-44b3-9c19-23afd6f4e01b None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:35.081356 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 412/806] 10.222.0.42 () {56 vars in 1133 bytes} [Tue Aug 2 15:16:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:35.082216 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18987ede-7603-44b3-9c19-23afd6f4e01b None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:35.138175 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5832db-6b01-49c5-be87-c7adbe4aad9e None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:35.164832 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:35.188353 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c27a7-d408-4a85-b1e4-2a846405cdbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:35.189008 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c27a7-d408-4a85-b1e4-2a846405cdbc None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:35.189289 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c27a7-d408-4a85-b1e4-2a846405cdbc None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:35.189562 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c27a7-d408-4a85-b1e4-2a846405cdbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:35.200863 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797c27a7-d408-4a85-b1e4-2a846405cdbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:35.202250 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797c27a7-d408-4a85-b1e4-2a846405cdbc None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:35.210490 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18987ede-7603-44b3-9c19-23afd6f4e01b None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:35.212533 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:35.221038 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-797c27a7-d408-4a85-b1e4-2a846405cdbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:35.221038 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:35.221038 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:35.221038 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:35.221038 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:35.221038 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:35.221038 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:35.221038 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:35.221038 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:35.221038 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:35.221038 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:35.221038 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:35.221038 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:16:35.221038 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:16:35.221038 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:16:35.222168 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:16:35.222168 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:35.222168 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:35.222168 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:35.222168 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:35.222168 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:35.222168 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:35.222168 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:35.222168 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:35.222168 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:35.222168 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:35.222168 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:35.222168 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:35.222168 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:35.222168 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:35.222168 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:35.222168 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:35.223757 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:16:35.223757 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:16:35.223757 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:35.223757 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:35.226006 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 395/807] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:16:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:35.226887 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c27a7-d408-4a85-b1e4-2a846405cdbc None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:35.254978 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b5738-751c-4dfb-87a4-0c06c1fb873c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:35.255872 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b5738-751c-4dfb-87a4-0c06c1fb873c None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:35.256253 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b5738-751c-4dfb-87a4-0c06c1fb873c None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:35.256658 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b5738-751c-4dfb-87a4-0c06c1fb873c None admin] PATH_INFO: `/v3/services/network` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:35.257404 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831b5738-751c-4dfb-87a4-0c06c1fb873c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:35.258899 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831b5738-751c-4dfb-87a4-0c06c1fb873c None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:35.269961 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-831b5738-751c-4dfb-87a4-0c06c1fb873c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 15:16:35.269961 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:35.269961 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 15:16:35.269961 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 15:16:35.269961 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 15:16:35.269961 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 15:16:35.269961 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 15:16:35.269961 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 15:16:35.269961 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 15:16:35.269961 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:35.269961 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 15:16:35.269961 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:35.269961 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:35.269961 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:35.269961 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:35.269961 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:35.269961 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:35.271174 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:35.271174 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:35.271174 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:35.271174 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:35.271174 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:35.271174 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:35.271174 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 15:16:35.271174 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 15:16:35.271174 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 15:16:35.271174 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 15:16:35.271174 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:35.271174 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:35.271174 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:35.271174 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:35.271174 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:35.271174 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:35.272105 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:35.272105 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:35.272105 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:35.272105 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:35.272105 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:35.272105 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:35.272105 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:35.272105 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:35.272105 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:35.272105 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:35.272105 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 15:16:35.272105 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 15:16:35.272105 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 15:16:35.272105 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:35.272105 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 413/808] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 2 15:16:35 2022] GET /identity/v3/services/network => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:35.272986 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b5738-751c-4dfb-87a4-0c06c1fb873c None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:35.338314 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c27a7-d408-4a85-b1e4-2a846405cdbc None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:35.371837 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7650e41a-9b45-4cf0-a009-44f716ffa715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:35.372510 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650e41a-9b45-4cf0-a009-44f716ffa715 None admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:35.372793 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650e41a-9b45-4cf0-a009-44f716ffa715 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:35.373072 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650e41a-9b45-4cf0-a009-44f716ffa715 None admin] PATH_INFO: `/v3/projects/cc19d22b4cd64dd1bc89ed78155d2732/users/6f4de590df474c8b95f2b1193f7dbcb5/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:35.375051 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7650e41a-9b45-4cf0-a009-44f716ffa715 None admin] RBAC: Authorizing `identity:create_grant(project_id=cc19d22b4cd64dd1bc89ed78155d2732, user_id=6f4de590df474c8b95f2b1193f7dbcb5, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:35.376514 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7650e41a-9b45-4cf0-a009-44f716ffa715 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:35.376831 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b5738-751c-4dfb-87a4-0c06c1fb873c None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:35.391834 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 396/809] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 2 15:16:35 2022] PUT /identity/v3/projects/cc19d22b4cd64dd1bc89ed78155d2732/users/6f4de590df474c8b95f2b1193f7dbcb5/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:16:35.393420 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fde44a-1600-4796-908e-433cf555405b None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:35.393711 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fde44a-1600-4796-908e-433cf555405b None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:35.393989 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fde44a-1600-4796-908e-433cf555405b None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:35.395858 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 397/810] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:16:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:16:35.396593 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fde44a-1600-4796-908e-433cf555405b None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:35.426675 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:35.433859 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcefccd2-879b-4766-948a-6336afa4c65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:35.434538 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcefccd2-879b-4766-948a-6336afa4c65f None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:35.434823 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcefccd2-879b-4766-948a-6336afa4c65f None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:35.435102 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcefccd2-879b-4766-948a-6336afa4c65f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:35.474554 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:35.517843 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcefccd2-879b-4766-948a-6336afa4c65f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:35.520071 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcefccd2-879b-4766-948a-6336afa4c65f None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:35.534909 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fde44a-1600-4796-908e-433cf555405b None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:35.577345 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e5942-14c4-4ad6-812a-61a6f3d37f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:35.577981 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e5942-14c4-4ad6-812a-61a6f3d37f4e None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:35.578262 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e5942-14c4-4ad6-812a-61a6f3d37f4e None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:35.578538 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e5942-14c4-4ad6-812a-61a6f3d37f4e None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:35.579238 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6e5942-14c4-4ad6-812a-61a6f3d37f4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:35.579572 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6e5942-14c4-4ad6-812a-61a6f3d37f4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:35.580952 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6e5942-14c4-4ad6-812a-61a6f3d37f4e None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:35.593292 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 398/811] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:16:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:35.594217 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e5942-14c4-4ad6-812a-61a6f3d37f4e None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:35.636509 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 414/812] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 2 15:16:35 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 15:16:35.637851 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff0a042-e77b-4357-8a16-293fd3b44b5e None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:35.638140 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff0a042-e77b-4357-8a16-293fd3b44b5e None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:35.638412 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff0a042-e77b-4357-8a16-293fd3b44b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:35.658393 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-1ff0a042-e77b-4357-8a16-293fd3b44b5e None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:16:35.659613 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-1ff0a042-e77b-4357-8a16-293fd3b44b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:16:35.690369 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:35.709279 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e5942-14c4-4ad6-812a-61a6f3d37f4e None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:35.731341 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:35.743397 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 415/813] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:16:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 15:16:35.743397 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff0a042-e77b-4357-8a16-293fd3b44b5e None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:35.750862 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c705c975-5324-4133-a898-ed89cd8a383b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:35.751551 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c705c975-5324-4133-a898-ed89cd8a383b None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:35.751842 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c705c975-5324-4133-a898-ed89cd8a383b None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:35.752123 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c705c975-5324-4133-a898-ed89cd8a383b None admin] PATH_INFO: `/v3/services` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:35.752938 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c705c975-5324-4133-a898-ed89cd8a383b None admin] RBAC: Adding query filter params (name=network) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:35.753248 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c705c975-5324-4133-a898-ed89cd8a383b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:35.754673 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c705c975-5324-4133-a898-ed89cd8a383b None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:35.760154 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 399/814] 10.222.0.42 () {56 vars in 1112 bytes} [Tue Aug 2 15:16:35 2022] GET /identity/v3/services?name=network => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:35.761057 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c705c975-5324-4133-a898-ed89cd8a383b None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:35.862068 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff0a042-e77b-4357-8a16-293fd3b44b5e None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:35.892592 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c705c975-5324-4133-a898-ed89cd8a383b None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:35.904846 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80415626-19d6-4caf-88ec-ed5d356f1315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:35.905500 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80415626-19d6-4caf-88ec-ed5d356f1315 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:35.905783 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80415626-19d6-4caf-88ec-ed5d356f1315 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:35.906065 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80415626-19d6-4caf-88ec-ed5d356f1315 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:35.918825 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80415626-19d6-4caf-88ec-ed5d356f1315 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:35.920350 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80415626-19d6-4caf-88ec-ed5d356f1315 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:35.932741 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-80415626-19d6-4caf-88ec-ed5d356f1315 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 15:16:35.932741 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:35.932741 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:35.932741 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:35.932741 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:35.932741 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:35.932741 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:35.932741 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:35.932741 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:35.932741 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:35.932741 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:35.932741 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:35.932741 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 15:16:35.932741 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 15:16:35.932741 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 15:16:35.932741 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 15:16:35.933916 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:35.933916 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:35.933916 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 15:16:35.933916 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:16:35.933916 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 15:16:35.933916 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:16:35.933916 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:35.933916 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:35.933916 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:35.933916 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:35.933916 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:35.933916 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:35.933916 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:35.933916 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:35.933916 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:35.933916 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:35.933916 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:35.933916 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:35.935247 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:35.935247 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:35.935247 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 15:16:35.935247 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 15:16:35.935247 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 15:16:35.935247 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 15:16:35.935247 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 15:16:35.935247 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 15:16:35.935247 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 15:16:35.935247 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:35.935247 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 416/815] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Aug 2 15:16:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:35.935247 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80415626-19d6-4caf-88ec-ed5d356f1315 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:35.939321 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7005a8e9-8b36-4f27-a9b0-5c1c756ad595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:35.940377 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005a8e9-8b36-4f27-a9b0-5c1c756ad595 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:35.940377 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005a8e9-8b36-4f27-a9b0-5c1c756ad595 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:35.940544 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005a8e9-8b36-4f27-a9b0-5c1c756ad595 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:35.952584 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7005a8e9-8b36-4f27-a9b0-5c1c756ad595 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:35.953962 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7005a8e9-8b36-4f27-a9b0-5c1c756ad595 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:35.962122 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:35.972704 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-7005a8e9-8b36-4f27-a9b0-5c1c756ad595 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:35.972704 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:35.972704 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:35.972704 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:35.972704 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:35.972704 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:35.972704 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:35.972704 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:35.972704 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:35.972704 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:35.972704 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:35.972704 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:35.972704 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:16:35.972704 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:16:35.972704 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:16:35.973758 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:16:35.973758 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:35.973758 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:35.973758 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:35.973758 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:35.973758 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:35.973758 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:35.973758 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:35.973758 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:35.973758 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:35.973758 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:35.973758 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:35.973758 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:35.973758 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:35.973758 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:35.973758 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:35.973758 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:35.974664 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:16:35.974664 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:16:35.974664 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:35.974664 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:35.974664 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 400/816] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:16:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:35.974944 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7005a8e9-8b36-4f27-a9b0-5c1c756ad595 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:36.015579 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:36.052921 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80415626-19d6-4caf-88ec-ed5d356f1315 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:36.089777 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2600db4-369f-4868-a5f5-cfbc062c9577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:36.090198 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7005a8e9-8b36-4f27-a9b0-5c1c756ad595 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:36.090403 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2600db4-369f-4868-a5f5-cfbc062c9577 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:36.090673 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2600db4-369f-4868-a5f5-cfbc062c9577 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:36.090951 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2600db4-369f-4868-a5f5-cfbc062c9577 None admin] PATH_INFO: `/v3/services` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:36.091782 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2600db4-369f-4868-a5f5-cfbc062c9577 None admin] RBAC: Adding query filter params (type=network) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:36.092093 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2600db4-369f-4868-a5f5-cfbc062c9577 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:36.093631 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2600db4-369f-4868-a5f5-cfbc062c9577 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:36.104086 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 417/817] 10.222.0.42 () {56 vars in 1112 bytes} [Tue Aug 2 15:16:35 2022] GET /identity/v3/services?type=network => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:36.104086 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2600db4-369f-4868-a5f5-cfbc062c9577 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:36.131358 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbe7cd5-2229-44e5-96d7-041a75b03949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:36.132010 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe7cd5-2229-44e5-96d7-041a75b03949 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:36.132295 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe7cd5-2229-44e5-96d7-041a75b03949 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:36.132572 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe7cd5-2229-44e5-96d7-041a75b03949 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:36.133194 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbe7cd5-2229-44e5-96d7-041a75b03949 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:36.134571 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbe7cd5-2229-44e5-96d7-041a75b03949 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:36.144797 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-6dbe7cd5-2229-44e5-96d7-041a75b03949 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 15:16:36.144797 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:36.144797 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 15:16:36.144797 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 15:16:36.144797 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 15:16:36.144797 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 15:16:36.144797 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 15:16:36.144797 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 15:16:36.144797 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 15:16:36.144797 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:36.144797 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 15:16:36.144797 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:36.144797 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:36.144797 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:36.144797 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:36.144797 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:36.145790 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:36.145790 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:36.145790 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:36.145790 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:36.145790 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:36.145790 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:36.145790 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:36.145790 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 15:16:36.145790 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 15:16:36.145790 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 15:16:36.145790 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 15:16:36.145790 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:36.145790 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:36.145790 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:36.145790 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:36.145790 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:36.146620 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:36.146620 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:36.146620 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:36.146620 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:36.146620 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:36.146620 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:36.146620 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:36.146620 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:36.146620 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:36.146620 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:36.146620 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:36.146620 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 15:16:36.146620 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 15:16:36.146620 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 15:16:36.146620 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:36.146620 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 401/818] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Aug 2 15:16:35 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:36.147488 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbe7cd5-2229-44e5-96d7-041a75b03949 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:36.215247 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:36.232905 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2600db4-369f-4868-a5f5-cfbc062c9577 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:36.260373 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:36.264000 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbe7cd5-2229-44e5-96d7-041a75b03949 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:36.269166 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344a34c-a69a-47a1-9b34-8c57fc792d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:36.270234 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344a34c-a69a-47a1-9b34-8c57fc792d7d None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:36.270517 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344a34c-a69a-47a1-9b34-8c57fc792d7d None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:36.270794 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344a34c-a69a-47a1-9b34-8c57fc792d7d None admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:36.271700 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3344a34c-a69a-47a1-9b34-8c57fc792d7d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:36.272019 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3344a34c-a69a-47a1-9b34-8c57fc792d7d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:36.273496 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3344a34c-a69a-47a1-9b34-8c57fc792d7d None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:36.297686 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 418/819] 10.222.0.42 () {56 vars in 1149 bytes} [Tue Aug 2 15:16:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:36.297686 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344a34c-a69a-47a1-9b34-8c57fc792d7d None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:36.307843 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39027f66-bdcf-44bc-9b4a-5c32e319a34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:36.308470 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39027f66-bdcf-44bc-9b4a-5c32e319a34f None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:36.308759 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39027f66-bdcf-44bc-9b4a-5c32e319a34f None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:36.309030 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39027f66-bdcf-44bc-9b4a-5c32e319a34f None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:36.309706 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39027f66-bdcf-44bc-9b4a-5c32e319a34f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:36.310013 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39027f66-bdcf-44bc-9b4a-5c32e319a34f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:36.311416 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39027f66-bdcf-44bc-9b4a-5c32e319a34f None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:36.325815 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 402/820] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:16:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:36.326585 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39027f66-bdcf-44bc-9b4a-5c32e319a34f None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:36.416823 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344a34c-a69a-47a1-9b34-8c57fc792d7d None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:36.435843 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39027f66-bdcf-44bc-9b4a-5c32e319a34f None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:36.454190 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2afc59e-89a8-4ccb-86ca-df41412f3bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:36.454987 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2afc59e-89a8-4ccb-86ca-df41412f3bbc None admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:36.455398 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2afc59e-89a8-4ccb-86ca-df41412f3bbc None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:36.455772 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2afc59e-89a8-4ccb-86ca-df41412f3bbc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:36.456580 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2afc59e-89a8-4ccb-86ca-df41412f3bbc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:36.458600 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2afc59e-89a8-4ccb-86ca-df41412f3bbc None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:36.473906 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e7175d-d192-435f-b5f5-ae868918fbd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:36.474710 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e7175d-d192-435f-b5f5-ae868918fbd2 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:36.475304 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e7175d-d192-435f-b5f5-ae868918fbd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:36.475380 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e7175d-d192-435f-b5f5-ae868918fbd2 None admin] PATH_INFO: `/v3/services` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:36.476114 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e7175d-d192-435f-b5f5-ae868918fbd2 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:36.476478 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e7175d-d192-435f-b5f5-ae868918fbd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:36.478077 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e7175d-d192-435f-b5f5-ae868918fbd2 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:36.479412 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:36.487244 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 419/821] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:16:36 2022] POST /identity/v3/endpoints => generated 337 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:16:36.487244 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2afc59e-89a8-4ccb-86ca-df41412f3bbc None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:36.493190 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 403/822] 10.222.0.42 () {56 vars in 1124 bytes} [Tue Aug 2 15:16:36 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:36.494229 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e7175d-d192-435f-b5f5-ae868918fbd2 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:36.539929 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:36.632447 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e7175d-d192-435f-b5f5-ae868918fbd2 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:36.653624 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2afc59e-89a8-4ccb-86ca-df41412f3bbc None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:36.675766 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db9e04a-7703-40fd-94f6-b22f16cca51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:36.677547 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9e04a-7703-40fd-94f6-b22f16cca51a None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:36.678047 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9e04a-7703-40fd-94f6-b22f16cca51a None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:36.678524 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9e04a-7703-40fd-94f6-b22f16cca51a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:36.686223 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db9e04a-7703-40fd-94f6-b22f16cca51a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:36.687986 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db9e04a-7703-40fd-94f6-b22f16cca51a None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:36.696806 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca802386-6e19-49c3-9d73-8c021eb44043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:36.697795 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca802386-6e19-49c3-9d73-8c021eb44043 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:36.698306 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca802386-6e19-49c3-9d73-8c021eb44043 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:36.698776 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca802386-6e19-49c3-9d73-8c021eb44043 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:36.702313 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-0db9e04a-7703-40fd-94f6-b22f16cca51a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:16:36.702313 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:36.702313 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:36.702313 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:36.702313 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:36.702313 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:36.702313 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:36.702313 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:36.702313 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:36.702313 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:36.702313 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:36.702313 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:36.702313 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 15:16:36.702313 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 15:16:36.702313 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 15:16:36.703201 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 15:16:36.703201 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:36.703201 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:36.703201 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:36.703201 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:36.703201 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:36.703201 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:36.703201 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:36.703201 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:36.703201 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:36.703201 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:36.703201 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:36.703201 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:36.703201 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:36.703201 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:36.703201 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:36.703201 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:36.704294 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 15:16:36.704294 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 15:16:36.704294 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 15:16:36.704294 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 15:16:36.704294 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 15:16:36.704294 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 15:16:36.704294 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:16:36.704294 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:36.704294 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 404/823] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 2 15:16:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:36.704294 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db9e04a-7703-40fd-94f6-b22f16cca51a None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:36.714941 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca802386-6e19-49c3-9d73-8c021eb44043 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:36.716791 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca802386-6e19-49c3-9d73-8c021eb44043 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:36.732428 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-ca802386-6e19-49c3-9d73-8c021eb44043 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:36.732428 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:36.732428 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:36.732428 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:36.732428 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:36.732428 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:36.732428 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:36.732428 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:36.732428 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:36.732428 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:36.732428 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:36.732428 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:36.732428 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:16:36.732428 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:16:36.732428 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:16:36.733551 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:16:36.733551 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:36.733551 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:36.733551 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:36.733551 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:36.733551 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:36.733551 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:36.733551 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:36.733551 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:36.733551 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:36.733551 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:36.733551 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:36.733551 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:36.733551 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:36.733551 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:36.733551 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:36.733551 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:36.734602 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:16:36.734602 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:16:36.734602 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:36.734602 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:36.736262 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 420/824] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:16:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:36.737273 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca802386-6e19-49c3-9d73-8c021eb44043 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:36.799759 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:36.816006 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:36.835631 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db9e04a-7703-40fd-94f6-b22f16cca51a None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:36.867061 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca802386-6e19-49c3-9d73-8c021eb44043 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:36.880549 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a89923-47ba-4f41-b8a0-4dd7e882ce83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:36.881207 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a89923-47ba-4f41-b8a0-4dd7e882ce83 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:36.881487 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a89923-47ba-4f41-b8a0-4dd7e882ce83 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:36.881746 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a89923-47ba-4f41-b8a0-4dd7e882ce83 None admin] PATH_INFO: `/v3/services` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:36.882556 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a89923-47ba-4f41-b8a0-4dd7e882ce83 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:36.882863 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a89923-47ba-4f41-b8a0-4dd7e882ce83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:36.884696 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a89923-47ba-4f41-b8a0-4dd7e882ce83 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:36.895062 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 405/825] 10.222.0.42 () {56 vars in 1124 bytes} [Tue Aug 2 15:16:36 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:36.895923 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a89923-47ba-4f41-b8a0-4dd7e882ce83 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:36.907524 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf50973-c8bd-4b23-84d5-0301d1235ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:36.908160 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf50973-c8bd-4b23-84d5-0301d1235ddc None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:36.908441 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf50973-c8bd-4b23-84d5-0301d1235ddc None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:36.908723 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf50973-c8bd-4b23-84d5-0301d1235ddc None admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:36.909485 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf50973-c8bd-4b23-84d5-0301d1235ddc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:36.909798 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf50973-c8bd-4b23-84d5-0301d1235ddc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:36.911854 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf50973-c8bd-4b23-84d5-0301d1235ddc None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:36.935635 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 421/826] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 2 15:16:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:36.935635 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf50973-c8bd-4b23-84d5-0301d1235ddc None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:37.034873 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a89923-47ba-4f41-b8a0-4dd7e882ce83 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:37.041765 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf50973-c8bd-4b23-84d5-0301d1235ddc None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:37.052407 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:37.073903 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde395f6-ad0c-491c-b789-d2ee4922c95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:37.074781 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde395f6-ad0c-491c-b789-d2ee4922c95b None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:37.075056 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde395f6-ad0c-491c-b789-d2ee4922c95b None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:37.075763 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde395f6-ad0c-491c-b789-d2ee4922c95b None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:37.076788 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde395f6-ad0c-491c-b789-d2ee4922c95b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:37.077170 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde395f6-ad0c-491c-b789-d2ee4922c95b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:37.078556 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde395f6-ad0c-491c-b789-d2ee4922c95b None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:37.080323 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b99896a-5549-4304-9d73-73dcb4f78323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:37.080951 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99896a-5549-4304-9d73-73dcb4f78323 None admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:37.081236 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99896a-5549-4304-9d73-73dcb4f78323 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:37.081513 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99896a-5549-4304-9d73-73dcb4f78323 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:37.082752 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b99896a-5549-4304-9d73-73dcb4f78323 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:37.084190 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b99896a-5549-4304-9d73-73dcb4f78323 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:37.095555 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 406/827] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:16:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:37.096858 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde395f6-ad0c-491c-b789-d2ee4922c95b None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:37.107367 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 422/828] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:16:36 2022] POST /identity/v3/endpoints => generated 346 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:16:37.108499 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b99896a-5549-4304-9d73-73dcb4f78323 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:37.118947 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:37.257359 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde395f6-ad0c-491c-b789-d2ee4922c95b None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:37.279833 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b99896a-5549-4304-9d73-73dcb4f78323 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:37.315012 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa57ada2-6d78-4879-92ec-8a21904eb077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:37.316198 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57ada2-6d78-4879-92ec-8a21904eb077 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:37.316738 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57ada2-6d78-4879-92ec-8a21904eb077 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:37.317206 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57ada2-6d78-4879-92ec-8a21904eb077 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:37.318209 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa57ada2-6d78-4879-92ec-8a21904eb077 None admin] RBAC: Adding query filter params (role.id=d75c9572cb294caeb8eb456521ff6f57, scope.project.id=cc19d22b4cd64dd1bc89ed78155d2732, user.id=4c0865af59bf43dfa4c84213d7db53c5) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:37.318741 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa57ada2-6d78-4879-92ec-8a21904eb077 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:37.320489 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa57ada2-6d78-4879-92ec-8a21904eb077 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:37.332028 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 407/829] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 2 15:16:37 2022] GET /identity/v3/role_assignments?user.id=4c0865af59bf43dfa4c84213d7db53c5&scope.project.id=cc19d22b4cd64dd1bc89ed78155d2732&role.id=d75c9572cb294caeb8eb456521ff6f57 => generated 608 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:37.352186 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87b7328-c0d2-4457-8ffa-45bf9766b660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:37.353290 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b7328-c0d2-4457-8ffa-45bf9766b660 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:37.353781 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b7328-c0d2-4457-8ffa-45bf9766b660 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:37.354270 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b7328-c0d2-4457-8ffa-45bf9766b660 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:37.364394 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87b7328-c0d2-4457-8ffa-45bf9766b660 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:37.366228 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87b7328-c0d2-4457-8ffa-45bf9766b660 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:37.380375 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-e87b7328-c0d2-4457-8ffa-45bf9766b660 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:16:37.380375 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:37.380375 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:37.380375 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:37.380375 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:37.380375 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:37.380375 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:37.380375 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:37.380375 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:37.380375 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:37.380375 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:37.380375 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:37.380375 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 15:16:37.380375 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 15:16:37.380375 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 15:16:37.381604 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 15:16:37.381604 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:37.381604 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:37.381604 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:37.381604 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:37.381604 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:37.381604 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:37.381604 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:37.381604 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:37.381604 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:37.381604 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:37.381604 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:37.381604 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:37.381604 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:37.381604 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:37.381604 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:37.381604 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:37.382608 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 15:16:37.382608 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 15:16:37.382608 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 15:16:37.382608 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 15:16:37.382608 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 15:16:37.382608 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 15:16:37.382608 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:16:37.382608 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:37.383916 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 423/830] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 2 15:16:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:37.390113 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa57ada2-6d78-4879-92ec-8a21904eb077 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:37.477164 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24537ea3-b552-4e64-ab25-7804b6e0c6c8 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:37.477441 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24537ea3-b552-4e64-ab25-7804b6e0c6c8 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:37.477720 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24537ea3-b552-4e64-ab25-7804b6e0c6c8 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:37.483253 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 424/831] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:16:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:16:37.485100 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dcbe04-38e9-4091-8cfd-31ee4d64df2f None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:37.485392 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dcbe04-38e9-4091-8cfd-31ee4d64df2f None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:37.485667 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dcbe04-38e9-4091-8cfd-31ee4d64df2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:37.492391 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:37.516399 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-19dcbe04-38e9-4091-8cfd-31ee4d64df2f None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:16:37.517803 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-19dcbe04-38e9-4091-8cfd-31ee4d64df2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:16:37.533889 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa57ada2-6d78-4879-92ec-8a21904eb077 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:37.538526 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:37.588073 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee9dfc2-5794-4fb5-ac15-efbc7ac6f599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:37.588784 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9dfc2-5794-4fb5-ac15-efbc7ac6f599 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:37.589073 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9dfc2-5794-4fb5-ac15-efbc7ac6f599 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:37.589349 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9dfc2-5794-4fb5-ac15-efbc7ac6f599 None admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:37.590104 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee9dfc2-5794-4fb5-ac15-efbc7ac6f599 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:37.590417 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee9dfc2-5794-4fb5-ac15-efbc7ac6f599 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:37.591905 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee9dfc2-5794-4fb5-ac15-efbc7ac6f599 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:37.607252 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 408/832] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 2 15:16:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:37.615110 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee9dfc2-5794-4fb5-ac15-efbc7ac6f599 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:37.623782 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 425/833] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:16:37 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 15:16:37.652533 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dcbe04-38e9-4091-8cfd-31ee4d64df2f None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:37.758373 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee9dfc2-5794-4fb5-ac15-efbc7ac6f599 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:37.762984 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dcbe04-38e9-4091-8cfd-31ee4d64df2f None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:37.800663 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:37.806149 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be631c9-cbeb-4934-b5f9-5a8d6e38c0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:37.807185 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be631c9-cbeb-4934-b5f9-5a8d6e38c0ec None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:37.807643 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be631c9-cbeb-4934-b5f9-5a8d6e38c0ec None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:37.808036 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c518043-db1c-49d7-ac46-79e432ccc13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:37.808247 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be631c9-cbeb-4934-b5f9-5a8d6e38c0ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:37.808947 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c518043-db1c-49d7-ac46-79e432ccc13c None admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:37.809296 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c518043-db1c-49d7-ac46-79e432ccc13c None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:37.809661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c518043-db1c-49d7-ac46-79e432ccc13c None admin] PATH_INFO: `/v3/projects/cc19d22b4cd64dd1bc89ed78155d2732/users/dfe8c00c0c3d4c4b8b6f36e39a3a2e71/roles/532162a00de849cea5c27767c8acd018` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:37.823622 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be631c9-cbeb-4934-b5f9-5a8d6e38c0ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:16:37.829131 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-6be631c9-cbeb-4934-b5f9-5a8d6e38c0ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 15:16:37.829131 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:37.829131 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:37.829131 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:37.829131 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:37.829131 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:37.829131 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:37.829131 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:37.829131 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:37.829131 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:37.829131 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:37.829131 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:37.829131 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:16:37.829131 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:16:37.829131 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:16:37.829131 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:16:37.830134 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:16:37.830134 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:16:37.830134 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:16:37.830134 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:16:37.830134 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:37.830134 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:37.830134 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:37.830134 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:37.830134 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:37.830134 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:37.830134 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:37.830134 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:37.830134 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:37.830134 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:37.830134 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:37.830134 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:37.830983 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:37.830983 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:37.830983 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:37.830983 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:37.830983 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:16:37.830983 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:16:37.830983 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:16:37.830983 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:16:37.830983 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:16:37.830983 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:16:37.830983 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 15:16:37.830983 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:37.839044 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c518043-db1c-49d7-ac46-79e432ccc13c None admin] RBAC: Authorizing `identity:create_grant(project_id=cc19d22b4cd64dd1bc89ed78155d2732, user_id=dfe8c00c0c3d4c4b8b6f36e39a3a2e71, role_id=532162a00de849cea5c27767c8acd018)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:37.839354 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 426/834] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 2 15:16:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:37.839924 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c518043-db1c-49d7-ac46-79e432ccc13c None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:37.840682 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be631c9-cbeb-4934-b5f9-5a8d6e38c0ec None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:37.856097 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:37.863328 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 409/835] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 2 15:16:37 2022] PUT /identity/v3/projects/cc19d22b4cd64dd1bc89ed78155d2732/users/dfe8c00c0c3d4c4b8b6f36e39a3a2e71/roles/532162a00de849cea5c27767c8acd018 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 15:16:37.968076 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be631c9-cbeb-4934-b5f9-5a8d6e38c0ec None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:38.007955 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14b474f-900e-4bb3-aa3a-0e431555bf74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:38.008943 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b474f-900e-4bb3-aa3a-0e431555bf74 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:38.009400 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b474f-900e-4bb3-aa3a-0e431555bf74 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:38.009878 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b474f-900e-4bb3-aa3a-0e431555bf74 None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:38.010861 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14b474f-900e-4bb3-aa3a-0e431555bf74 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:38.011382 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14b474f-900e-4bb3-aa3a-0e431555bf74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:38.013057 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14b474f-900e-4bb3-aa3a-0e431555bf74 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:38.025983 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 427/836] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 2 15:16:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:38.032219 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c518043-db1c-49d7-ac46-79e432ccc13c None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:38.146741 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c518043-db1c-49d7-ac46-79e432ccc13c None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:38.185580 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab7b6e8-2894-44ef-af28-885c584cd19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:38.186472 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7b6e8-2894-44ef-af28-885c584cd19c None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:38.186931 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7b6e8-2894-44ef-af28-885c584cd19c None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:38.187386 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7b6e8-2894-44ef-af28-885c584cd19c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:38.198856 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab7b6e8-2894-44ef-af28-885c584cd19c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:38.200587 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab7b6e8-2894-44ef-af28-885c584cd19c None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:38.216648 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-dab7b6e8-2894-44ef-af28-885c584cd19c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:38.216648 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:38.216648 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:38.216648 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:38.216648 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:38.216648 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:38.216648 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:38.216648 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:38.216648 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:38.216648 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:38.216648 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:38.216648 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:38.216648 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:16:38.216648 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:16:38.216648 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:16:38.217761 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:16:38.217761 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:38.217761 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:38.217761 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:38.217761 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:38.217761 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:38.217761 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:38.217761 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:38.217761 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:38.217761 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:38.217761 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:38.217761 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:38.217761 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:38.217761 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:38.217761 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:38.217761 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:38.217761 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:38.218851 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:16:38.218851 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:16:38.218851 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:38.218851 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:38.220825 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 410/837] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:16:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:38.226765 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14b474f-900e-4bb3-aa3a-0e431555bf74 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:38.304787 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:38.339054 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14b474f-900e-4bb3-aa3a-0e431555bf74 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:38.374419 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbcc791-70de-430b-88e6-0a6a88423baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:38.375508 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbcc791-70de-430b-88e6-0a6a88423baf None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:38.375988 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbcc791-70de-430b-88e6-0a6a88423baf None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:38.376488 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbcc791-70de-430b-88e6-0a6a88423baf None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:38.377451 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbcc791-70de-430b-88e6-0a6a88423baf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:38.377954 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbcc791-70de-430b-88e6-0a6a88423baf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:38.380102 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbcc791-70de-430b-88e6-0a6a88423baf None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:38.395817 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 428/838] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:16:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:38.401672 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab7b6e8-2894-44ef-af28-885c584cd19c None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:38.438948 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:38.509414 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab7b6e8-2894-44ef-af28-885c584cd19c None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:38.544523 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec8375-508e-494b-87c3-4621fbdef9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:38.545622 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec8375-508e-494b-87c3-4621fbdef9d7 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:38.546144 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec8375-508e-494b-87c3-4621fbdef9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:38.546636 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec8375-508e-494b-87c3-4621fbdef9d7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:38.555262 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ec8375-508e-494b-87c3-4621fbdef9d7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:38.557075 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ec8375-508e-494b-87c3-4621fbdef9d7 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:38.571079 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-a8ec8375-508e-494b-87c3-4621fbdef9d7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 02 15:16:38.571079 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:38.571079 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:38.571079 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:38.571079 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:38.571079 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:38.571079 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:38.571079 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:38.571079 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:38.571079 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:38.571079 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:38.571079 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:38.571079 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 15:16:38.571079 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 15:16:38.571079 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 15:16:38.571079 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 15:16:38.572097 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:38.572097 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:38.572097 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 15:16:38.572097 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:16:38.572097 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 15:16:38.572097 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:16:38.572097 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:38.572097 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:38.572097 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:38.572097 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:38.572097 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:38.572097 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:38.572097 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:38.572097 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:38.572097 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:38.572097 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:38.572097 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:38.572097 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:38.573039 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:38.573039 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:38.573039 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 15:16:38.573039 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 15:16:38.573039 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 15:16:38.573039 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 15:16:38.573039 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 15:16:38.573039 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 15:16:38.573039 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 02 15:16:38.573039 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:38.573553 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 411/839] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 2 15:16:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:38.579875 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbcc791-70de-430b-88e6-0a6a88423baf None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:38.687991 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbcc791-70de-430b-88e6-0a6a88423baf None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:38.721221 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:38.726071 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c62afe-5927-40f9-880b-3c98b4710098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:38.726686 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c62afe-5927-40f9-880b-3c98b4710098 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:38.726957 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c62afe-5927-40f9-880b-3c98b4710098 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:38.727315 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c62afe-5927-40f9-880b-3c98b4710098 None admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:38.728109 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c62afe-5927-40f9-880b-3c98b4710098 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:38.728412 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c62afe-5927-40f9-880b-3c98b4710098 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:38.729843 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c62afe-5927-40f9-880b-3c98b4710098 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:38.749717 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 429/840] 10.222.0.42 () {56 vars in 1135 bytes} [Tue Aug 2 15:16:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:38.755288 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec8375-508e-494b-87c3-4621fbdef9d7 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:38.856434 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:38.863926 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec8375-508e-494b-87c3-4621fbdef9d7 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:38.898470 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d283625-5ee9-4f0c-9ca9-29f82d0bdf15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:38.899099 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d283625-5ee9-4f0c-9ca9-29f82d0bdf15 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:38.899464 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d283625-5ee9-4f0c-9ca9-29f82d0bdf15 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:38.899745 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d283625-5ee9-4f0c-9ca9-29f82d0bdf15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:38.973607 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d283625-5ee9-4f0c-9ca9-29f82d0bdf15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:38.974988 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d283625-5ee9-4f0c-9ca9-29f82d0bdf15 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:39.083569 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:39.087328 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 412/841] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 2 15:16:38 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 02 15:16:39.092333 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c62afe-5927-40f9-880b-3c98b4710098 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:39.237924 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c62afe-5927-40f9-880b-3c98b4710098 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:39.276340 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0028ceb6-1416-4571-9ffa-1a43d51a22a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:39.276997 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028ceb6-1416-4571-9ffa-1a43d51a22a1 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:39.277280 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028ceb6-1416-4571-9ffa-1a43d51a22a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:39.277559 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028ceb6-1416-4571-9ffa-1a43d51a22a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:39.289184 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0028ceb6-1416-4571-9ffa-1a43d51a22a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:39.290661 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0028ceb6-1416-4571-9ffa-1a43d51a22a1 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:39.306366 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-0028ceb6-1416-4571-9ffa-1a43d51a22a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:39.306366 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:39.306366 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:39.306366 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:39.306366 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:39.306366 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:39.306366 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:39.306366 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:39.306366 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:39.306366 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:39.306366 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:39.306366 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:39.306366 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:16:39.306366 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:16:39.306366 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:16:39.307346 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:16:39.307346 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:39.307346 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:39.307346 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:39.307346 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:39.307346 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:39.307346 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:39.307346 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:39.307346 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:39.307346 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:39.307346 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:39.307346 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:39.307346 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:39.307346 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:39.307346 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:39.307346 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:39.307346 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:39.308241 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:16:39.308241 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:16:39.308241 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:39.308241 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:39.308241 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 430/842] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:16:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:39.313485 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d283625-5ee9-4f0c-9ca9-29f82d0bdf15 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:39.372668 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a683907-d158-431f-bbe0-4f4006594013 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:39.372986 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a683907-d158-431f-bbe0-4f4006594013 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:39.373235 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a683907-d158-431f-bbe0-4f4006594013 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:39.374883 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 431/843] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:16:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 15:16:39.382189 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480af9ed-945f-4801-8e21-82e62e56ef99 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:39.382481 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480af9ed-945f-4801-8e21-82e62e56ef99 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:39.382762 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480af9ed-945f-4801-8e21-82e62e56ef99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:39.400834 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-480af9ed-945f-4801-8e21-82e62e56ef99 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:16:39.402071 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-480af9ed-945f-4801-8e21-82e62e56ef99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:16:39.421866 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d283625-5ee9-4f0c-9ca9-29f82d0bdf15 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:39.441042 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:39.468673 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6688c3-dee2-4191-887f-752accf38742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:39.469776 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6688c3-dee2-4191-887f-752accf38742 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:39.470638 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6688c3-dee2-4191-887f-752accf38742 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:39.471063 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6688c3-dee2-4191-887f-752accf38742 None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:39.472184 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6688c3-dee2-4191-887f-752accf38742 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:39.472925 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6688c3-dee2-4191-887f-752accf38742 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:39.475199 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6688c3-dee2-4191-887f-752accf38742 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:39.481907 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 432/844] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:16:39 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 15:16:39.493162 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 413/845] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:16:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:39.498858 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480af9ed-945f-4801-8e21-82e62e56ef99 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:39.505566 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6688c3-dee2-4191-887f-752accf38742 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:39.577219 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:39.619095 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480af9ed-945f-4801-8e21-82e62e56ef99 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:39.632501 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6688c3-dee2-4191-887f-752accf38742 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:39.654949 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b1b5b2-60b8-40cf-b0d5-ff957b1d30d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:39.655770 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1b5b2-60b8-40cf-b0d5-ff957b1d30d0 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:39.656056 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1b5b2-60b8-40cf-b0d5-ff957b1d30d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:39.656448 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1b5b2-60b8-40cf-b0d5-ff957b1d30d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:39.664604 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b1b5b2-60b8-40cf-b0d5-ff957b1d30d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:39.666160 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b1b5b2-60b8-40cf-b0d5-ff957b1d30d0 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:39.667876 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e570ce4-f750-4942-baad-d4d0a285d5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:39.668529 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e570ce4-f750-4942-baad-d4d0a285d5a7 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:39.668804 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e570ce4-f750-4942-baad-d4d0a285d5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:39.669075 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e570ce4-f750-4942-baad-d4d0a285d5a7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:39.669696 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e570ce4-f750-4942-baad-d4d0a285d5a7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:39.671032 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e570ce4-f750-4942-baad-d4d0a285d5a7 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:39.681010 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-b4b1b5b2-60b8-40cf-b0d5-ff957b1d30d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:16:39.681010 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:39.681010 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:39.681010 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:39.681010 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:39.681010 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:39.681010 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:39.681010 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:39.681010 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:39.681010 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:39.681010 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:39.681010 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:39.681010 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 15:16:39.681010 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 15:16:39.681010 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 15:16:39.681915 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 15:16:39.681915 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:39.681915 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:39.681915 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:39.681915 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:39.681915 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:39.681915 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:39.681915 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:39.681915 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:39.681915 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:39.681915 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:39.681915 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:39.681915 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:39.681915 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:39.681915 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:39.681915 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:39.681915 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:39.682799 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 15:16:39.682799 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 15:16:39.682799 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 15:16:39.682799 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 15:16:39.682799 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 15:16:39.682799 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 15:16:39.682799 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:16:39.682799 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:39.683277 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-8e570ce4-f750-4942-baad-d4d0a285d5a7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 15:16:39.683277 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:39.683277 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 15:16:39.683277 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 15:16:39.683277 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 15:16:39.683277 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 15:16:39.683277 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 15:16:39.683277 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 15:16:39.683277 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 15:16:39.683277 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:39.683277 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 15:16:39.683277 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:39.683277 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:39.683277 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:39.683277 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:39.683277 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:39.683277 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:39.684186 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:39.684186 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:39.684186 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:39.684186 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:39.684186 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:39.684186 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:39.684186 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 15:16:39.684186 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 15:16:39.684186 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 15:16:39.684186 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 15:16:39.684186 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:39.684186 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:39.684186 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:39.684186 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:39.684186 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:39.684186 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:39.685012 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:39.685012 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:39.685012 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:39.685012 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:39.685012 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:39.685012 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:39.685012 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:39.685012 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:39.685012 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:39.685012 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:39.685012 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 15:16:39.685012 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 15:16:39.685012 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 15:16:39.685012 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:39.685012 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 414/846] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Aug 2 15:16:39 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 15:16:39.685791 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7e7ae-2c8d-49c9-9f80-88483479c423 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:39.685791 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7e7ae-2c8d-49c9-9f80-88483479c423 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:39.685791 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7e7ae-2c8d-49c9-9f80-88483479c423 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:39.685791 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 415/847] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:16:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:16:39.688479 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7e7ae-2c8d-49c9-9f80-88483479c423 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:39.688977 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 433/848] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 2 15:16:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:39.692754 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa7e26-f7fe-4ea4-b715-8867a78a141a None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:39.693260 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa7e26-f7fe-4ea4-b715-8867a78a141a None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:39.693719 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa7e26-f7fe-4ea4-b715-8867a78a141a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:39.714200 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-31fa7e26-f7fe-4ea4-b715-8867a78a141a None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:16:39.715456 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-31fa7e26-f7fe-4ea4-b715-8867a78a141a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:16:39.746827 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:39.795256 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 434/849] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:16:39 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 15:16:39.796529 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa7e26-f7fe-4ea4-b715-8867a78a141a None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:39.808641 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7e7ae-2c8d-49c9-9f80-88483479c423 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:39.831534 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:39.850027 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d584acde-f935-491a-b8b4-65d6fcb82471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:39.850813 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584acde-f935-491a-b8b4-65d6fcb82471 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:39.851225 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584acde-f935-491a-b8b4-65d6fcb82471 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:39.851621 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584acde-f935-491a-b8b4-65d6fcb82471 None admin] PATH_INFO: `/v3/services` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:39.852307 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d584acde-f935-491a-b8b4-65d6fcb82471 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:39.852618 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d584acde-f935-491a-b8b4-65d6fcb82471 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:39.853988 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d584acde-f935-491a-b8b4-65d6fcb82471 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:39.858856 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 416/850] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Aug 2 15:16:39 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:16:39.859605 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d584acde-f935-491a-b8b4-65d6fcb82471 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:39.924256 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa7e26-f7fe-4ea4-b715-8867a78a141a None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:39.966932 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d009902f-f962-4e86-94e5-e45e635565c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:39.967589 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009902f-f962-4e86-94e5-e45e635565c2 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:39.967873 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009902f-f962-4e86-94e5-e45e635565c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:39.968150 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009902f-f962-4e86-94e5-e45e635565c2 None admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:39.968913 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d009902f-f962-4e86-94e5-e45e635565c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:39.969220 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d009902f-f962-4e86-94e5-e45e635565c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:39.970667 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d009902f-f962-4e86-94e5-e45e635565c2 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:39.977845 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d584acde-f935-491a-b8b4-65d6fcb82471 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:39.983781 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 435/851] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 2 15:16:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:39.984483 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d009902f-f962-4e86-94e5-e45e635565c2 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:40.010180 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:40.029649 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b9670-4cf4-4fb7-9342-cd6149d8b961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:40.030588 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b9670-4cf4-4fb7-9342-cd6149d8b961 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:40.030723 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b9670-4cf4-4fb7-9342-cd6149d8b961 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:40.031095 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b9670-4cf4-4fb7-9342-cd6149d8b961 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:40.031660 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1b9670-4cf4-4fb7-9342-cd6149d8b961 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:40.033261 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1b9670-4cf4-4fb7-9342-cd6149d8b961 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:40.045976 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-8f1b9670-4cf4-4fb7-9342-cd6149d8b961 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 15:16:40.045976 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:40.045976 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 15:16:40.045976 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 15:16:40.045976 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 15:16:40.045976 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 15:16:40.045976 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 15:16:40.045976 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 15:16:40.045976 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 15:16:40.045976 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:40.045976 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 15:16:40.045976 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:40.045976 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:40.045976 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:40.045976 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:40.045976 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:40.047184 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:40.047184 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:40.047184 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:40.047184 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:40.047184 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:40.047184 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:40.047184 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:40.047184 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 15:16:40.047184 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 15:16:40.047184 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 15:16:40.047184 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 15:16:40.047184 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:40.047184 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:40.047184 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:40.047184 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:40.047184 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:40.048193 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:40.048193 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:40.048193 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:40.048193 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:40.048193 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:40.048193 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:40.048193 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:40.048193 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:40.048193 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:40.048193 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:40.048193 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:40.048193 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 15:16:40.048193 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 15:16:40.048193 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 15:16:40.048193 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:40.049083 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 417/852] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Aug 2 15:16:39 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:40.049718 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b9670-4cf4-4fb7-9342-cd6149d8b961 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:40.108709 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d009902f-f962-4e86-94e5-e45e635565c2 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:40.120469 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:40.148945 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc1467-9142-4e6d-8c30-c1cf0b665d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:40.149951 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc1467-9142-4e6d-8c30-c1cf0b665d37 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:40.150340 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc1467-9142-4e6d-8c30-c1cf0b665d37 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:40.150598 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc1467-9142-4e6d-8c30-c1cf0b665d37 None admin] PATH_INFO: `/v3/services` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:40.151188 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdc1467-9142-4e6d-8c30-c1cf0b665d37 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:40.151523 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdc1467-9142-4e6d-8c30-c1cf0b665d37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:40.156709 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdc1467-9142-4e6d-8c30-c1cf0b665d37 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:40.161286 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 436/853] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Aug 2 15:16:39 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:40.172329 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc1467-9142-4e6d-8c30-c1cf0b665d37 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:40.199862 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b9670-4cf4-4fb7-9342-cd6149d8b961 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:40.241745 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e98304a-b8c9-4cd5-bd0f-e805145553de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:40.242476 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98304a-b8c9-4cd5-bd0f-e805145553de None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:40.242810 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98304a-b8c9-4cd5-bd0f-e805145553de None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:40.243092 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98304a-b8c9-4cd5-bd0f-e805145553de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:40.243951 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e98304a-b8c9-4cd5-bd0f-e805145553de None admin] RBAC: Adding query filter params (role.id=d75c9572cb294caeb8eb456521ff6f57, scope.project.id=cc19d22b4cd64dd1bc89ed78155d2732, user.id=6f4de590df474c8b95f2b1193f7dbcb5) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:40.244261 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e98304a-b8c9-4cd5-bd0f-e805145553de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:40.245736 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e98304a-b8c9-4cd5-bd0f-e805145553de None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:40.263691 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 418/854] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 2 15:16:40 2022] GET /identity/v3/role_assignments?user.id=6f4de590df474c8b95f2b1193f7dbcb5&scope.project.id=cc19d22b4cd64dd1bc89ed78155d2732&role.id=d75c9572cb294caeb8eb456521ff6f57 => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:40.264922 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242aebb9-fe1b-42fe-8aa2-c0fd345e661f None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:40.265210 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242aebb9-fe1b-42fe-8aa2-c0fd345e661f None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:40.265487 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242aebb9-fe1b-42fe-8aa2-c0fd345e661f None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:40.271240 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 419/855] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:16:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:16:40.273760 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ee391-4185-432e-9bc1-ae6215060d1d None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:40.274438 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ee391-4185-432e-9bc1-ae6215060d1d None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:40.274855 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ee391-4185-432e-9bc1-ae6215060d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:40.298841 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:40.302720 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-fe8ee391-4185-432e-9bc1-ae6215060d1d None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:16:40.304247 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-fe8ee391-4185-432e-9bc1-ae6215060d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:16:40.323797 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc1467-9142-4e6d-8c30-c1cf0b665d37 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:40.373962 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcedfea-c29b-42f9-94e7-436d1d9fab20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:40.374590 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcedfea-c29b-42f9-94e7-436d1d9fab20 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:40.374870 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcedfea-c29b-42f9-94e7-436d1d9fab20 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:40.375145 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcedfea-c29b-42f9-94e7-436d1d9fab20 None admin] PATH_INFO: `/v3/services` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:40.375875 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcedfea-c29b-42f9-94e7-436d1d9fab20 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:40.376180 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcedfea-c29b-42f9-94e7-436d1d9fab20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:40.377583 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcedfea-c29b-42f9-94e7-436d1d9fab20 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:40.384160 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 437/856] 10.222.0.42 () {56 vars in 1126 bytes} [Tue Aug 2 15:16:40 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:40.393328 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcedfea-c29b-42f9-94e7-436d1d9fab20 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:40.420526 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 420/857] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:16:40 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 15:16:40.450044 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ee391-4185-432e-9bc1-ae6215060d1d None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:40.502880 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:40.527882 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcedfea-c29b-42f9-94e7-436d1d9fab20 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:40.566987 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca004a5-02dd-4736-bbae-576f31c01808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:40.567752 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca004a5-02dd-4736-bbae-576f31c01808 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:40.568079 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca004a5-02dd-4736-bbae-576f31c01808 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:40.568352 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca004a5-02dd-4736-bbae-576f31c01808 None admin] PATH_INFO: `/v3/services` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:40.569163 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca004a5-02dd-4736-bbae-576f31c01808 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:40.569414 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca004a5-02dd-4736-bbae-576f31c01808 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:40.570899 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca004a5-02dd-4736-bbae-576f31c01808 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:40.576172 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 438/858] 10.222.0.42 () {56 vars in 1126 bytes} [Tue Aug 2 15:16:40 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:40.593282 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ee391-4185-432e-9bc1-ae6215060d1d None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:40.634461 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19be002e-cdce-4695-b78d-de3fcd166974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:40.635131 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be002e-cdce-4695-b78d-de3fcd166974 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:40.635444 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be002e-cdce-4695-b78d-de3fcd166974 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:40.635717 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be002e-cdce-4695-b78d-de3fcd166974 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:40.649082 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19be002e-cdce-4695-b78d-de3fcd166974 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:16:40.654268 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-19be002e-cdce-4695-b78d-de3fcd166974 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 15:16:40.654268 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:40.654268 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:40.654268 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:40.654268 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:40.654268 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:40.654268 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:40.654268 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:40.654268 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:40.654268 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:40.654268 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:40.654268 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:40.654268 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:16:40.654268 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:16:40.654268 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:16:40.654268 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:16:40.655290 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:16:40.655290 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:16:40.655290 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:16:40.655290 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:16:40.655290 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:40.655290 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:40.655290 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:40.655290 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:40.655290 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:40.655290 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:40.655290 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:40.655290 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:40.655290 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:40.655290 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:40.655290 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:40.655290 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:40.656679 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:40.656679 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:40.656679 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:40.656679 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:40.656679 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:16:40.656679 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:16:40.656679 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:16:40.656679 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:16:40.656679 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:16:40.656679 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:16:40.656679 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 15:16:40.656679 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:40.656679 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 421/859] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 2 15:16:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 15:16:40.664205 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca004a5-02dd-4736-bbae-576f31c01808 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:40.684057 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:40.780041 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca004a5-02dd-4736-bbae-576f31c01808 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:40.820825 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9c93d3-c7f6-4937-8e09-b0df11dacf9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:40.821695 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c93d3-c7f6-4937-8e09-b0df11dacf9e None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:40.822128 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c93d3-c7f6-4937-8e09-b0df11dacf9e None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:40.822574 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c93d3-c7f6-4937-8e09-b0df11dacf9e None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:40.823486 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9c93d3-c7f6-4937-8e09-b0df11dacf9e None admin] RBAC: Adding query filter params (name=service) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:40.823942 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9c93d3-c7f6-4937-8e09-b0df11dacf9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:40.825488 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9c93d3-c7f6-4937-8e09-b0df11dacf9e None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:40.839332 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 439/860] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Aug 2 15:16:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:40.840878 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19be002e-cdce-4695-b78d-de3fcd166974 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:40.949369 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:40.953326 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19be002e-cdce-4695-b78d-de3fcd166974 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:40.990670 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fdb7d8-cf2e-40a2-a5ac-1704998f5896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:40.991354 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fdb7d8-cf2e-40a2-a5ac-1704998f5896 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:40.991636 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fdb7d8-cf2e-40a2-a5ac-1704998f5896 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:40.991910 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fdb7d8-cf2e-40a2-a5ac-1704998f5896 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:41.002916 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fdb7d8-cf2e-40a2-a5ac-1704998f5896 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:41.005061 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fdb7d8-cf2e-40a2-a5ac-1704998f5896 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:41.021135 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-78fdb7d8-cf2e-40a2-a5ac-1704998f5896 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:41.021135 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:41.021135 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:41.021135 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:41.021135 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:41.021135 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:41.021135 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:41.021135 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:41.021135 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:41.021135 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:41.021135 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:41.021135 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:41.021135 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:16:41.021135 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:16:41.021135 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:16:41.022114 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:16:41.022114 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:41.022114 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:41.022114 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:41.022114 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:41.022114 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:41.022114 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:41.022114 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:41.022114 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:41.022114 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:41.022114 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:41.022114 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:41.022114 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:41.022114 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:41.022114 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:41.022114 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:41.022114 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:41.023449 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:16:41.023449 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:16:41.023449 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:41.023449 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:41.023449 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 422/861] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:16:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:41.029694 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9c93d3-c7f6-4937-8e09-b0df11dacf9e None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:41.125423 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:41.152448 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9c93d3-c7f6-4937-8e09-b0df11dacf9e None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:41.189521 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8843db1e-bc09-4c3e-9ee1-e86215612aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:41.190514 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843db1e-bc09-4c3e-9ee1-e86215612aba None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:41.191036 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843db1e-bc09-4c3e-9ee1-e86215612aba None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:41.191574 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843db1e-bc09-4c3e-9ee1-e86215612aba None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:41.192452 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8843db1e-bc09-4c3e-9ee1-e86215612aba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:41.193153 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8843db1e-bc09-4c3e-9ee1-e86215612aba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:41.194718 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8843db1e-bc09-4c3e-9ee1-e86215612aba None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:41.207202 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 440/862] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:16:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:41.212492 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fdb7d8-cf2e-40a2-a5ac-1704998f5896 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:41.320411 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fdb7d8-cf2e-40a2-a5ac-1704998f5896 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:41.355531 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c8312-61f1-4e4c-a3f1-e46c4c278d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:41.356173 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c8312-61f1-4e4c-a3f1-e46c4c278d08 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:41.356513 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c8312-61f1-4e4c-a3f1-e46c4c278d08 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:41.356787 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c8312-61f1-4e4c-a3f1-e46c4c278d08 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:41.365191 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589c8312-61f1-4e4c-a3f1-e46c4c278d08 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:41.366688 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589c8312-61f1-4e4c-a3f1-e46c4c278d08 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:41.378306 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-589c8312-61f1-4e4c-a3f1-e46c4c278d08 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 15:16:41.378306 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:41.378306 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:41.378306 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:41.378306 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:41.378306 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:41.378306 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:41.378306 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:41.378306 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:41.378306 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:41.378306 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:41.378306 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:41.378306 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 15:16:41.378306 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 15:16:41.378306 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 15:16:41.378306 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 15:16:41.379297 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:41.379297 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:41.379297 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 15:16:41.379297 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:16:41.379297 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 15:16:41.379297 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:16:41.379297 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:41.379297 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:41.379297 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:41.379297 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:41.379297 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:41.379297 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:41.379297 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:41.379297 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:41.379297 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:41.379297 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:41.379297 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:41.379297 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:41.380226 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:41.380226 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:41.380226 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 15:16:41.380226 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 15:16:41.380226 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 15:16:41.380226 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 15:16:41.380226 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 15:16:41.380226 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 15:16:41.380226 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 15:16:41.380226 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:41.380226 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 423/863] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Aug 2 15:16:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 15:16:41.385537 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8843db1e-bc09-4c3e-9ee1-e86215612aba None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:41.493732 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8843db1e-bc09-4c3e-9ee1-e86215612aba None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:41.530762 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0674e939-8b4e-421b-8f98-429503cbe19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:41.531437 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674e939-8b4e-421b-8f98-429503cbe19d None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:41.531775 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674e939-8b4e-421b-8f98-429503cbe19d None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:41.532059 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674e939-8b4e-421b-8f98-429503cbe19d None admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:41.532873 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0674e939-8b4e-421b-8f98-429503cbe19d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:41.533185 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0674e939-8b4e-421b-8f98-429503cbe19d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:41.534670 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0674e939-8b4e-421b-8f98-429503cbe19d None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:41.539591 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:41.557389 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 441/864] 10.222.0.42 () {56 vars in 1149 bytes} [Tue Aug 2 15:16:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:41.562846 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c8312-61f1-4e4c-a3f1-e46c4c278d08 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:41.587595 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:41.672213 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c8312-61f1-4e4c-a3f1-e46c4c278d08 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:41.707558 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c176e9ed-728a-4cb0-9bf8-fff53c83e49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:41.708176 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176e9ed-728a-4cb0-9bf8-fff53c83e49c None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:41.708460 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176e9ed-728a-4cb0-9bf8-fff53c83e49c None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:41.708738 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176e9ed-728a-4cb0-9bf8-fff53c83e49c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:41.782311 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c176e9ed-728a-4cb0-9bf8-fff53c83e49c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:41.783816 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c176e9ed-728a-4cb0-9bf8-fff53c83e49c None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:41.800081 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:41.888850 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 424/865] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 2 15:16:41 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 15:16:41.894255 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0674e939-8b4e-421b-8f98-429503cbe19d None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:41.998185 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0674e939-8b4e-421b-8f98-429503cbe19d None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:42.034763 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f2957-4acb-48d2-8a27-81ddac8b158b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:42.036317 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f2957-4acb-48d2-8a27-81ddac8b158b None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:42.036797 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f2957-4acb-48d2-8a27-81ddac8b158b None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:42.037285 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f2957-4acb-48d2-8a27-81ddac8b158b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:42.048314 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9f2957-4acb-48d2-8a27-81ddac8b158b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:42.050016 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9f2957-4acb-48d2-8a27-81ddac8b158b None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:42.065565 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-ef9f2957-4acb-48d2-8a27-81ddac8b158b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:42.065565 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:42.065565 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:42.065565 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:42.065565 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:42.065565 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:42.065565 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:42.065565 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:42.065565 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:42.065565 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:42.065565 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:42.065565 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:42.065565 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:16:42.065565 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:16:42.065565 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:16:42.066539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:16:42.066539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:42.066539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:42.066539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:42.066539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:42.066539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:42.066539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:42.066539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:42.066539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:42.066539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:42.066539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:42.066539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:42.066539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:42.066539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:42.066539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:42.066539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:42.066539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:42.067426 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:16:42.067426 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:16:42.067426 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:42.067426 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:42.069210 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 442/866] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:16:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:42.079239 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c176e9ed-728a-4cb0-9bf8-fff53c83e49c None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:42.182029 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c176e9ed-728a-4cb0-9bf8-fff53c83e49c None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:42.196002 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:42.218962 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b3214c-c5df-4e1f-ab1a-5b4a70e06a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:42.219675 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3214c-c5df-4e1f-ab1a-5b4a70e06a5d None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:42.220021 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3214c-c5df-4e1f-ab1a-5b4a70e06a5d None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:42.220308 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3214c-c5df-4e1f-ab1a-5b4a70e06a5d None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:42.221006 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b3214c-c5df-4e1f-ab1a-5b4a70e06a5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:42.221312 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b3214c-c5df-4e1f-ab1a-5b4a70e06a5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:42.223266 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b3214c-c5df-4e1f-ab1a-5b4a70e06a5d None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:42.239440 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 425/867] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:16:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:42.242038 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f2957-4acb-48d2-8a27-81ddac8b158b None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:42.295823 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:42.351955 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f2957-4acb-48d2-8a27-81ddac8b158b None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:42.376730 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447bdcd-4fd1-4946-aea5-d4948a641bd0 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:42.377064 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447bdcd-4fd1-4946-aea5-d4948a641bd0 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:42.377300 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447bdcd-4fd1-4946-aea5-d4948a641bd0 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:42.378934 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 426/868] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:16:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 15:16:42.383879 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fdec11-9a7c-435b-a448-de0b2cd772be None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:42.384166 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fdec11-9a7c-435b-a448-de0b2cd772be None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:42.384446 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fdec11-9a7c-435b-a448-de0b2cd772be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:42.386181 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f57e8a-a35b-466c-911d-37901fd2ff8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:42.386823 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f57e8a-a35b-466c-911d-37901fd2ff8e None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:42.387106 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f57e8a-a35b-466c-911d-37901fd2ff8e None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:42.387412 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f57e8a-a35b-466c-911d-37901fd2ff8e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:42.395417 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f57e8a-a35b-466c-911d-37901fd2ff8e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:42.396885 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f57e8a-a35b-466c-911d-37901fd2ff8e None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:42.403965 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-87fdec11-9a7c-435b-a448-de0b2cd772be None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:16:42.405233 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-87fdec11-9a7c-435b-a448-de0b2cd772be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:16:42.408656 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-31f57e8a-a35b-466c-911d-37901fd2ff8e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:16:42.408656 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:42.408656 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:42.408656 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:42.408656 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:42.408656 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:42.408656 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:42.408656 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:42.408656 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:42.408656 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:42.408656 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:42.408656 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:42.408656 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 15:16:42.408656 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 15:16:42.408656 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 15:16:42.409510 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 15:16:42.409510 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:42.409510 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:42.409510 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:42.409510 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:42.409510 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:42.409510 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:42.409510 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:42.409510 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:42.409510 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:42.409510 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:42.409510 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:42.409510 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:42.409510 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:42.409510 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:42.409510 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:42.409510 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:42.411397 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 15:16:42.411397 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 15:16:42.411397 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 15:16:42.411397 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 15:16:42.411397 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 15:16:42.411397 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 15:16:42.411397 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:16:42.411397 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:42.411397 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 443/869] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 2 15:16:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:42.418148 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f57e8a-a35b-466c-911d-37901fd2ff8e None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:42.483377 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 427/870] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:16:42 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 15:16:42.485173 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c615a15-3227-42a8-ab24-0482bba5896a None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:42.485490 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c615a15-3227-42a8-ab24-0482bba5896a None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:42.486036 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c615a15-3227-42a8-ab24-0482bba5896a None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:42.491649 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 428/871] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:16:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:16:42.493987 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0034e-437f-4def-8103-9a1233eda0e0 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:42.494278 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0034e-437f-4def-8103-9a1233eda0e0 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:42.495024 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0034e-437f-4def-8103-9a1233eda0e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:42.514256 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-1fa0034e-437f-4def-8103-9a1233eda0e0 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:16:42.515621 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-1fa0034e-437f-4def-8103-9a1233eda0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:16:42.532418 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f57e8a-a35b-466c-911d-37901fd2ff8e None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:42.540288 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:42.569566 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf532696-5801-4000-b352-3077d0c78db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:42.570193 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf532696-5801-4000-b352-3077d0c78db1 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:42.570540 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf532696-5801-4000-b352-3077d0c78db1 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:42.571073 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf532696-5801-4000-b352-3077d0c78db1 None admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:42.571854 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf532696-5801-4000-b352-3077d0c78db1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:42.572163 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf532696-5801-4000-b352-3077d0c78db1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:42.573615 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf532696-5801-4000-b352-3077d0c78db1 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:42.586489 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 444/872] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 2 15:16:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:16:42.587324 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf532696-5801-4000-b352-3077d0c78db1 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:42.600997 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 429/873] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:16:42 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 15:16:42.600997 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa0034e-437f-4def-8103-9a1233eda0e0 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:42.638135 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:42.700302 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf532696-5801-4000-b352-3077d0c78db1 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:42.719004 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa0034e-437f-4def-8103-9a1233eda0e0 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:42.736026 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d27708-007b-48ac-8999-b2ef93de1c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:42.736641 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d27708-007b-48ac-8999-b2ef93de1c8c None admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:42.736916 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d27708-007b-48ac-8999-b2ef93de1c8c None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:42.737198 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d27708-007b-48ac-8999-b2ef93de1c8c None admin] PATH_INFO: `/v3/services` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:42.737880 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d27708-007b-48ac-8999-b2ef93de1c8c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:42.739844 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d27708-007b-48ac-8999-b2ef93de1c8c None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:42.754321 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 445/874] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Aug 2 15:16:42 2022] POST /identity/v3/services => generated 251 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:16:42.755129 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d27708-007b-48ac-8999-b2ef93de1c8c None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:42.767686 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1129944e-8e6e-4e93-8b45-c7d4777cb153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:42.768328 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129944e-8e6e-4e93-8b45-c7d4777cb153 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:42.768613 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129944e-8e6e-4e93-8b45-c7d4777cb153 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:42.768892 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129944e-8e6e-4e93-8b45-c7d4777cb153 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:42.770277 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1129944e-8e6e-4e93-8b45-c7d4777cb153 None admin] RBAC: Adding query filter params (role.id=532162a00de849cea5c27767c8acd018, scope.project.id=cc19d22b4cd64dd1bc89ed78155d2732, user.id=dfe8c00c0c3d4c4b8b6f36e39a3a2e71) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:42.770596 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1129944e-8e6e-4e93-8b45-c7d4777cb153 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:42.772171 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1129944e-8e6e-4e93-8b45-c7d4777cb153 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:42.783690 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 430/875] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 2 15:16:42 2022] GET /identity/v3/role_assignments?user.id=dfe8c00c0c3d4c4b8b6f36e39a3a2e71&scope.project.id=cc19d22b4cd64dd1bc89ed78155d2732&role.id=532162a00de849cea5c27767c8acd018 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:42.783690 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b645e-bc03-4f9e-b710-ead9cfc66cf6 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:42.783690 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b645e-bc03-4f9e-b710-ead9cfc66cf6 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:42.783690 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b645e-bc03-4f9e-b710-ead9cfc66cf6 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:42.783690 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 431/876] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:16:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:16:42.788604 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678560b0-a7f8-4fc3-b4dd-622325498f8e None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:42.789217 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678560b0-a7f8-4fc3-b4dd-622325498f8e None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:42.789573 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678560b0-a7f8-4fc3-b4dd-622325498f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:42.802436 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:42.817492 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-678560b0-a7f8-4fc3-b4dd-622325498f8e None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:16:42.820075 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-678560b0-a7f8-4fc3-b4dd-622325498f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:16:42.904021 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d27708-007b-48ac-8999-b2ef93de1c8c None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:42.924946 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 432/877] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:16:42 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 15:16:42.949392 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678560b0-a7f8-4fc3-b4dd-622325498f8e None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:42.952323 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2974163-9444-4329-be1c-eb947adccecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:42.952991 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2974163-9444-4329-be1c-eb947adccecf None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:42.953279 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2974163-9444-4329-be1c-eb947adccecf None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:42.953562 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2974163-9444-4329-be1c-eb947adccecf None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:42.954197 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2974163-9444-4329-be1c-eb947adccecf None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:42.955671 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2974163-9444-4329-be1c-eb947adccecf None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:42.965587 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-d2974163-9444-4329-be1c-eb947adccecf None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 15:16:42.965587 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:42.965587 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 15:16:42.965587 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 15:16:42.965587 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 15:16:42.965587 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 15:16:42.965587 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 15:16:42.965587 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 15:16:42.965587 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 15:16:42.965587 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:42.965587 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 15:16:42.965587 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:42.965587 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:42.965587 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:42.965587 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:42.965587 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:42.965587 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:42.966636 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:42.966636 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:42.966636 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:42.966636 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:42.966636 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:42.966636 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:42.966636 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 15:16:42.966636 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 15:16:42.966636 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 15:16:42.966636 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 15:16:42.966636 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:42.966636 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:42.966636 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:42.966636 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:42.966636 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:42.966636 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:42.967487 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:42.967487 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:42.967487 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:42.967487 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:42.967487 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:42.967487 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:42.967487 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:42.967487 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:42.967487 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:42.967487 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:42.967487 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 15:16:42.967487 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 15:16:42.967487 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 15:16:42.967487 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:42.967487 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 446/878] 10.222.0.42 () {56 vars in 1126 bytes} [Tue Aug 2 15:16:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:42.974260 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2974163-9444-4329-be1c-eb947adccecf None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:42.983513 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:43.082657 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:43.087822 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678560b0-a7f8-4fc3-b4dd-622325498f8e None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:43.095741 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2974163-9444-4329-be1c-eb947adccecf None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:43.144445 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921353c5-db74-4dd3-ade9-6b57bdf69dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:43.145089 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921353c5-db74-4dd3-ade9-6b57bdf69dc8 None admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:43.145373 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921353c5-db74-4dd3-ade9-6b57bdf69dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:43.145645 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921353c5-db74-4dd3-ade9-6b57bdf69dc8 None admin] PATH_INFO: `/v3/services` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:43.146346 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921353c5-db74-4dd3-ade9-6b57bdf69dc8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:43.147765 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921353c5-db74-4dd3-ade9-6b57bdf69dc8 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:43.153853 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0fc39c-f10e-4275-9e7c-0d9c7ef5adee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:43.154501 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0fc39c-f10e-4275-9e7c-0d9c7ef5adee None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:43.154783 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0fc39c-f10e-4275-9e7c-0d9c7ef5adee None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:43.155058 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0fc39c-f10e-4275-9e7c-0d9c7ef5adee None admin] PATH_INFO: `/v3/services` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:43.155784 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0fc39c-f10e-4275-9e7c-0d9c7ef5adee None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:43.156091 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0fc39c-f10e-4275-9e7c-0d9c7ef5adee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:43.158035 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0fc39c-f10e-4275-9e7c-0d9c7ef5adee None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:43.164914 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 447/879] 10.222.0.42 () {56 vars in 1122 bytes} [Tue Aug 2 15:16:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:16:43.176293 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0fc39c-f10e-4275-9e7c-0d9c7ef5adee None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:43.201813 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 433/880] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Aug 2 15:16:42 2022] POST /identity/v3/services => generated 269 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 15:16:43.330958 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0fc39c-f10e-4275-9e7c-0d9c7ef5adee None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:43.378532 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afb3295-2a25-4293-8d19-a4ac925782e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:43.379116 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb3295-2a25-4293-8d19-a4ac925782e7 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:43.379507 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb3295-2a25-4293-8d19-a4ac925782e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:43.379789 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb3295-2a25-4293-8d19-a4ac925782e7 None admin] PATH_INFO: `/v3/services` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:43.380463 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afb3295-2a25-4293-8d19-a4ac925782e7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:43.380766 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afb3295-2a25-4293-8d19-a4ac925782e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:43.382147 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afb3295-2a25-4293-8d19-a4ac925782e7 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:43.387191 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 448/881] 10.222.0.42 () {56 vars in 1122 bytes} [Tue Aug 2 15:16:43 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:16:44.905602 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223db02c-c5a7-4c05-b742-6318e2fe4a09 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:44.906238 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223db02c-c5a7-4c05-b742-6318e2fe4a09 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:44.906238 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223db02c-c5a7-4c05-b742-6318e2fe4a09 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:44.907901 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 434/882] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:16:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:16:44.914041 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1618d5d1-eb39-43ea-8048-6d794a3064ca None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:44.914909 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1618d5d1-eb39-43ea-8048-6d794a3064ca None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:44.915422 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1618d5d1-eb39-43ea-8048-6d794a3064ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:44.934701 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-1618d5d1-eb39-43ea-8048-6d794a3064ca None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:16:44.936273 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-1618d5d1-eb39-43ea-8048-6d794a3064ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:16:44.947165 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:45.001361 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ae1d5-ab6b-4b3a-b139-a9a15f81a231 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:45.001707 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ae1d5-ab6b-4b3a-b139-a9a15f81a231 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:45.001901 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ae1d5-ab6b-4b3a-b139-a9a15f81a231 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:45.003517 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 435/883] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:16:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 15:16:45.010006 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ec38b-19a5-4c5a-8ff2-244095435791 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:45.010289 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ec38b-19a5-4c5a-8ff2-244095435791 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:45.010555 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ec38b-19a5-4c5a-8ff2-244095435791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:45.016056 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 449/884] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:16:44 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 15:16:45.031247 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-af3ec38b-19a5-4c5a-8ff2-244095435791 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:16:45.032788 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-af3ec38b-19a5-4c5a-8ff2-244095435791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:16:45.040437 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1618d5d1-eb39-43ea-8048-6d794a3064ca None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:45.114247 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 436/885] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:16:45 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 15:16:45.134042 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3ec38b-19a5-4c5a-8ff2-244095435791 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:45.151686 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1618d5d1-eb39-43ea-8048-6d794a3064ca None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:45.152746 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:45.202582 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d1838-c643-4c86-bc57-f59fbe110b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:45.204073 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d1838-c643-4c86-bc57-f59fbe110b3c None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:45.204586 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d1838-c643-4c86-bc57-f59fbe110b3c None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:45.205082 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d1838-c643-4c86-bc57-f59fbe110b3c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:45.205937 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0d1838-c643-4c86-bc57-f59fbe110b3c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:45.209063 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0d1838-c643-4c86-bc57-f59fbe110b3c None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:45.222378 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-3e0d1838-c643-4c86-bc57-f59fbe110b3c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 15:16:45.222378 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:45.222378 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 15:16:45.222378 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 15:16:45.222378 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 15:16:45.222378 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 15:16:45.222378 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 15:16:45.222378 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 15:16:45.222378 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 15:16:45.222378 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:45.222378 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 15:16:45.222378 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:45.222378 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:45.222378 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:45.222378 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:45.222378 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:45.222378 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:45.224098 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:45.224098 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:45.224098 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:45.224098 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:45.224098 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:45.224098 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:45.224098 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 15:16:45.224098 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 15:16:45.224098 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 15:16:45.224098 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 15:16:45.224098 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:45.224098 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:45.224098 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:45.224098 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:45.224098 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:45.224098 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:45.224989 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:45.224989 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:45.224989 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:45.224989 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:45.224989 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:45.224989 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:45.224989 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:45.224989 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:45.224989 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:45.224989 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:45.224989 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 15:16:45.224989 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 15:16:45.224989 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 15:16:45.224989 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:45.228363 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 450/886] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Aug 2 15:16:45 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 15:16:45.234812 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d1838-c643-4c86-bc57-f59fbe110b3c None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:45.249673 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:45.276463 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3ec38b-19a5-4c5a-8ff2-244095435791 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:45.321154 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7a4271-e9b9-4fc6-bb1b-96fd37ba90ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:45.322098 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a4271-e9b9-4fc6-bb1b-96fd37ba90ae None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:45.322544 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a4271-e9b9-4fc6-bb1b-96fd37ba90ae None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:45.323007 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a4271-e9b9-4fc6-bb1b-96fd37ba90ae None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:45.334592 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7a4271-e9b9-4fc6-bb1b-96fd37ba90ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:16:45.339938 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-af7a4271-e9b9-4fc6-bb1b-96fd37ba90ae None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 15:16:45.339938 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:45.339938 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:45.339938 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:45.339938 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:45.339938 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:45.339938 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:45.339938 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:45.339938 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:45.339938 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:45.339938 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:45.339938 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:45.339938 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:16:45.339938 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:16:45.339938 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:16:45.339938 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:16:45.340885 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:16:45.340885 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:16:45.340885 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:16:45.340885 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:16:45.340885 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:45.340885 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:45.340885 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:45.340885 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:45.340885 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:45.340885 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:45.340885 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:45.340885 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:45.340885 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:45.340885 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:45.340885 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:45.340885 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:45.341834 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:45.341834 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:45.341834 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:45.341834 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:45.341834 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:16:45.341834 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:16:45.341834 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:16:45.341834 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:16:45.341834 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:16:45.341834 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:16:45.341834 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 15:16:45.341834 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:45.349540 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 437/887] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Aug 2 15:16:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 15:16:45.349946 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261f689-3ced-4b28-83dc-22d1d1628fa4 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:45.350449 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261f689-3ced-4b28-83dc-22d1d1628fa4 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:45.350567 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261f689-3ced-4b28-83dc-22d1d1628fa4 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:45.352018 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 438/888] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:16:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:16:45.352719 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f261f689-3ced-4b28-83dc-22d1d1628fa4 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:45.362495 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d1838-c643-4c86-bc57-f59fbe110b3c None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:45.397280 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c91d9dd-1a43-461d-a2b8-adeaf94d1ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:45.397914 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91d9dd-1a43-461d-a2b8-adeaf94d1ea0 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:45.398200 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91d9dd-1a43-461d-a2b8-adeaf94d1ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:45.398492 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91d9dd-1a43-461d-a2b8-adeaf94d1ea0 None admin] PATH_INFO: `/v3/services` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:45.399177 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c91d9dd-1a43-461d-a2b8-adeaf94d1ea0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:45.399516 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c91d9dd-1a43-461d-a2b8-adeaf94d1ea0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:45.400908 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c91d9dd-1a43-461d-a2b8-adeaf94d1ea0 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:45.405923 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 451/889] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Aug 2 15:16:45 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:45.407176 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49abf030-3e74-45b8-a34e-60628aedb5b1 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:45.407499 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49abf030-3e74-45b8-a34e-60628aedb5b1 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:45.407778 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49abf030-3e74-45b8-a34e-60628aedb5b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:45.426461 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-49abf030-3e74-45b8-a34e-60628aedb5b1 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:16:45.427609 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-49abf030-3e74-45b8-a34e-60628aedb5b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:16:45.440054 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:45.470512 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f261f689-3ced-4b28-83dc-22d1d1628fa4 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:45.494259 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 452/890] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:16:45 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 15:16:45.495100 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49abf030-3e74-45b8-a34e-60628aedb5b1 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:45.497287 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:45.506866 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b698e8b-b47b-4b2d-aa95-28df8df592c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:45.507513 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b698e8b-b47b-4b2d-aa95-28df8df592c0 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:45.507794 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b698e8b-b47b-4b2d-aa95-28df8df592c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:45.508162 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b698e8b-b47b-4b2d-aa95-28df8df592c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:45.508926 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b698e8b-b47b-4b2d-aa95-28df8df592c0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:45.509229 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b698e8b-b47b-4b2d-aa95-28df8df592c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:45.510596 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b698e8b-b47b-4b2d-aa95-28df8df592c0 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:45.524406 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 439/891] 10.222.0.42 () {56 vars in 1115 bytes} [Tue Aug 2 15:16:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:45.524406 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f33a2-0f5b-4561-9f15-0677b5add9dd None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:45.524406 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f33a2-0f5b-4561-9f15-0677b5add9dd None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:45.524406 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f33a2-0f5b-4561-9f15-0677b5add9dd None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:45.524406 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 440/892] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:16:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:16:45.524406 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10f33a2-0f5b-4561-9f15-0677b5add9dd None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:45.602854 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49abf030-3e74-45b8-a34e-60628aedb5b1 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:45.625664 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10f33a2-0f5b-4561-9f15-0677b5add9dd None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:45.639006 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad2452-7b46-4788-bd0f-b9eacf2b9e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:45.639729 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad2452-7b46-4788-bd0f-b9eacf2b9e6c None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:45.640016 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad2452-7b46-4788-bd0f-b9eacf2b9e6c None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:45.640298 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad2452-7b46-4788-bd0f-b9eacf2b9e6c None admin] PATH_INFO: `/v3/services` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:45.640982 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bad2452-7b46-4788-bd0f-b9eacf2b9e6c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:45.641290 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bad2452-7b46-4788-bd0f-b9eacf2b9e6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:45.642681 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bad2452-7b46-4788-bd0f-b9eacf2b9e6c None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:45.648346 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 453/893] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Aug 2 15:16:45 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:45.649128 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad2452-7b46-4788-bd0f-b9eacf2b9e6c None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:45.664342 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5fc56e-7e7e-42c7-bdd1-fa3736ac5c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:45.664700 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5fc56e-7e7e-42c7-bdd1-fa3736ac5c38 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:45.664980 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5fc56e-7e7e-42c7-bdd1-fa3736ac5c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:45.665258 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5fc56e-7e7e-42c7-bdd1-fa3736ac5c38 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:45.665883 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5fc56e-7e7e-42c7-bdd1-fa3736ac5c38 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:45.667267 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5fc56e-7e7e-42c7-bdd1-fa3736ac5c38 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:45.669081 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:45.678141 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-bc5fc56e-7e7e-42c7-bdd1-fa3736ac5c38 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 15:16:45.678141 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:45.678141 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 15:16:45.678141 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 15:16:45.678141 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 15:16:45.678141 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 15:16:45.678141 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 15:16:45.678141 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 15:16:45.678141 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 15:16:45.678141 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:45.678141 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 15:16:45.678141 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:45.678141 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:45.678141 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:45.678141 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:45.678141 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:45.679308 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:45.679308 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:45.679308 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:45.679308 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:45.679308 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:45.679308 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:45.679308 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:45.679308 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 15:16:45.679308 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 15:16:45.679308 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 15:16:45.679308 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 15:16:45.679308 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:45.679308 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:45.679308 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:45.679308 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:45.679308 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:45.680513 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:45.680513 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:45.680513 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:45.680513 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:45.680513 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:45.680513 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:45.680513 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:45.680513 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:45.680513 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:45.680513 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:45.680513 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:45.680513 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 15:16:45.680513 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 15:16:45.680513 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 15:16:45.680513 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:45.680513 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 441/894] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Aug 2 15:16:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:45.681779 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652a3df-4aba-41fe-8afd-cd4b8e9ec82a None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:45.682453 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652a3df-4aba-41fe-8afd-cd4b8e9ec82a None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:45.682802 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652a3df-4aba-41fe-8afd-cd4b8e9ec82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:45.700746 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-2652a3df-4aba-41fe-8afd-cd4b8e9ec82a None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:16:45.701926 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-2652a3df-4aba-41fe-8afd-cd4b8e9ec82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:16:45.717943 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:45.752749 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad2452-7b46-4788-bd0f-b9eacf2b9e6c None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:45.767671 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 442/895] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:16:45 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 15:16:45.771420 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2652a3df-4aba-41fe-8afd-cd4b8e9ec82a None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:45.787668 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bff91f-6e24-43bd-80c9-22fdad358f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:45.788312 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bff91f-6e24-43bd-80c9-22fdad358f9d None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:45.788594 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bff91f-6e24-43bd-80c9-22fdad358f9d None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:45.789125 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bff91f-6e24-43bd-80c9-22fdad358f9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:45.801270 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bff91f-6e24-43bd-80c9-22fdad358f9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:45.803176 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bff91f-6e24-43bd-80c9-22fdad358f9d None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:45.819164 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-f5bff91f-6e24-43bd-80c9-22fdad358f9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:45.819164 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:45.819164 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:45.819164 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:45.819164 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:45.819164 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:45.819164 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:45.819164 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:45.819164 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:45.819164 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:45.819164 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:45.819164 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:45.819164 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:16:45.819164 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:16:45.819164 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:16:45.820107 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:16:45.820107 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:45.820107 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:45.820107 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:45.820107 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:45.820107 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:45.820107 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:45.820107 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:45.820107 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:45.820107 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:45.820107 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:45.820107 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:45.820107 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:45.820107 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:45.820107 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:45.820107 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:45.820107 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:45.821005 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:16:45.821005 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:16:45.821005 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:45.821005 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:45.821005 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 454/896] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:16:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:45.821300 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bff91f-6e24-43bd-80c9-22fdad358f9d None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:45.869810 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2652a3df-4aba-41fe-8afd-cd4b8e9ec82a None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:45.896548 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:45.904877 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a446bd17-4669-474e-8f70-13b5dfb872a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:45.905492 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446bd17-4669-474e-8f70-13b5dfb872a3 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:45.905772 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446bd17-4669-474e-8f70-13b5dfb872a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:45.906314 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446bd17-4669-474e-8f70-13b5dfb872a3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:45.906778 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a446bd17-4669-474e-8f70-13b5dfb872a3 None admin] RBAC: Adding query filter params (interface=public, service_id=5136496ca77e4a1797d46517de8f0816, region_id=RegionOne) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:45.907415 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a446bd17-4669-474e-8f70-13b5dfb872a3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:45.908489 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a446bd17-4669-474e-8f70-13b5dfb872a3 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:45.913433 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 443/897] 10.222.0.42 () {56 vars in 1251 bytes} [Tue Aug 2 15:16:45 2022] GET /identity/v3/endpoints?service_id=5136496ca77e4a1797d46517de8f0816&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:45.914433 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a446bd17-4669-474e-8f70-13b5dfb872a3 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:45.926883 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bff91f-6e24-43bd-80c9-22fdad358f9d None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:45.945468 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:45.963427 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f7fd6-c68f-4aeb-85ea-7bc512848a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:45.964048 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f7fd6-c68f-4aeb-85ea-7bc512848a46 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:45.964329 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f7fd6-c68f-4aeb-85ea-7bc512848a46 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:45.964613 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f7fd6-c68f-4aeb-85ea-7bc512848a46 None admin] PATH_INFO: `/v3/services` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:45.965291 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837f7fd6-c68f-4aeb-85ea-7bc512848a46 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:45.965598 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837f7fd6-c68f-4aeb-85ea-7bc512848a46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:45.966984 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837f7fd6-c68f-4aeb-85ea-7bc512848a46 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:45.971598 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 455/898] 10.222.0.42 () {56 vars in 1126 bytes} [Tue Aug 2 15:16:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:45.972374 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f7fd6-c68f-4aeb-85ea-7bc512848a46 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:46.022285 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a446bd17-4669-474e-8f70-13b5dfb872a3 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:46.055646 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0420d4-e654-4cea-b5af-3e38d05a5997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:46.056259 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0420d4-e654-4cea-b5af-3e38d05a5997 None admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:46.056537 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0420d4-e654-4cea-b5af-3e38d05a5997 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:46.056809 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0420d4-e654-4cea-b5af-3e38d05a5997 None admin] PATH_INFO: `/v3/services` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:46.057486 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0420d4-e654-4cea-b5af-3e38d05a5997 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:46.058836 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0420d4-e654-4cea-b5af-3e38d05a5997 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:46.073139 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f7fd6-c68f-4aeb-85ea-7bc512848a46 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:46.075586 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 444/899] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Aug 2 15:16:45 2022] POST /identity/v3/services => generated 241 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:16:46.076403 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0420d4-e654-4cea-b5af-3e38d05a5997 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:46.121926 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e8ace0-05e5-4173-b78c-9a9a68e3f246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:46.122664 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8ace0-05e5-4173-b78c-9a9a68e3f246 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:46.122946 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8ace0-05e5-4173-b78c-9a9a68e3f246 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:46.123251 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8ace0-05e5-4173-b78c-9a9a68e3f246 None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:46.123957 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e8ace0-05e5-4173-b78c-9a9a68e3f246 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:46.124261 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e8ace0-05e5-4173-b78c-9a9a68e3f246 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:46.125734 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e8ace0-05e5-4173-b78c-9a9a68e3f246 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:46.144715 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 456/900] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:16:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:46.144715 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e8ace0-05e5-4173-b78c-9a9a68e3f246 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:46.149136 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:46.192507 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:46.210902 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0420d4-e654-4cea-b5af-3e38d05a5997 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:46.251001 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb54fcb-bcc4-412a-8f44-4757f5812577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:46.255048 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb54fcb-bcc4-412a-8f44-4757f5812577 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:46.255048 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb54fcb-bcc4-412a-8f44-4757f5812577 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:46.255048 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb54fcb-bcc4-412a-8f44-4757f5812577 None admin] PATH_INFO: `/v3/services` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:46.255048 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb54fcb-bcc4-412a-8f44-4757f5812577 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:46.255048 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb54fcb-bcc4-412a-8f44-4757f5812577 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:46.262512 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 445/901] 10.222.0.42 () {56 vars in 1087 bytes} [Tue Aug 2 15:16:46 2022] GET /identity/v3/services => generated 1497 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:16:46.263549 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb54fcb-bcc4-412a-8f44-4757f5812577 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:46.277794 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e8ace0-05e5-4173-b78c-9a9a68e3f246 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:46.319672 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c14a9-5f7b-4b20-9be5-35ce614e06dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:46.320311 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c14a9-5f7b-4b20-9be5-35ce614e06dd None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:46.320598 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c14a9-5f7b-4b20-9be5-35ce614e06dd None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:46.320876 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c14a9-5f7b-4b20-9be5-35ce614e06dd None admin] PATH_INFO: `/v3/services` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:46.321576 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075c14a9-5f7b-4b20-9be5-35ce614e06dd None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:46.321900 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075c14a9-5f7b-4b20-9be5-35ce614e06dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:46.323337 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075c14a9-5f7b-4b20-9be5-35ce614e06dd None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:46.329556 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 457/902] 10.222.0.42 () {56 vars in 1126 bytes} [Tue Aug 2 15:16:46 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:46.335822 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c14a9-5f7b-4b20-9be5-35ce614e06dd None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:46.400357 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb54fcb-bcc4-412a-8f44-4757f5812577 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:46.430079 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:46.450955 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0addc27f-a83f-40c6-961b-4772ce97d6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:46.451533 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c14a9-5f7b-4b20-9be5-35ce614e06dd None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:46.451671 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0addc27f-a83f-40c6-961b-4772ce97d6cd None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:46.451918 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0addc27f-a83f-40c6-961b-4772ce97d6cd None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:46.452195 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0addc27f-a83f-40c6-961b-4772ce97d6cd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:46.453315 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:46.461070 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0addc27f-a83f-40c6-961b-4772ce97d6cd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:46.462466 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0addc27f-a83f-40c6-961b-4772ce97d6cd None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:46.476272 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-0addc27f-a83f-40c6-961b-4772ce97d6cd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 15:16:46.476272 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:46.476272 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:46.476272 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:46.476272 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:46.476272 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:46.476272 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:46.476272 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:46.476272 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:46.476272 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:46.476272 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:46.476272 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:46.476272 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 15:16:46.476272 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 15:16:46.476272 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 15:16:46.476272 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 15:16:46.477293 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:46.477293 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:46.477293 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 15:16:46.477293 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:16:46.477293 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 15:16:46.477293 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:16:46.477293 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:46.477293 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:46.477293 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:46.477293 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:46.477293 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:46.477293 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:46.477293 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:46.477293 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:46.477293 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:46.477293 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:46.477293 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:46.477293 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:46.478242 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:46.478242 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:46.478242 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 15:16:46.478242 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 15:16:46.478242 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 15:16:46.478242 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 15:16:46.478242 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 15:16:46.478242 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 15:16:46.478242 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 15:16:46.478242 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:46.478242 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 446/903] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Aug 2 15:16:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:46.483937 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0addc27f-a83f-40c6-961b-4772ce97d6cd None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:46.500103 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78dff0-7f49-48f5-a2fd-a245b1d932ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:46.500737 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78dff0-7f49-48f5-a2fd-a245b1d932ef None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:46.501021 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78dff0-7f49-48f5-a2fd-a245b1d932ef None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:46.501302 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78dff0-7f49-48f5-a2fd-a245b1d932ef None admin] PATH_INFO: `/v3/endpoints` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:46.503755 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e78dff0-7f49-48f5-a2fd-a245b1d932ef None admin] RBAC: Adding query filter params (interface=public, service_id=1061b530c75d4111bd2d683675b646a3, region_id=RegionOne) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:46.504061 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e78dff0-7f49-48f5-a2fd-a245b1d932ef None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:46.505454 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e78dff0-7f49-48f5-a2fd-a245b1d932ef None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:46.514404 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 458/904] 10.222.0.42 () {56 vars in 1251 bytes} [Tue Aug 2 15:16:46 2022] GET /identity/v3/endpoints?service_id=1061b530c75d4111bd2d683675b646a3&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:46.520957 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78dff0-7f49-48f5-a2fd-a245b1d932ef None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:46.620750 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0addc27f-a83f-40c6-961b-4772ce97d6cd None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:46.638189 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78dff0-7f49-48f5-a2fd-a245b1d932ef None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:46.657072 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba90386-d8ec-4210-8bba-ea0e270d47b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:46.657692 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba90386-d8ec-4210-8bba-ea0e270d47b8 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:46.657972 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba90386-d8ec-4210-8bba-ea0e270d47b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:46.658246 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba90386-d8ec-4210-8bba-ea0e270d47b8 None admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:46.659034 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba90386-d8ec-4210-8bba-ea0e270d47b8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:46.659385 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba90386-d8ec-4210-8bba-ea0e270d47b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:46.661480 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba90386-d8ec-4210-8bba-ea0e270d47b8 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:46.677443 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15399d4e-64e9-4683-b9e4-ce07883600a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:46.678986 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15399d4e-64e9-4683-b9e4-ce07883600a5 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:46.679528 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15399d4e-64e9-4683-b9e4-ce07883600a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:46.680211 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15399d4e-64e9-4683-b9e4-ce07883600a5 None admin] PATH_INFO: `/v3/services` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:46.681013 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15399d4e-64e9-4683-b9e4-ce07883600a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:46.686876 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 447/905] 10.222.0.42 () {56 vars in 1149 bytes} [Tue Aug 2 15:16:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:16:46.687173 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15399d4e-64e9-4683-b9e4-ce07883600a5 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:46.688319 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba90386-d8ec-4210-8bba-ea0e270d47b8 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:46.703865 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 459/906] 10.222.0.42 () {56 vars in 1087 bytes} [Tue Aug 2 15:16:46 2022] GET /identity/v3/services => generated 1497 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:16:46.734258 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:46.812216 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba90386-d8ec-4210-8bba-ea0e270d47b8 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:46.851896 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc9330-3127-40c2-925a-d543b44a64fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:46.852598 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc9330-3127-40c2-925a-d543b44a64fc None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:46.852885 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc9330-3127-40c2-925a-d543b44a64fc None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:46.853161 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc9330-3127-40c2-925a-d543b44a64fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:46.930795 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc9330-3127-40c2-925a-d543b44a64fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:46.932354 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc9330-3127-40c2-925a-d543b44a64fc None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:46.966828 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:47.039916 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 448/907] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 2 15:16:46 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 15:16:47.045924 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15399d4e-64e9-4683-b9e4-ce07883600a5 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:47.083713 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:47.153227 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15399d4e-64e9-4683-b9e4-ce07883600a5 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:47.188802 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21ffa00-b0a0-40cb-8787-80d8389fb664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:47.189443 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ffa00-b0a0-40cb-8787-80d8389fb664 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:47.189722 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ffa00-b0a0-40cb-8787-80d8389fb664 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:47.189991 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ffa00-b0a0-40cb-8787-80d8389fb664 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:47.201270 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21ffa00-b0a0-40cb-8787-80d8389fb664 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:47.202732 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21ffa00-b0a0-40cb-8787-80d8389fb664 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:47.217736 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-a21ffa00-b0a0-40cb-8787-80d8389fb664 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:47.217736 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:47.217736 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:47.217736 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:47.217736 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:47.217736 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:47.217736 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:47.217736 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:47.217736 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:47.217736 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:47.217736 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:47.217736 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:47.217736 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:16:47.217736 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:16:47.217736 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:16:47.218657 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:16:47.218657 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:47.218657 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:47.218657 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:47.218657 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:47.218657 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:47.218657 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:47.218657 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:47.218657 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:47.218657 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:47.218657 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:47.218657 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:47.218657 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:47.218657 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:47.218657 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:47.218657 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:47.218657 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:47.219574 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:16:47.219574 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:16:47.219574 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:47.219574 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:47.219574 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 460/908] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:16:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:47.228343 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc9330-3127-40c2-925a-d543b44a64fc None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:47.339327 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc9330-3127-40c2-925a-d543b44a64fc None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:47.374706 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb10669f-357c-408c-8c2d-058e01aa813d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:47.375367 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb10669f-357c-408c-8c2d-058e01aa813d None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:47.375654 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb10669f-357c-408c-8c2d-058e01aa813d None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:47.375933 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb10669f-357c-408c-8c2d-058e01aa813d None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:47.376622 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb10669f-357c-408c-8c2d-058e01aa813d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:47.376995 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb10669f-357c-408c-8c2d-058e01aa813d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:47.378440 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb10669f-357c-408c-8c2d-058e01aa813d None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:47.379951 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:47.390989 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 449/909] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:16:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:47.397248 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21ffa00-b0a0-40cb-8787-80d8389fb664 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:47.482259 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:47.502510 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21ffa00-b0a0-40cb-8787-80d8389fb664 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:47.542082 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440714d6-421a-47be-bcfe-e8e1b17e62c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:47.542721 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440714d6-421a-47be-bcfe-e8e1b17e62c2 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:47.543003 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440714d6-421a-47be-bcfe-e8e1b17e62c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:47.543306 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440714d6-421a-47be-bcfe-e8e1b17e62c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:47.550205 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440714d6-421a-47be-bcfe-e8e1b17e62c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:47.551782 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440714d6-421a-47be-bcfe-e8e1b17e62c2 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:47.563113 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-440714d6-421a-47be-bcfe-e8e1b17e62c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:16:47.563113 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:47.563113 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:47.563113 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:47.563113 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:47.563113 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:47.563113 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:47.563113 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:47.563113 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:47.563113 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:47.563113 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:47.563113 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:47.563113 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 15:16:47.563113 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 15:16:47.563113 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 15:16:47.564087 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 15:16:47.564087 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:47.564087 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:47.564087 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:47.564087 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:47.564087 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:47.564087 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:47.564087 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:47.564087 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:47.564087 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:47.564087 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:47.564087 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:47.564087 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:47.564087 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:47.564087 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:47.564087 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:47.564087 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:47.564952 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 15:16:47.564952 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 15:16:47.564952 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 15:16:47.564952 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 15:16:47.564952 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 15:16:47.564952 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 15:16:47.564952 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:16:47.564952 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:47.564952 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 461/910] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 2 15:16:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:47.571848 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb10669f-357c-408c-8c2d-058e01aa813d None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:47.680087 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb10669f-357c-408c-8c2d-058e01aa813d None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:47.716726 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee02de7-614e-46dc-8b78-4b39e8d75050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:47.717779 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee02de7-614e-46dc-8b78-4b39e8d75050 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:47.718265 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee02de7-614e-46dc-8b78-4b39e8d75050 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:47.718750 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee02de7-614e-46dc-8b78-4b39e8d75050 None admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:47.719769 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee02de7-614e-46dc-8b78-4b39e8d75050 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:47.720281 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee02de7-614e-46dc-8b78-4b39e8d75050 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:47.721905 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee02de7-614e-46dc-8b78-4b39e8d75050 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:47.734927 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 450/911] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 2 15:16:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:47.744604 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440714d6-421a-47be-bcfe-e8e1b17e62c2 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:47.850918 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440714d6-421a-47be-bcfe-e8e1b17e62c2 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:47.886539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33a40ad-3e1a-4dca-9433-548cf2849342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:47.887550 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a40ad-3e1a-4dca-9433-548cf2849342 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:47.888093 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a40ad-3e1a-4dca-9433-548cf2849342 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:47.888832 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a40ad-3e1a-4dca-9433-548cf2849342 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:47.890495 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33a40ad-3e1a-4dca-9433-548cf2849342 None admin] RBAC: Adding query filter params (role.id=1df4511e5e2b47278b0bf4cd5acbeb38, scope.project.id=cc19d22b4cd64dd1bc89ed78155d2732, user.id=dfe8c00c0c3d4c4b8b6f36e39a3a2e71) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:47.891273 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33a40ad-3e1a-4dca-9433-548cf2849342 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:47.892943 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33a40ad-3e1a-4dca-9433-548cf2849342 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:47.900293 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 462/912] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 2 15:16:47 2022] GET /identity/v3/role_assignments?user.id=dfe8c00c0c3d4c4b8b6f36e39a3a2e71&scope.project.id=cc19d22b4cd64dd1bc89ed78155d2732&role.id=1df4511e5e2b47278b0bf4cd5acbeb38 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:48.204886 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d5cf5e-4c20-48fd-9430-b621d87bd1f0 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:48.205449 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d5cf5e-4c20-48fd-9430-b621d87bd1f0 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:48.205449 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d5cf5e-4c20-48fd-9430-b621d87bd1f0 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:48.206987 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 451/913] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:16:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:16:48.213195 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d040f0d-1757-4e51-92d8-f032c39ed927 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:48.214132 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d040f0d-1757-4e51-92d8-f032c39ed927 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:48.214635 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d040f0d-1757-4e51-92d8-f032c39ed927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:48.228554 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:48.234884 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-4d040f0d-1757-4e51-92d8-f032c39ed927 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:16:48.236465 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-4d040f0d-1757-4e51-92d8-f032c39ed927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:16:48.319540 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 463/914] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:16:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 15:16:48.346606 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d5cf5e-4c20-48fd-9430-b621d87bd1f0 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:48.411394 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:48.462520 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d5cf5e-4c20-48fd-9430-b621d87bd1f0 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:48.504614 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3b0f27-52a7-4e9b-831d-e372f5ff98e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:48.505263 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b0f27-52a7-4e9b-831d-e372f5ff98e1 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:48.505544 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b0f27-52a7-4e9b-831d-e372f5ff98e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:48.505822 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b0f27-52a7-4e9b-831d-e372f5ff98e1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:48.506446 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3b0f27-52a7-4e9b-831d-e372f5ff98e1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:48.507857 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3b0f27-52a7-4e9b-831d-e372f5ff98e1 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:48.517171 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-be3b0f27-52a7-4e9b-831d-e372f5ff98e1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 15:16:48.517171 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:48.517171 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 15:16:48.517171 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 15:16:48.517171 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 15:16:48.517171 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 15:16:48.517171 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 15:16:48.517171 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 15:16:48.517171 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 15:16:48.517171 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:48.517171 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 15:16:48.517171 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:48.517171 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:48.517171 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:48.517171 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:48.517171 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:48.517171 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:48.518260 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:48.518260 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:48.518260 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:48.518260 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:48.518260 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:48.518260 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:48.518260 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 15:16:48.518260 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 15:16:48.518260 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 15:16:48.518260 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 15:16:48.518260 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:48.518260 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:48.518260 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:48.518260 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:48.518260 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:48.518260 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:48.519112 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:48.519112 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:48.519112 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:48.519112 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:48.519112 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:48.519112 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:48.519112 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:48.519112 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:48.519112 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:48.519112 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:48.519112 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 15:16:48.519112 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 15:16:48.519112 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 15:16:48.519112 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:48.519112 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 452/915] 10.222.0.42 () {56 vars in 1126 bytes} [Tue Aug 2 15:16:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:48.525185 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d040f0d-1757-4e51-92d8-f032c39ed927 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:48.533618 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d234f-46f0-4aad-b804-6f71d5e15610 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:48.533927 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d234f-46f0-4aad-b804-6f71d5e15610 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:48.534184 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d234f-46f0-4aad-b804-6f71d5e15610 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:48.536332 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 453/916] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:16:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 15:16:48.541606 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6972620-7ebc-4768-86e5-add69a503ea2 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:48.542059 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6972620-7ebc-4768-86e5-add69a503ea2 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:48.542519 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6972620-7ebc-4768-86e5-add69a503ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:48.560935 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-c6972620-7ebc-4768-86e5-add69a503ea2 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:16:48.562386 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-c6972620-7ebc-4768-86e5-add69a503ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:16:48.643502 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 454/917] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:16:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 15:16:48.648625 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d040f0d-1757-4e51-92d8-f032c39ed927 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:48.658277 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6972620-7ebc-4768-86e5-add69a503ea2 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:48.696723 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e494b5-3359-499c-b7ca-bbc8144e9921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:48.697785 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e494b5-3359-499c-b7ca-bbc8144e9921 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:48.699076 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e494b5-3359-499c-b7ca-bbc8144e9921 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:48.699574 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e494b5-3359-499c-b7ca-bbc8144e9921 None admin] PATH_INFO: `/v3/services` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:48.704040 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e494b5-3359-499c-b7ca-bbc8144e9921 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:48.704435 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e494b5-3359-499c-b7ca-bbc8144e9921 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:48.706380 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e494b5-3359-499c-b7ca-bbc8144e9921 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:48.709289 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:48.716033 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:48.719299 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 464/918] 10.222.0.42 () {56 vars in 1122 bytes} [Tue Aug 2 15:16:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:48.721537 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e494b5-3359-499c-b7ca-bbc8144e9921 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:48.782619 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6972620-7ebc-4768-86e5-add69a503ea2 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:48.819994 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98095b0-e186-4845-86b0-7e0099f5940d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:48.821102 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98095b0-e186-4845-86b0-7e0099f5940d None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:48.821596 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98095b0-e186-4845-86b0-7e0099f5940d None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:48.822084 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98095b0-e186-4845-86b0-7e0099f5940d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:48.822933 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98095b0-e186-4845-86b0-7e0099f5940d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:48.824546 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98095b0-e186-4845-86b0-7e0099f5940d None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:48.834789 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-e98095b0-e186-4845-86b0-7e0099f5940d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 15:16:48.834789 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:48.834789 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 15:16:48.834789 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 15:16:48.834789 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 15:16:48.834789 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 15:16:48.834789 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 15:16:48.834789 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 15:16:48.834789 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 15:16:48.834789 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:48.834789 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 15:16:48.834789 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:48.834789 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:48.834789 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:48.834789 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:48.834789 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:48.834789 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:48.835867 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:48.835867 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:48.835867 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:48.835867 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:48.835867 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:48.835867 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:48.835867 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 15:16:48.835867 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 15:16:48.835867 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 15:16:48.835867 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 15:16:48.835867 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:48.835867 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:48.835867 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:48.835867 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:48.835867 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:48.835867 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:48.836709 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:48.836709 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:48.836709 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:48.836709 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:48.836709 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:48.836709 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:48.836709 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:48.836709 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:48.836709 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:48.836709 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:48.836709 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 15:16:48.836709 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 15:16:48.836709 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 15:16:48.836709 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:48.843882 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e494b5-3359-499c-b7ca-bbc8144e9921 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:48.844447 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 455/919] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Aug 2 15:16:48 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 15:16:48.845491 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98095b0-e186-4845-86b0-7e0099f5940d None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:48.880845 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15fe8c9-bdc3-48e9-b330-3c72a0422555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:48.881467 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15fe8c9-bdc3-48e9-b330-3c72a0422555 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:48.881747 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15fe8c9-bdc3-48e9-b330-3c72a0422555 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:48.882022 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15fe8c9-bdc3-48e9-b330-3c72a0422555 None admin] PATH_INFO: `/v3/services` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:48.882702 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15fe8c9-bdc3-48e9-b330-3c72a0422555 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:48.883009 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15fe8c9-bdc3-48e9-b330-3c72a0422555 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:48.884432 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15fe8c9-bdc3-48e9-b330-3c72a0422555 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:48.895162 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 465/920] 10.222.0.42 () {56 vars in 1122 bytes} [Tue Aug 2 15:16:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:16:48.896498 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15fe8c9-bdc3-48e9-b330-3c72a0422555 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:48.956436 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98095b0-e186-4845-86b0-7e0099f5940d None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:48.962306 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:48.969738 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:48.994414 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a12d8-e3a2-41bf-a832-347a1eac2894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:48.995276 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a12d8-e3a2-41bf-a832-347a1eac2894 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:48.995388 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a12d8-e3a2-41bf-a832-347a1eac2894 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:48.995611 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a12d8-e3a2-41bf-a832-347a1eac2894 None admin] PATH_INFO: `/v3/services` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:48.996292 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a12d8-e3a2-41bf-a832-347a1eac2894 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:48.996651 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a12d8-e3a2-41bf-a832-347a1eac2894 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:48.997967 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a12d8-e3a2-41bf-a832-347a1eac2894 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:49.005349 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15fe8c9-bdc3-48e9-b330-3c72a0422555 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:49.008430 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 456/921] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Aug 2 15:16:48 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:49.009659 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cedf46a-0d14-496f-9fac-376a96f6ec1e None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:49.009950 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cedf46a-0d14-496f-9fac-376a96f6ec1e None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:49.010280 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cedf46a-0d14-496f-9fac-376a96f6ec1e None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:49.011753 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 457/922] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:16:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:16:49.012277 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cedf46a-0d14-496f-9fac-376a96f6ec1e None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:49.045269 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0910295-58ce-44b3-80cc-b30f3b7aa9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:49.046143 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0910295-58ce-44b3-80cc-b30f3b7aa9b0 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:49.046614 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0910295-58ce-44b3-80cc-b30f3b7aa9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:49.046895 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0910295-58ce-44b3-80cc-b30f3b7aa9b0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:49.047699 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0910295-58ce-44b3-80cc-b30f3b7aa9b0 None admin] RBAC: Adding query filter params (interface=public, service_id=a57f74a2d7404d7c89c18336e950e79a, region_id=RegionOne) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:49.048014 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0910295-58ce-44b3-80cc-b30f3b7aa9b0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:49.049411 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0910295-58ce-44b3-80cc-b30f3b7aa9b0 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:49.061005 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 466/923] 10.222.0.42 () {56 vars in 1251 bytes} [Tue Aug 2 15:16:48 2022] GET /identity/v3/endpoints?service_id=a57f74a2d7404d7c89c18336e950e79a&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:49.062679 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048f7ec-6a45-4606-9528-a81dbaca0e19 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:49.062998 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048f7ec-6a45-4606-9528-a81dbaca0e19 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:49.063252 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048f7ec-6a45-4606-9528-a81dbaca0e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:49.083894 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-9048f7ec-6a45-4606-9528-a81dbaca0e19 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:16:49.085092 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-9048f7ec-6a45-4606-9528-a81dbaca0e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:16:49.125842 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cedf46a-0d14-496f-9fac-376a96f6ec1e None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:49.165879 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 467/924] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:16:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 15:16:49.166809 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9048f7ec-6a45-4606-9528-a81dbaca0e19 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:49.179142 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12bafa1-f495-4bd7-a0d0-bd3f6e9c96da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:49.180059 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12bafa1-f495-4bd7-a0d0-bd3f6e9c96da None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:49.180537 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12bafa1-f495-4bd7-a0d0-bd3f6e9c96da None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:49.181005 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12bafa1-f495-4bd7-a0d0-bd3f6e9c96da None admin] PATH_INFO: `/v3/services` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:49.181864 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12bafa1-f495-4bd7-a0d0-bd3f6e9c96da None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:49.182361 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12bafa1-f495-4bd7-a0d0-bd3f6e9c96da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:49.184016 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12bafa1-f495-4bd7-a0d0-bd3f6e9c96da None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:49.190114 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 458/925] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Aug 2 15:16:49 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:49.196270 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12bafa1-f495-4bd7-a0d0-bd3f6e9c96da None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:49.238435 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:49.242174 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:49.287833 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9048f7ec-6a45-4606-9528-a81dbaca0e19 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:49.310344 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12bafa1-f495-4bd7-a0d0-bd3f6e9c96da None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:49.333782 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b404599-3c46-434d-8ebb-7bf8b4d5c8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:49.334799 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b404599-3c46-434d-8ebb-7bf8b4d5c8b1 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:49.335359 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b404599-3c46-434d-8ebb-7bf8b4d5c8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:49.335737 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b404599-3c46-434d-8ebb-7bf8b4d5c8b1 None admin] PATH_INFO: `/v3/services` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:49.336423 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b404599-3c46-434d-8ebb-7bf8b4d5c8b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:49.337775 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b404599-3c46-434d-8ebb-7bf8b4d5c8b1 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:49.355248 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 468/926] 10.222.0.42 () {56 vars in 1087 bytes} [Tue Aug 2 15:16:49 2022] GET /identity/v3/services => generated 1497 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:16:49.355248 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b404599-3c46-434d-8ebb-7bf8b4d5c8b1 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:49.357663 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b1593-cadf-4b23-a21a-bf0e74d5acd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:49.358450 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b1593-cadf-4b23-a21a-bf0e74d5acd1 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:49.358821 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b1593-cadf-4b23-a21a-bf0e74d5acd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:49.359168 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b1593-cadf-4b23-a21a-bf0e74d5acd1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:49.359938 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79b1593-cadf-4b23-a21a-bf0e74d5acd1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:49.361621 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79b1593-cadf-4b23-a21a-bf0e74d5acd1 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:49.374880 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-c79b1593-cadf-4b23-a21a-bf0e74d5acd1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 15:16:49.374880 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:49.374880 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 15:16:49.374880 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 15:16:49.374880 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 15:16:49.374880 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 15:16:49.374880 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 15:16:49.374880 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 15:16:49.374880 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 15:16:49.374880 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:49.374880 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 15:16:49.374880 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:49.374880 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:49.374880 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:49.374880 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:49.374880 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:49.375957 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:49.375957 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:49.375957 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:49.375957 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:49.375957 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:49.375957 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:49.375957 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:49.375957 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 15:16:49.375957 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 15:16:49.375957 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 15:16:49.375957 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 15:16:49.375957 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:49.375957 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:49.375957 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:49.375957 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:49.375957 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:49.376788 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:49.376788 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:49.376788 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:49.376788 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:49.376788 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:49.376788 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:49.376788 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:49.376788 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:49.376788 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:49.376788 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:49.376788 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:49.376788 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 15:16:49.376788 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 15:16:49.376788 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 15:16:49.376788 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:49.376788 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 459/927] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Aug 2 15:16:49 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:49.388336 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b1593-cadf-4b23-a21a-bf0e74d5acd1 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:49.483295 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b404599-3c46-434d-8ebb-7bf8b4d5c8b1 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:49.511843 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b1593-cadf-4b23-a21a-bf0e74d5acd1 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:49.514203 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:49.515697 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:49.532794 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682df3f-5247-4b21-ac6c-52673b8f135f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:49.533427 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682df3f-5247-4b21-ac6c-52673b8f135f None admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:49.533708 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682df3f-5247-4b21-ac6c-52673b8f135f None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:49.533982 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682df3f-5247-4b21-ac6c-52673b8f135f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:49.534692 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0682df3f-5247-4b21-ac6c-52673b8f135f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:49.536631 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0682df3f-5247-4b21-ac6c-52673b8f135f None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:49.558362 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649f93e0-f9ac-473b-a2b2-2b64c736bb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:49.558989 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f93e0-f9ac-473b-a2b2-2b64c736bb89 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:49.559096 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 469/928] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:16:49 2022] POST /identity/v3/endpoints => generated 346 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:16:49.559343 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f93e0-f9ac-473b-a2b2-2b64c736bb89 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:49.559583 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f93e0-f9ac-473b-a2b2-2b64c736bb89 None admin] PATH_INFO: `/v3/services` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:49.560268 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649f93e0-f9ac-473b-a2b2-2b64c736bb89 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:49.560578 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649f93e0-f9ac-473b-a2b2-2b64c736bb89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:49.567992 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649f93e0-f9ac-473b-a2b2-2b64c736bb89 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:49.579010 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 460/929] 10.222.0.42 () {56 vars in 1126 bytes} [Tue Aug 2 15:16:49 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:49.580822 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682df3f-5247-4b21-ac6c-52673b8f135f None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:49.705667 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682df3f-5247-4b21-ac6c-52673b8f135f None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:49.745808 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d0856-5184-442d-b7f9-9dec62910faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:49.746801 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d0856-5184-442d-b7f9-9dec62910faa None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:49.747298 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d0856-5184-442d-b7f9-9dec62910faa None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:49.747783 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d0856-5184-442d-b7f9-9dec62910faa None admin] PATH_INFO: `/v3/services` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:49.748653 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787d0856-5184-442d-b7f9-9dec62910faa None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:49.749140 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787d0856-5184-442d-b7f9-9dec62910faa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:49.751966 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787d0856-5184-442d-b7f9-9dec62910faa None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:49.763413 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 470/930] 10.222.0.42 () {56 vars in 1126 bytes} [Tue Aug 2 15:16:49 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:49.766132 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649f93e0-f9ac-473b-a2b2-2b64c736bb89 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:49.877710 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649f93e0-f9ac-473b-a2b2-2b64c736bb89 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:49.912326 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676d4289-8238-4f47-8f6a-766ed3fc962b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:49.912957 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d4289-8238-4f47-8f6a-766ed3fc962b None admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:49.913237 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d4289-8238-4f47-8f6a-766ed3fc962b None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:49.913517 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d4289-8238-4f47-8f6a-766ed3fc962b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:49.914478 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676d4289-8238-4f47-8f6a-766ed3fc962b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:49.915995 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676d4289-8238-4f47-8f6a-766ed3fc962b None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:49.940722 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 461/931] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:16:49 2022] POST /identity/v3/endpoints => generated 347 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:16:49.986283 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6dfdd-40bb-42d4-85e2-329313b3abd5 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:49.986628 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6dfdd-40bb-42d4-85e2-329313b3abd5 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:49.986835 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6dfdd-40bb-42d4-85e2-329313b3abd5 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:49.988638 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 471/932] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:16:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:16:49.994333 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a7f94-4d69-4693-81b4-f053d30ada82 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:49.994661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a7f94-4d69-4693-81b4-f053d30ada82 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:49.994896 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a7f94-4d69-4693-81b4-f053d30ada82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:50.015270 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-e71a7f94-4d69-4693-81b4-f053d30ada82 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:16:50.016505 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-e71a7f94-4d69-4693-81b4-f053d30ada82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:16:50.038181 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:50.101706 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 462/933] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:16:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 15:16:50.123290 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc6dfdd-40bb-42d4-85e2-329313b3abd5 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:50.178659 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:50.248283 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc6dfdd-40bb-42d4-85e2-329313b3abd5 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:50.285958 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2197de-2552-4a7d-8dc0-381b0a65721b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:50.286511 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2197de-2552-4a7d-8dc0-381b0a65721b None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:50.286789 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2197de-2552-4a7d-8dc0-381b0a65721b None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:50.287058 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2197de-2552-4a7d-8dc0-381b0a65721b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:50.297783 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2197de-2552-4a7d-8dc0-381b0a65721b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:16:50.303132 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-fe2197de-2552-4a7d-8dc0-381b0a65721b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 15:16:50.303132 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:50.303132 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:50.303132 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:50.303132 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:50.303132 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:50.303132 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:50.303132 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:50.303132 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:50.303132 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:50.303132 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:50.303132 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:50.303132 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:16:50.303132 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:16:50.303132 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:16:50.303132 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:16:50.304087 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:16:50.304087 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:16:50.304087 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:16:50.304087 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:16:50.304087 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:50.304087 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:50.304087 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:50.304087 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:50.304087 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:50.304087 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:50.304087 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:50.304087 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:50.304087 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:50.304087 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:50.304087 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:50.304087 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:50.304902 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:50.304902 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:50.304902 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:50.304902 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:50.304902 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:16:50.304902 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:16:50.304902 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:16:50.304902 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:16:50.304902 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:16:50.304902 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:16:50.304902 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 15:16:50.304902 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:50.304902 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 472/934] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Aug 2 15:16:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:50.310395 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a7f94-4d69-4693-81b4-f053d30ada82 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:50.418825 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a7f94-4d69-4693-81b4-f053d30ada82 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:50.455551 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c6d383-4c54-43f3-a5a8-92f3625e3574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:50.456183 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6d383-4c54-43f3-a5a8-92f3625e3574 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:50.456469 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6d383-4c54-43f3-a5a8-92f3625e3574 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:50.457287 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6d383-4c54-43f3-a5a8-92f3625e3574 None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:50.458060 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c6d383-4c54-43f3-a5a8-92f3625e3574 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:50.458370 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c6d383-4c54-43f3-a5a8-92f3625e3574 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:50.459783 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c6d383-4c54-43f3-a5a8-92f3625e3574 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:50.469018 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 463/935] 10.222.0.42 () {56 vars in 1115 bytes} [Tue Aug 2 15:16:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:50.474873 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2197de-2552-4a7d-8dc0-381b0a65721b None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:50.581182 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2197de-2552-4a7d-8dc0-381b0a65721b None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:50.584159 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:50.617142 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c45052c-bde1-4230-8217-a73d1b45786f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:50.617791 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45052c-bde1-4230-8217-a73d1b45786f None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:50.618090 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45052c-bde1-4230-8217-a73d1b45786f None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:50.618360 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45052c-bde1-4230-8217-a73d1b45786f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:50.630215 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c45052c-bde1-4230-8217-a73d1b45786f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:50.631706 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c45052c-bde1-4230-8217-a73d1b45786f None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:50.646308 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-8c45052c-bde1-4230-8217-a73d1b45786f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:50.646308 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:50.646308 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:50.646308 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:50.646308 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:50.646308 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:50.646308 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:50.646308 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:50.646308 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:50.646308 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:50.646308 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:50.646308 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:50.646308 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:16:50.646308 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:16:50.646308 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:16:50.648481 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:16:50.648481 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:50.648481 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:50.648481 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:50.648481 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:50.648481 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:50.648481 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:50.648481 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:50.648481 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:50.648481 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:50.648481 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:50.648481 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:50.648481 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:50.648481 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:50.648481 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:50.648481 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:50.648481 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:50.650607 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:16:50.650607 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:16:50.650607 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:50.650607 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:50.650607 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 473/936] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:16:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:50.655464 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c6d383-4c54-43f3-a5a8-92f3625e3574 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:50.674035 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:50.779023 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c6d383-4c54-43f3-a5a8-92f3625e3574 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:50.814996 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f426e-1bd7-4938-b454-c4677aff4f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:50.815712 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f426e-1bd7-4938-b454-c4677aff4f64 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:50.816509 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f426e-1bd7-4938-b454-c4677aff4f64 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:50.816790 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f426e-1bd7-4938-b454-c4677aff4f64 None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:50.817476 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f426e-1bd7-4938-b454-c4677aff4f64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:50.817783 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f426e-1bd7-4938-b454-c4677aff4f64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:50.819155 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f426e-1bd7-4938-b454-c4677aff4f64 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:50.831998 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 464/937] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:16:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:50.837547 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c45052c-bde1-4230-8217-a73d1b45786f None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:50.945328 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c45052c-bde1-4230-8217-a73d1b45786f None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:50.982206 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1903a8c7-f37e-4d8b-8f4c-ba20ec546c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:50.983711 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903a8c7-f37e-4d8b-8f4c-ba20ec546c32 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:50.984425 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903a8c7-f37e-4d8b-8f4c-ba20ec546c32 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:50.985071 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903a8c7-f37e-4d8b-8f4c-ba20ec546c32 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:50.997886 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1903a8c7-f37e-4d8b-8f4c-ba20ec546c32 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:51.000592 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1903a8c7-f37e-4d8b-8f4c-ba20ec546c32 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:51.017065 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-1903a8c7-f37e-4d8b-8f4c-ba20ec546c32 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 15:16:51.017065 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:51.017065 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:51.017065 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:51.017065 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:51.017065 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:51.017065 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:51.017065 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:51.017065 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:51.017065 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:51.017065 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:51.017065 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:51.017065 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 15:16:51.017065 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 15:16:51.017065 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 15:16:51.017065 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 15:16:51.018079 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:51.018079 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:51.018079 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 15:16:51.018079 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:16:51.018079 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 15:16:51.018079 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:16:51.018079 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:51.018079 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:51.018079 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:51.018079 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:51.018079 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:51.018079 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:51.018079 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:51.018079 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:51.018079 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:51.018079 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:51.018079 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:51.018079 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:51.018996 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:51.018996 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:51.018996 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 15:16:51.018996 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 15:16:51.018996 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 15:16:51.018996 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 15:16:51.018996 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 15:16:51.018996 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 15:16:51.018996 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 15:16:51.018996 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:51.022676 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 474/938] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Aug 2 15:16:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:51.029798 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f426e-1bd7-4938-b454-c4677aff4f64 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:51.108410 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:51.140524 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f426e-1bd7-4938-b454-c4677aff4f64 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:51.177724 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b500ba-c699-43a7-9f1d-4c452d10bbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:51.178355 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b500ba-c699-43a7-9f1d-4c452d10bbcf None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:51.178641 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b500ba-c699-43a7-9f1d-4c452d10bbcf None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:51.178922 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b500ba-c699-43a7-9f1d-4c452d10bbcf None admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:51.179750 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b500ba-c699-43a7-9f1d-4c452d10bbcf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:51.180063 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b500ba-c699-43a7-9f1d-4c452d10bbcf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:51.181502 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b500ba-c699-43a7-9f1d-4c452d10bbcf None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:51.201795 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 465/939] 10.222.0.42 () {56 vars in 1149 bytes} [Tue Aug 2 15:16:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:51.207642 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1903a8c7-f37e-4d8b-8f4c-ba20ec546c32 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:51.222365 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:51.319809 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1903a8c7-f37e-4d8b-8f4c-ba20ec546c32 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:51.356263 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda00b89-4285-43d7-add3-292121f57d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:51.356899 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda00b89-4285-43d7-add3-292121f57d01 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:51.357179 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda00b89-4285-43d7-add3-292121f57d01 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:51.357457 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda00b89-4285-43d7-add3-292121f57d01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:51.369186 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda00b89-4285-43d7-add3-292121f57d01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:51.370702 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda00b89-4285-43d7-add3-292121f57d01 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:51.386360 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-fda00b89-4285-43d7-add3-292121f57d01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:51.386360 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:51.386360 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:51.386360 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:51.386360 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:51.386360 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:51.386360 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:51.386360 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:51.386360 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:51.386360 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:51.386360 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:51.386360 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:51.386360 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:16:51.386360 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:16:51.386360 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:16:51.387301 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:16:51.387301 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:51.387301 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:51.387301 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:51.387301 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:51.387301 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:51.387301 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:51.387301 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:51.387301 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:51.387301 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:51.387301 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:51.387301 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:51.387301 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:51.387301 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:51.387301 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:51.387301 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:51.387301 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:51.388208 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:16:51.388208 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:16:51.388208 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:51.388208 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:51.388208 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 475/940] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:16:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:51.393634 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b500ba-c699-43a7-9f1d-4c452d10bbcf None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:51.497080 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b500ba-c699-43a7-9f1d-4c452d10bbcf None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:51.529325 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:51.533538 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf1a37c-ec6d-4cff-a459-08b5cf1a1dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:51.534337 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1a37c-ec6d-4cff-a459-08b5cf1a1dc1 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:51.535251 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1a37c-ec6d-4cff-a459-08b5cf1a1dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:51.535546 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1a37c-ec6d-4cff-a459-08b5cf1a1dc1 None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:51.536232 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf1a37c-ec6d-4cff-a459-08b5cf1a1dc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:51.536591 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf1a37c-ec6d-4cff-a459-08b5cf1a1dc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:51.538009 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf1a37c-ec6d-4cff-a459-08b5cf1a1dc1 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:51.551156 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 466/941] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:16:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:51.552544 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058dc6bb-44bf-4606-968e-dbeb3026d498 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:51.552827 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058dc6bb-44bf-4606-968e-dbeb3026d498 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:51.553099 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058dc6bb-44bf-4606-968e-dbeb3026d498 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:51.554630 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 476/942] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:16:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:16:51.556658 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf1a37c-ec6d-4cff-a459-08b5cf1a1dc1 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:51.559517 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8fe243-b0b5-4164-8852-16649ef5bbee None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:51.559804 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8fe243-b0b5-4164-8852-16649ef5bbee None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:51.560082 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8fe243-b0b5-4164-8852-16649ef5bbee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:51.578210 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-ac8fe243-b0b5-4164-8852-16649ef5bbee None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:16:51.579563 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-ac8fe243-b0b5-4164-8852-16649ef5bbee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:16:51.652788 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:51.668679 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 477/943] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:16:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 15:16:51.683960 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf1a37c-ec6d-4cff-a459-08b5cf1a1dc1 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:51.695324 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8fe243-b0b5-4164-8852-16649ef5bbee None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:51.725049 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cba636-498c-421f-8396-e271893b5ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:51.726185 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cba636-498c-421f-8396-e271893b5ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:51.726789 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cba636-498c-421f-8396-e271893b5ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:51.727303 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cba636-498c-421f-8396-e271893b5ea5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:51.735323 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cba636-498c-421f-8396-e271893b5ea5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:51.737305 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cba636-498c-421f-8396-e271893b5ea5 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:51.751429 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-83cba636-498c-421f-8396-e271893b5ea5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:16:51.751429 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:51.751429 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:51.751429 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:51.751429 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:51.751429 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:51.751429 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:51.751429 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:51.751429 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:51.751429 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:51.751429 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:51.751429 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:51.751429 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 15:16:51.751429 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 15:16:51.751429 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 15:16:51.752422 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 15:16:51.752422 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:51.752422 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:51.752422 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:51.752422 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:51.752422 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:51.752422 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:51.752422 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:51.752422 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:51.752422 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:51.752422 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:51.752422 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:51.752422 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:51.752422 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:51.752422 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:51.752422 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:51.752422 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:51.753361 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 15:16:51.753361 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 15:16:51.753361 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 15:16:51.753361 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 15:16:51.753361 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 15:16:51.753361 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 15:16:51.753361 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:16:51.753361 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:51.756099 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 467/944] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 2 15:16:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:51.762163 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cba636-498c-421f-8396-e271893b5ea5 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:51.817786 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8fe243-b0b5-4164-8852-16649ef5bbee None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:51.822717 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:51.856380 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cfb3c4-b4b7-4f83-8b03-c35da3b1cd6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:51.857069 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cfb3c4-b4b7-4f83-8b03-c35da3b1cd6d None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:51.857285 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cfb3c4-b4b7-4f83-8b03-c35da3b1cd6d None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:51.857563 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cfb3c4-b4b7-4f83-8b03-c35da3b1cd6d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:51.858186 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cfb3c4-b4b7-4f83-8b03-c35da3b1cd6d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:51.859595 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cfb3c4-b4b7-4f83-8b03-c35da3b1cd6d None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:51.869828 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-e8cfb3c4-b4b7-4f83-8b03-c35da3b1cd6d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 15:16:51.869828 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:51.869828 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 15:16:51.869828 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 15:16:51.869828 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 15:16:51.869828 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 15:16:51.869828 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 15:16:51.869828 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 15:16:51.869828 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 15:16:51.869828 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:51.869828 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 15:16:51.869828 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:51.869828 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:51.869828 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:51.869828 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:51.869828 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:51.869828 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:51.873095 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:51.873095 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:51.873095 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:51.873095 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:51.873095 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:51.873095 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:51.873095 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 15:16:51.873095 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 15:16:51.873095 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 15:16:51.873095 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 15:16:51.873095 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:51.873095 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:51.873095 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:51.873095 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:51.873095 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:51.873095 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:51.875700 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:51.875700 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:51.875700 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:51.875700 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:51.875700 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:51.875700 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:51.875700 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:51.875700 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:51.875700 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:51.875700 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:51.875700 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 15:16:51.875700 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 15:16:51.875700 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 15:16:51.875700 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:51.875700 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 478/945] 10.222.0.42 () {56 vars in 1126 bytes} [Tue Aug 2 15:16:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 15:16:51.878237 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b00ff-29a2-45e1-949b-d7cf0f06f8b5 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:51.878237 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b00ff-29a2-45e1-949b-d7cf0f06f8b5 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:51.878237 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b00ff-29a2-45e1-949b-d7cf0f06f8b5 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:51.882820 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 479/946] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:16:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:16:51.882820 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b00ff-29a2-45e1-949b-d7cf0f06f8b5 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:51.883109 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cba636-498c-421f-8396-e271893b5ea5 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:51.919560 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9887b9e8-4743-4669-ab1e-c94f23507b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:51.920110 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887b9e8-4743-4669-ab1e-c94f23507b51 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:51.920396 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887b9e8-4743-4669-ab1e-c94f23507b51 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:51.920672 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887b9e8-4743-4669-ab1e-c94f23507b51 None admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:51.921419 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9887b9e8-4743-4669-ab1e-c94f23507b51 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:51.921727 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9887b9e8-4743-4669-ab1e-c94f23507b51 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:51.923610 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9887b9e8-4743-4669-ab1e-c94f23507b51 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:51.937703 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 468/947] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 2 15:16:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:16:51.938948 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32bfd81-fc50-48c0-be23-40ad57ab9cfa None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:51.939251 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32bfd81-fc50-48c0-be23-40ad57ab9cfa None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:51.939528 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32bfd81-fc50-48c0-be23-40ad57ab9cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:51.947495 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:51.957726 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-c32bfd81-fc50-48c0-be23-40ad57ab9cfa None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:16:51.958896 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-c32bfd81-fc50-48c0-be23-40ad57ab9cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:16:51.996006 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b00ff-29a2-45e1-949b-d7cf0f06f8b5 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:52.028298 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 469/948] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:16:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 15:16:52.029454 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32bfd81-fc50-48c0-be23-40ad57ab9cfa None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:52.037804 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f300fc-dbb3-4d20-9565-793d49413bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:52.039454 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f300fc-dbb3-4d20-9565-793d49413bed None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:52.039882 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f300fc-dbb3-4d20-9565-793d49413bed None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:52.040290 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f300fc-dbb3-4d20-9565-793d49413bed None admin] PATH_INFO: `/v3/services` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:52.041563 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f300fc-dbb3-4d20-9565-793d49413bed None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:52.042028 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f300fc-dbb3-4d20-9565-793d49413bed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:52.044282 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f300fc-dbb3-4d20-9565-793d49413bed None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:52.056099 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 480/949] 10.222.0.42 () {56 vars in 1122 bytes} [Tue Aug 2 15:16:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:52.057382 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f300fc-dbb3-4d20-9565-793d49413bed None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:52.080090 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:52.148707 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32bfd81-fc50-48c0-be23-40ad57ab9cfa None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:52.175990 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f300fc-dbb3-4d20-9565-793d49413bed None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:52.185096 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb3eba4-ae58-4235-ba49-5aebc687b147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:52.185758 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3eba4-ae58-4235-ba49-5aebc687b147 None admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:52.186037 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3eba4-ae58-4235-ba49-5aebc687b147 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:52.186317 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3eba4-ae58-4235-ba49-5aebc687b147 None admin] PATH_INFO: `/v3/projects/cc19d22b4cd64dd1bc89ed78155d2732/users/dfe8c00c0c3d4c4b8b6f36e39a3a2e71/roles/1df4511e5e2b47278b0bf4cd5acbeb38` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:52.188525 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb3eba4-ae58-4235-ba49-5aebc687b147 None admin] RBAC: Authorizing `identity:create_grant(project_id=cc19d22b4cd64dd1bc89ed78155d2732, user_id=dfe8c00c0c3d4c4b8b6f36e39a3a2e71, role_id=1df4511e5e2b47278b0bf4cd5acbeb38)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:52.189945 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb3eba4-ae58-4235-ba49-5aebc687b147 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:52.196579 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:52.204246 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 470/950] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 2 15:16:52 2022] PUT /identity/v3/projects/cc19d22b4cd64dd1bc89ed78155d2732/users/dfe8c00c0c3d4c4b8b6f36e39a3a2e71/roles/1df4511e5e2b47278b0bf4cd5acbeb38 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:16:52.205057 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb3eba4-ae58-4235-ba49-5aebc687b147 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:52.213026 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d4370f-444e-422f-92e7-3c59953bb41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:52.213923 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d4370f-444e-422f-92e7-3c59953bb41f None admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:52.214353 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d4370f-444e-422f-92e7-3c59953bb41f None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:52.214637 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d4370f-444e-422f-92e7-3c59953bb41f None admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:52.215366 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d4370f-444e-422f-92e7-3c59953bb41f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:52.216870 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d4370f-444e-422f-92e7-3c59953bb41f None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:52.220264 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: WARNING keystone.server.flask.common [None req-c0d4370f-444e-422f-92e7-3c59953bb41f None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 02 15:16:52.241997 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.sql.core [None req-c0d4370f-444e-422f-92e7-3c59953bb41f None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 02 15:16:52.241997 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 02 15:16:52.241997 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [parameters: {'id': 'e738cca9a8b2480aaf96eada2d9a7dfb', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 02 15:16:52.241997 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80359) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 02 15:16:52.260515 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-c0d4370f-444e-422f-92e7-3c59953bb41f None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e738cca9a8b2480aaf96eada2d9a7dfb.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e738cca9a8b2480aaf96eada2d9a7dfb. Aug 02 15:16:52.260515 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:52.260515 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 02 15:16:52.260515 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 02 15:16:52.260515 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 02 15:16:52.260515 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 02 15:16:52.260515 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 02 15:16:52.260515 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application result = self._query(query) Aug 02 15:16:52.260515 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 02 15:16:52.260515 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application conn.query(q) Aug 02 15:16:52.260515 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 02 15:16:52.260515 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 02 15:16:52.260515 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 02 15:16:52.261427 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application result.read() Aug 02 15:16:52.261427 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 02 15:16:52.261427 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 02 15:16:52.261427 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 02 15:16:52.261427 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 02 15:16:52.261427 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 02 15:16:52.261427 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 02 15:16:52.261427 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 02 15:16:52.261427 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 02 15:16:52.261427 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 02 15:16:52.261427 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:52.261427 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 02 15:16:52.261427 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:52.261427 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:52.261427 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 02 15:16:52.261427 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 02 15:16:52.261427 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 02 15:16:52.261427 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 02 15:16:52.262418 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 02 15:16:52.262418 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application next(self.gen) Aug 02 15:16:52.262418 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 02 15:16:52.262418 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application yield resource Aug 02 15:16:52.262418 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 02 15:16:52.262418 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application next(self.gen) Aug 02 15:16:52.262418 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 02 15:16:52.262418 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self.session.rollback() Aug 02 15:16:52.262418 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 15:16:52.262418 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self.force_reraise() Aug 02 15:16:52.262418 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 15:16:52.262418 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise self.value Aug 02 15:16:52.262418 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 02 15:16:52.262418 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 02 15:16:52.262418 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 02 15:16:52.262418 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application session.commit() Aug 02 15:16:52.262418 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 02 15:16:52.263358 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 02 15:16:52.263358 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 02 15:16:52.263358 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._prepare_impl() Aug 02 15:16:52.263358 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 02 15:16:52.263358 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self.session.flush() Aug 02 15:16:52.263358 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 02 15:16:52.263358 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._flush(objects) Aug 02 15:16:52.263358 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 02 15:16:52.263358 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 02 15:16:52.263358 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 02 15:16:52.263358 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application compat.raise_( Aug 02 15:16:52.263358 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 02 15:16:52.263358 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception Aug 02 15:16:52.263358 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 02 15:16:52.263358 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application flush_context.execute() Aug 02 15:16:52.263358 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 02 15:16:52.263358 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rec.execute(self) Aug 02 15:16:52.264290 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 02 15:16:52.264290 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 02 15:16:52.264290 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 02 15:16:52.264290 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 02 15:16:52.264290 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 02 15:16:52.264290 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 02 15:16:52.264290 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 02 15:16:52.264290 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 02 15:16:52.264290 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 02 15:16:52.264290 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 02 15:16:52.264290 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 02 15:16:52.264290 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 02 15:16:52.264290 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 02 15:16:52.264290 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 02 15:16:52.264290 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 02 15:16:52.266923 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 02 15:16:52.266923 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 02 15:16:52.266923 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception Aug 02 15:16:52.266923 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 02 15:16:52.266923 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 02 15:16:52.266923 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 02 15:16:52.266923 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 02 15:16:52.266923 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 02 15:16:52.266923 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application result = self._query(query) Aug 02 15:16:52.266923 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 02 15:16:52.266923 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application conn.query(q) Aug 02 15:16:52.266923 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 02 15:16:52.266923 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 02 15:16:52.266923 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 02 15:16:52.266923 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application result.read() Aug 02 15:16:52.266923 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 02 15:16:52.266923 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 02 15:16:52.268778 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 02 15:16:52.268778 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 02 15:16:52.268778 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 02 15:16:52.268778 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 02 15:16:52.268778 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 02 15:16:52.268778 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 02 15:16:52.268778 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 02 15:16:52.268778 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 02 15:16:52.268778 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [parameters: {'id': 'e738cca9a8b2480aaf96eada2d9a7dfb', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 02 15:16:52.268778 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 02 15:16:52.268778 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:52.268778 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 15:16:52.268778 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:52.268778 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:52.268778 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 02 15:16:52.270146 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 02 15:16:52.270146 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 02 15:16:52.270146 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 02 15:16:52.270146 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 02 15:16:52.270146 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:52.270146 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 15:16:52.270146 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:52.270146 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:52.270146 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:52.270146 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:52.270146 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:52.270146 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:52.270146 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:52.270146 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:52.270146 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:52.270146 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:52.270146 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:52.271764 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:52.271764 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 02 15:16:52.271764 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 02 15:16:52.271764 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:52.271764 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:52.271764 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 02 15:16:52.271764 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 02 15:16:52.271764 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e738cca9a8b2480aaf96eada2d9a7dfb. Aug 02 15:16:52.271764 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:52.271764 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 481/951] 10.222.0.42 () {60 vars in 1140 bytes} [Tue Aug 2 15:16:52 2022] POST /identity/v3/projects => generated 262 bytes in 206 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:52.271764 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e36f1-b7ac-4ff8-8695-e5309f7b102a None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:52.271764 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e36f1-b7ac-4ff8-8695-e5309f7b102a None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:52.272444 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e36f1-b7ac-4ff8-8695-e5309f7b102a None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:52.272444 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 482/952] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:16:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:16:52.272444 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96e36f1-b7ac-4ff8-8695-e5309f7b102a None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:52.329412 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:52.333567 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb3eba4-ae58-4235-ba49-5aebc687b147 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:52.379312 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9587ac1-52d7-4672-889e-842849bda724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:52.380048 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9587ac1-52d7-4672-889e-842849bda724 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:52.380398 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9587ac1-52d7-4672-889e-842849bda724 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:52.380708 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9587ac1-52d7-4672-889e-842849bda724 None admin] PATH_INFO: `/v3/services` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:52.381502 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9587ac1-52d7-4672-889e-842849bda724 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:52.381870 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9587ac1-52d7-4672-889e-842849bda724 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:52.383498 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9587ac1-52d7-4672-889e-842849bda724 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:52.389559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 471/953] 10.222.0.42 () {56 vars in 1122 bytes} [Tue Aug 2 15:16:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:52.392409 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042a3d1-7177-4198-837d-4e835ca51298 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:52.392409 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042a3d1-7177-4198-837d-4e835ca51298 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:52.392409 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042a3d1-7177-4198-837d-4e835ca51298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:52.393911 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96e36f1-b7ac-4ff8-8695-e5309f7b102a None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:52.412653 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-1042a3d1-7177-4198-837d-4e835ca51298 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:16:52.414343 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-1042a3d1-7177-4198-837d-4e835ca51298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:16:52.431709 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7d676a-3ca7-4fb9-9a29-8026046c1ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:52.432278 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d676a-3ca7-4fb9-9a29-8026046c1ff2 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:52.432557 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d676a-3ca7-4fb9-9a29-8026046c1ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:52.432865 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d676a-3ca7-4fb9-9a29-8026046c1ff2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:52.440823 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7d676a-3ca7-4fb9-9a29-8026046c1ff2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:52.444052 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7d676a-3ca7-4fb9-9a29-8026046c1ff2 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:52.455729 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-1d7d676a-3ca7-4fb9-9a29-8026046c1ff2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:16:52.455729 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:52.455729 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:52.455729 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:52.455729 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:52.455729 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:52.455729 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:52.455729 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:52.455729 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:52.455729 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:52.455729 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:52.455729 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:52.455729 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 15:16:52.455729 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 15:16:52.455729 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 15:16:52.457476 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 15:16:52.457476 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:52.457476 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:52.457476 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:52.457476 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:52.457476 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:52.457476 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:52.457476 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:52.457476 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:52.457476 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:52.457476 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:52.457476 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:52.457476 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:52.457476 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:52.457476 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:52.457476 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:52.457476 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:52.458642 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 15:16:52.458642 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 15:16:52.458642 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 15:16:52.458642 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 15:16:52.458642 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 15:16:52.458642 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 15:16:52.458642 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:16:52.458642 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:52.460000 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 483/954] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 2 15:16:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:52.464511 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7d676a-3ca7-4fb9-9a29-8026046c1ff2 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:52.494480 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 472/955] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:16:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 15:16:52.500182 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1042a3d1-7177-4198-837d-4e835ca51298 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:52.517731 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:52.592744 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7d676a-3ca7-4fb9-9a29-8026046c1ff2 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:52.614085 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:52.621631 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1042a3d1-7177-4198-837d-4e835ca51298 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:52.634413 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e0a81-d1a9-42b1-aca8-9bc994564618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:52.635273 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e0a81-d1a9-42b1-aca8-9bc994564618 None admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:52.635713 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e0a81-d1a9-42b1-aca8-9bc994564618 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:52.636059 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e0a81-d1a9-42b1-aca8-9bc994564618 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:52.637067 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868e0a81-d1a9-42b1-aca8-9bc994564618 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:52.638776 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868e0a81-d1a9-42b1-aca8-9bc994564618 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:52.662900 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a2d7ab-08e1-4e6f-9b39-b6f61970c647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:52.664177 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2d7ab-08e1-4e6f-9b39-b6f61970c647 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:52.664319 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 484/956] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:16:52 2022] POST /identity/v3/endpoints => generated 349 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:16:52.665179 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e0a81-d1a9-42b1-aca8-9bc994564618 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:52.676715 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2d7ab-08e1-4e6f-9b39-b6f61970c647 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:52.677400 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2d7ab-08e1-4e6f-9b39-b6f61970c647 None admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:52.678488 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a2d7ab-08e1-4e6f-9b39-b6f61970c647 None admin] RBAC: Adding query filter params (name=service) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:52.679203 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a2d7ab-08e1-4e6f-9b39-b6f61970c647 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:52.681577 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a2d7ab-08e1-4e6f-9b39-b6f61970c647 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:52.703481 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 473/957] 10.222.0.42 () {56 vars in 1112 bytes} [Tue Aug 2 15:16:52 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:52.787717 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:52.806299 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e0a81-d1a9-42b1-aca8-9bc994564618 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:52.848729 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3907641-281a-4c74-837d-16a8780d34c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:52.849496 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3907641-281a-4c74-837d-16a8780d34c2 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:52.849846 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3907641-281a-4c74-837d-16a8780d34c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:52.850191 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3907641-281a-4c74-837d-16a8780d34c2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:52.850908 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3907641-281a-4c74-837d-16a8780d34c2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:52.852465 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3907641-281a-4c74-837d-16a8780d34c2 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:52.863609 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-c3907641-281a-4c74-837d-16a8780d34c2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 15:16:52.863609 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:52.863609 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 15:16:52.863609 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 15:16:52.863609 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 15:16:52.863609 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 15:16:52.863609 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 15:16:52.863609 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 15:16:52.863609 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 15:16:52.863609 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:52.863609 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 15:16:52.863609 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:52.863609 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:52.863609 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:52.863609 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:52.863609 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:52.863609 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:52.864831 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:52.864831 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:52.864831 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:52.864831 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:52.864831 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:52.864831 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:52.864831 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 15:16:52.864831 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 15:16:52.864831 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 15:16:52.864831 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 15:16:52.864831 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:52.864831 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:52.864831 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:52.864831 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:52.864831 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:52.864831 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:52.865860 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:52.865860 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:52.865860 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:52.865860 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:52.865860 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:52.865860 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:52.865860 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:52.865860 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:52.865860 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:52.865860 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:52.865860 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 15:16:52.865860 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 15:16:52.865860 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 15:16:52.865860 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:52.869855 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 485/958] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 2 15:16:52 2022] GET /identity/v3/services/compute => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:52.874735 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a2d7ab-08e1-4e6f-9b39-b6f61970c647 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:52.987968 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a2d7ab-08e1-4e6f-9b39-b6f61970c647 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:53.023805 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beaef7d-d75b-42ab-a408-de6c2f10fb02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:53.024495 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beaef7d-d75b-42ab-a408-de6c2f10fb02 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:53.024786 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beaef7d-d75b-42ab-a408-de6c2f10fb02 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:53.025066 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beaef7d-d75b-42ab-a408-de6c2f10fb02 None admin] PATH_INFO: `/v3/services` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:53.025755 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beaef7d-d75b-42ab-a408-de6c2f10fb02 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:53.026066 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beaef7d-d75b-42ab-a408-de6c2f10fb02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:53.027499 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beaef7d-d75b-42ab-a408-de6c2f10fb02 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:53.033146 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 474/959] 10.222.0.42 () {56 vars in 1112 bytes} [Tue Aug 2 15:16:52 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:53.039824 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3907641-281a-4c74-837d-16a8780d34c2 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:53.155244 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3907641-281a-4c74-837d-16a8780d34c2 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:53.185723 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60d7ce-ba7b-4072-9cfc-23f18a78f0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:53.186347 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60d7ce-ba7b-4072-9cfc-23f18a78f0ae None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:53.186629 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60d7ce-ba7b-4072-9cfc-23f18a78f0ae None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:53.186904 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60d7ce-ba7b-4072-9cfc-23f18a78f0ae None admin] PATH_INFO: `/v3/services` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:53.187615 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed60d7ce-ba7b-4072-9cfc-23f18a78f0ae None admin] RBAC: Adding query filter params (type=compute) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:53.187919 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed60d7ce-ba7b-4072-9cfc-23f18a78f0ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:53.189302 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed60d7ce-ba7b-4072-9cfc-23f18a78f0ae None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:53.199362 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 486/960] 10.222.0.42 () {56 vars in 1112 bytes} [Tue Aug 2 15:16:53 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:54.343128 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532b24d-d1d9-41c0-94b2-d696133c78a7 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:54.343685 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532b24d-d1d9-41c0-94b2-d696133c78a7 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:54.343991 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532b24d-d1d9-41c0-94b2-d696133c78a7 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:54.345704 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 475/961] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:16:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:16:54.351067 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0afdcbe-a0ac-455d-b2f7-ec8dc3ee83e6 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:54.351529 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0afdcbe-a0ac-455d-b2f7-ec8dc3ee83e6 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:54.351847 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0afdcbe-a0ac-455d-b2f7-ec8dc3ee83e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:54.371370 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-e0afdcbe-a0ac-455d-b2f7-ec8dc3ee83e6 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:16:54.373036 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-e0afdcbe-a0ac-455d-b2f7-ec8dc3ee83e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:16:54.389055 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:54.452751 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 487/962] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:16:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 15:16:54.476460 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8532b24d-d1d9-41c0-94b2-d696133c78a7 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:54.497003 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:54.596928 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8532b24d-d1d9-41c0-94b2-d696133c78a7 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:54.634579 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61813a2-c88d-45c6-8ae8-511b6539c273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:54.635509 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61813a2-c88d-45c6-8ae8-511b6539c273 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:54.635964 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61813a2-c88d-45c6-8ae8-511b6539c273 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:54.636407 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61813a2-c88d-45c6-8ae8-511b6539c273 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:54.648349 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61813a2-c88d-45c6-8ae8-511b6539c273 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:16:54.653542 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-b61813a2-c88d-45c6-8ae8-511b6539c273 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 15:16:54.653542 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:54.653542 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:54.653542 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:54.653542 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:54.653542 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:54.653542 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:54.653542 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:54.653542 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:54.653542 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:54.653542 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:54.653542 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:54.653542 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:16:54.653542 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:16:54.653542 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:16:54.653542 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:16:54.654676 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:16:54.654676 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:16:54.654676 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:16:54.654676 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:16:54.654676 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:54.654676 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:54.654676 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:54.654676 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:54.654676 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:54.654676 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:54.654676 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:54.654676 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:54.654676 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:54.654676 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:54.654676 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:54.654676 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:54.655774 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:54.655774 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:54.655774 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:54.655774 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:54.655774 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:16:54.655774 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:16:54.655774 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:16:54.655774 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:16:54.655774 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:16:54.655774 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:16:54.655774 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 15:16:54.655774 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:54.658050 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 476/963] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Aug 2 15:16:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:54.663669 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0afdcbe-a0ac-455d-b2f7-ec8dc3ee83e6 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:54.751176 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26228a-3549-466f-bd27-dd71102d590e None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:54.751395 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26228a-3549-466f-bd27-dd71102d590e None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:54.751739 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26228a-3549-466f-bd27-dd71102d590e None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:54.753293 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 477/964] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:16:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:16:54.759448 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498b9b55-a843-48d4-a685-84fbe9c659ee None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:54.759846 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498b9b55-a843-48d4-a685-84fbe9c659ee None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:54.760223 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498b9b55-a843-48d4-a685-84fbe9c659ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:54.771602 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0afdcbe-a0ac-455d-b2f7-ec8dc3ee83e6 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:54.781888 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-498b9b55-a843-48d4-a685-84fbe9c659ee None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:16:54.783360 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-498b9b55-a843-48d4-a685-84fbe9c659ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:16:54.812596 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17639521-255d-4eaf-a450-42bca7ef3392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:54.813441 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17639521-255d-4eaf-a450-42bca7ef3392 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:54.813825 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17639521-255d-4eaf-a450-42bca7ef3392 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:54.814443 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17639521-255d-4eaf-a450-42bca7ef3392 None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:54.815703 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17639521-255d-4eaf-a450-42bca7ef3392 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:54.816668 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17639521-255d-4eaf-a450-42bca7ef3392 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:54.818736 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17639521-255d-4eaf-a450-42bca7ef3392 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:54.830744 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 488/965] 10.222.0.42 () {56 vars in 1115 bytes} [Tue Aug 2 15:16:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:54.836150 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17639521-255d-4eaf-a450-42bca7ef3392 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:54.849254 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:54.868819 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 478/966] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:16:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 15:16:54.887981 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498b9b55-a843-48d4-a685-84fbe9c659ee None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:54.901564 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:54.968513 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17639521-255d-4eaf-a450-42bca7ef3392 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:55.006024 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498b9b55-a843-48d4-a685-84fbe9c659ee None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:55.007756 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf29d2-c0fd-48f9-9955-167837680215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:55.008399 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf29d2-c0fd-48f9-9955-167837680215 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:55.008672 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf29d2-c0fd-48f9-9955-167837680215 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:55.008945 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf29d2-c0fd-48f9-9955-167837680215 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:55.020539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbf29d2-c0fd-48f9-9955-167837680215 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:55.021984 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbf29d2-c0fd-48f9-9955-167837680215 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:55.036824 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-afbf29d2-c0fd-48f9-9955-167837680215 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:55.036824 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:55.036824 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:55.036824 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:55.036824 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:55.036824 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:55.036824 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:55.036824 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:55.036824 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:55.036824 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:55.036824 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:55.036824 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:55.036824 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:16:55.036824 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:16:55.036824 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:16:55.037977 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:16:55.037977 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:55.037977 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:55.037977 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:55.037977 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:55.037977 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:55.037977 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:55.037977 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:55.037977 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:55.037977 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:55.037977 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:55.037977 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:55.037977 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:55.037977 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:55.037977 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:55.037977 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:55.037977 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:55.039168 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:16:55.039168 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:16:55.039168 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:55.039168 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:55.039168 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 489/967] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:16:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 15:16:55.039579 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42961d4-7b3f-462f-aca2-64b962f83fb1 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:55.039904 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42961d4-7b3f-462f-aca2-64b962f83fb1 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:55.040176 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42961d4-7b3f-462f-aca2-64b962f83fb1 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:55.041763 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 490/968] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:16:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:16:55.046334 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42961d4-7b3f-462f-aca2-64b962f83fb1 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:55.049429 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b938e66-49fe-43bb-ae7b-94bed315294b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:55.050315 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b938e66-49fe-43bb-ae7b-94bed315294b None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:55.050598 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b938e66-49fe-43bb-ae7b-94bed315294b None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:55.050877 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b938e66-49fe-43bb-ae7b-94bed315294b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:55.051560 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b938e66-49fe-43bb-ae7b-94bed315294b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:55.052945 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b938e66-49fe-43bb-ae7b-94bed315294b None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:55.064321 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-5b938e66-49fe-43bb-ae7b-94bed315294b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 15:16:55.064321 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:55.064321 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 15:16:55.064321 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 15:16:55.064321 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 15:16:55.064321 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 15:16:55.064321 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 15:16:55.064321 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 15:16:55.064321 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 15:16:55.064321 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:55.064321 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 15:16:55.064321 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:55.064321 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:55.064321 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:55.064321 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:55.064321 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:55.064321 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:55.065828 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:55.065828 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:55.065828 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:55.065828 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:55.065828 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:55.065828 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:55.065828 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 15:16:55.065828 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 15:16:55.065828 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 15:16:55.065828 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 15:16:55.065828 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:55.065828 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:55.065828 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:55.065828 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:55.065828 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:55.065828 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:55.066809 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:55.066809 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:55.066809 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:55.066809 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:55.066809 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:55.066809 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:55.066809 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:55.066809 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:55.066809 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:55.066809 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:55.066809 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 15:16:55.066809 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 15:16:55.066809 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 15:16:55.066809 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:55.066809 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 479/969] 10.222.0.42 () {56 vars in 1126 bytes} [Tue Aug 2 15:16:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 15:16:55.068174 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d7da99-28dd-4f43-b38e-c77e27a83d83 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:55.068174 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d7da99-28dd-4f43-b38e-c77e27a83d83 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:55.068174 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d7da99-28dd-4f43-b38e-c77e27a83d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:55.087271 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-b9d7da99-28dd-4f43-b38e-c77e27a83d83 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:16:55.088820 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-b9d7da99-28dd-4f43-b38e-c77e27a83d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:16:55.117309 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:55.163375 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 480/970] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:16:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 15:16:55.164702 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d7da99-28dd-4f43-b38e-c77e27a83d83 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:55.167036 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:55.185100 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42961d4-7b3f-462f-aca2-64b962f83fb1 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:55.223756 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2f7515-9a21-4ddc-9965-724a92778263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:55.224380 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f7515-9a21-4ddc-9965-724a92778263 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:55.224662 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f7515-9a21-4ddc-9965-724a92778263 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:55.224940 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f7515-9a21-4ddc-9965-724a92778263 None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:55.225633 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2f7515-9a21-4ddc-9965-724a92778263 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:55.225943 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2f7515-9a21-4ddc-9965-724a92778263 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:55.227392 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2f7515-9a21-4ddc-9965-724a92778263 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:55.239989 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 491/971] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:16:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:55.245081 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2f7515-9a21-4ddc-9965-724a92778263 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:55.275765 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d7da99-28dd-4f43-b38e-c77e27a83d83 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:55.310088 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d7684-ecd9-4252-8a80-95456166d837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:55.310709 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d7684-ecd9-4252-8a80-95456166d837 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:55.310994 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d7684-ecd9-4252-8a80-95456166d837 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:55.311312 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d7684-ecd9-4252-8a80-95456166d837 None admin] PATH_INFO: `/v3/services` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:55.311995 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479d7684-ecd9-4252-8a80-95456166d837 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:55.312302 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479d7684-ecd9-4252-8a80-95456166d837 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:55.313680 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479d7684-ecd9-4252-8a80-95456166d837 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:55.318996 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 481/972] 10.222.0.42 () {56 vars in 1122 bytes} [Tue Aug 2 15:16:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:55.319851 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d7684-ecd9-4252-8a80-95456166d837 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:55.346676 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2f7515-9a21-4ddc-9965-724a92778263 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:55.368803 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:55.384343 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e88d984-bc0d-4303-9e9c-2ef0814e78dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:55.384842 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:55.386302 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e88d984-bc0d-4303-9e9c-2ef0814e78dc None admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:55.386302 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e88d984-bc0d-4303-9e9c-2ef0814e78dc None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:55.386302 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e88d984-bc0d-4303-9e9c-2ef0814e78dc None admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:55.386302 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e88d984-bc0d-4303-9e9c-2ef0814e78dc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:55.387748 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e88d984-bc0d-4303-9e9c-2ef0814e78dc None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:55.402608 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.sql.core [None req-4e88d984-bc0d-4303-9e9c-2ef0814e78dc None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 02 15:16:55.402608 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 02 15:16:55.402608 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [parameters: {'user_id': 'efb31063d04742f598490372b2b3b95c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 02 15:16:55.402608 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80359) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 02 15:16:55.409186 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-4e88d984-bc0d-4303-9e9c-2ef0814e78dc None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 02 15:16:55.409186 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:55.409186 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 02 15:16:55.409186 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 02 15:16:55.409186 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 02 15:16:55.409186 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 02 15:16:55.409186 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 02 15:16:55.409186 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application result = self._query(query) Aug 02 15:16:55.409186 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 02 15:16:55.409186 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application conn.query(q) Aug 02 15:16:55.409186 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 02 15:16:55.409186 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 02 15:16:55.409186 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 02 15:16:55.409186 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application result.read() Aug 02 15:16:55.409186 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 02 15:16:55.412829 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 02 15:16:55.412829 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 02 15:16:55.412829 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 02 15:16:55.412829 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 02 15:16:55.412829 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 02 15:16:55.412829 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 02 15:16:55.412829 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 02 15:16:55.412829 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 02 15:16:55.412829 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:55.412829 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 02 15:16:55.412829 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:55.412829 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:55.412829 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 02 15:16:55.412829 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 02 15:16:55.412829 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 02 15:16:55.412829 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 02 15:16:55.412829 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 02 15:16:55.412829 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application next(self.gen) Aug 02 15:16:55.414550 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 02 15:16:55.414550 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application yield resource Aug 02 15:16:55.414550 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 02 15:16:55.414550 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application next(self.gen) Aug 02 15:16:55.414550 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 02 15:16:55.414550 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self.session.rollback() Aug 02 15:16:55.414550 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 15:16:55.414550 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self.force_reraise() Aug 02 15:16:55.414550 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 15:16:55.414550 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise self.value Aug 02 15:16:55.414550 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 02 15:16:55.414550 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 02 15:16:55.414550 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 02 15:16:55.414550 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application session.commit() Aug 02 15:16:55.414550 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 02 15:16:55.414550 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 02 15:16:55.414550 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 02 15:16:55.416370 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._prepare_impl() Aug 02 15:16:55.416370 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 02 15:16:55.416370 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self.session.flush() Aug 02 15:16:55.416370 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 02 15:16:55.416370 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._flush(objects) Aug 02 15:16:55.416370 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 02 15:16:55.416370 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 02 15:16:55.416370 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 02 15:16:55.416370 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application compat.raise_( Aug 02 15:16:55.416370 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 02 15:16:55.416370 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception Aug 02 15:16:55.416370 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 02 15:16:55.416370 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application flush_context.execute() Aug 02 15:16:55.416370 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 02 15:16:55.416370 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rec.execute(self) Aug 02 15:16:55.416370 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 02 15:16:55.416370 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 02 15:16:55.417468 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 02 15:16:55.417468 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 02 15:16:55.417468 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 02 15:16:55.417468 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 02 15:16:55.417468 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 02 15:16:55.417468 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 02 15:16:55.417468 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 02 15:16:55.417468 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 02 15:16:55.417468 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 02 15:16:55.417468 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 02 15:16:55.417468 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 02 15:16:55.417468 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 02 15:16:55.417468 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 02 15:16:55.417468 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 02 15:16:55.417468 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 02 15:16:55.417468 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception Aug 02 15:16:55.418537 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 02 15:16:55.418537 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 02 15:16:55.418537 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 02 15:16:55.418537 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 02 15:16:55.418537 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 02 15:16:55.418537 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application result = self._query(query) Aug 02 15:16:55.418537 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 02 15:16:55.418537 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application conn.query(q) Aug 02 15:16:55.418537 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 02 15:16:55.418537 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 02 15:16:55.418537 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 02 15:16:55.418537 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application result.read() Aug 02 15:16:55.418537 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 02 15:16:55.418537 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 02 15:16:55.418537 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 02 15:16:55.418537 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 02 15:16:55.419609 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 02 15:16:55.419609 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 02 15:16:55.419609 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 02 15:16:55.419609 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 02 15:16:55.419609 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 02 15:16:55.419609 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 02 15:16:55.419609 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [parameters: {'user_id': 'efb31063d04742f598490372b2b3b95c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 02 15:16:55.419609 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 02 15:16:55.419609 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:55.419609 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 15:16:55.419609 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:55.419609 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:55.419609 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:55.419609 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:55.419609 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:55.420570 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:55.420570 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:55.420570 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:55.420570 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:55.420570 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:55.420570 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:55.420570 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:55.420570 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 02 15:16:55.420570 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 02 15:16:55.420570 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:55.420570 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:55.420570 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 15:16:55.420570 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:16:55.420570 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 15:16:55.420570 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:16:55.420570 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 02 15:16:55.420570 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 02 15:16:55.421679 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 02 15:16:55.421679 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 02 15:16:55.421679 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 02 15:16:55.421679 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 02 15:16:55.421679 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 02 15:16:55.421679 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:55.421679 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 492/973] 10.222.0.42 () {60 vars in 1131 bytes} [Tue Aug 2 15:16:55 2022] POST /identity/v3/users => generated 160 bytes in 171 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:55.421679 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8c060-dee5-46ff-bb2e-fef993ba74c1 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:55.421679 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8c060-dee5-46ff-bb2e-fef993ba74c1 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:55.421679 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8c060-dee5-46ff-bb2e-fef993ba74c1 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:55.422378 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 493/974] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:16:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:16:55.423444 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8c060-dee5-46ff-bb2e-fef993ba74c1 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:55.433479 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d7684-ecd9-4252-8a80-95456166d837 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:55.467296 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61242b62-f5e0-4061-bbda-5a704fc5a9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:55.467936 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61242b62-f5e0-4061-bbda-5a704fc5a9c8 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:55.468218 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61242b62-f5e0-4061-bbda-5a704fc5a9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:55.468495 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61242b62-f5e0-4061-bbda-5a704fc5a9c8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:55.476388 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61242b62-f5e0-4061-bbda-5a704fc5a9c8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:55.477820 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61242b62-f5e0-4061-bbda-5a704fc5a9c8 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:55.490009 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-61242b62-f5e0-4061-bbda-5a704fc5a9c8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 15:16:55.490009 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:55.490009 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:55.490009 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:55.490009 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:55.490009 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:55.490009 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:55.490009 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:55.490009 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:55.490009 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:55.490009 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:55.490009 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:55.490009 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 15:16:55.490009 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 15:16:55.490009 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 15:16:55.490009 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 15:16:55.491123 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:55.491123 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:55.491123 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 15:16:55.491123 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:16:55.491123 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 15:16:55.491123 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:16:55.491123 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:55.491123 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:55.491123 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:55.491123 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:55.491123 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:55.491123 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:55.491123 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:55.491123 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:55.491123 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:55.491123 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:55.491123 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:55.491123 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:55.492534 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:55.492534 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:55.492534 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 15:16:55.492534 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 15:16:55.492534 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 15:16:55.492534 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 15:16:55.492534 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 15:16:55.492534 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 15:16:55.492534 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 15:16:55.492534 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:55.492534 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 482/975] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Aug 2 15:16:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:55.492534 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61242b62-f5e0-4061-bbda-5a704fc5a9c8 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:55.528783 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8c060-dee5-46ff-bb2e-fef993ba74c1 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:55.564068 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe74cfd-6fad-43c1-adba-755681d9a1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:55.564695 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe74cfd-6fad-43c1-adba-755681d9a1c7 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:55.565071 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe74cfd-6fad-43c1-adba-755681d9a1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:55.565353 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe74cfd-6fad-43c1-adba-755681d9a1c7 None admin] PATH_INFO: `/v3/services` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:55.566613 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe74cfd-6fad-43c1-adba-755681d9a1c7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:55.566919 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe74cfd-6fad-43c1-adba-755681d9a1c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:55.568629 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe74cfd-6fad-43c1-adba-755681d9a1c7 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:55.574019 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 494/976] 10.222.0.42 () {56 vars in 1122 bytes} [Tue Aug 2 15:16:55 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:55.576077 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44912f00-e486-46a8-8f11-de8b52e7800c None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:55.576077 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44912f00-e486-46a8-8f11-de8b52e7800c None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:55.576077 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44912f00-e486-46a8-8f11-de8b52e7800c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:55.594883 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-44912f00-e486-46a8-8f11-de8b52e7800c None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:16:55.596434 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-44912f00-e486-46a8-8f11-de8b52e7800c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:16:55.596778 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61242b62-f5e0-4061-bbda-5a704fc5a9c8 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:55.622217 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:55.632027 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af867b-141c-4b50-8559-27105e470751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:55.632671 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af867b-141c-4b50-8559-27105e470751 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:55.632945 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af867b-141c-4b50-8559-27105e470751 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:55.633217 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af867b-141c-4b50-8559-27105e470751 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:55.640063 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:55.641564 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62af867b-141c-4b50-8559-27105e470751 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:55.645049 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62af867b-141c-4b50-8559-27105e470751 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:55.657676 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-62af867b-141c-4b50-8559-27105e470751 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 02 15:16:55.657676 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:55.657676 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:55.657676 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:55.657676 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:55.657676 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:55.657676 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:55.657676 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:55.657676 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:55.657676 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:55.657676 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:55.657676 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:55.657676 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 15:16:55.657676 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 15:16:55.657676 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 15:16:55.657676 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 15:16:55.658890 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:55.658890 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:55.658890 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 15:16:55.658890 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:16:55.658890 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 15:16:55.658890 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:16:55.658890 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:55.658890 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:55.658890 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:55.658890 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:55.658890 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:55.658890 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:55.658890 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:55.658890 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:55.658890 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:55.658890 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:55.658890 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:55.658890 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:55.660574 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:55.660574 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:55.660574 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 15:16:55.660574 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 15:16:55.660574 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 15:16:55.660574 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 15:16:55.660574 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 15:16:55.660574 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 15:16:55.660574 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 02 15:16:55.660574 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:55.660574 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 483/977] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 2 15:16:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:55.660574 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af867b-141c-4b50-8559-27105e470751 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:55.671356 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 495/978] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:16:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 15:16:55.672264 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44912f00-e486-46a8-8f11-de8b52e7800c None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:55.762577 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af867b-141c-4b50-8559-27105e470751 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:55.776501 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44912f00-e486-46a8-8f11-de8b52e7800c None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:55.797399 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210efe47-c45b-4a2d-8afe-949ac61ea0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:55.798057 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210efe47-c45b-4a2d-8afe-949ac61ea0a6 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:55.798306 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210efe47-c45b-4a2d-8afe-949ac61ea0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:55.798496 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210efe47-c45b-4a2d-8afe-949ac61ea0a6 None admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:55.799304 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210efe47-c45b-4a2d-8afe-949ac61ea0a6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:55.799618 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210efe47-c45b-4a2d-8afe-949ac61ea0a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:55.801113 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210efe47-c45b-4a2d-8afe-949ac61ea0a6 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:55.810859 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e5444-d858-4273-89a8-3283f0dde197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:55.811507 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e5444-d858-4273-89a8-3283f0dde197 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:55.811795 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e5444-d858-4273-89a8-3283f0dde197 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:55.812074 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e5444-d858-4273-89a8-3283f0dde197 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:55.812834 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36e5444-d858-4273-89a8-3283f0dde197 None admin] RBAC: Adding query filter params (interface=admin, service_id=a57f74a2d7404d7c89c18336e950e79a, region_id=RegionOne) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:55.813148 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36e5444-d858-4273-89a8-3283f0dde197 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:55.814517 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36e5444-d858-4273-89a8-3283f0dde197 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:55.818270 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 484/979] 10.222.0.42 () {56 vars in 1149 bytes} [Tue Aug 2 15:16:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:55.819076 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210efe47-c45b-4a2d-8afe-949ac61ea0a6 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:55.824234 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 496/980] 10.222.0.42 () {56 vars in 1249 bytes} [Tue Aug 2 15:16:55 2022] GET /identity/v3/endpoints?service_id=a57f74a2d7404d7c89c18336e950e79a&interface=admin®ion_id=RegionOne => generated 193 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:55.824234 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e5444-d858-4273-89a8-3283f0dde197 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:55.867674 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:55.870868 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:55.932458 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210efe47-c45b-4a2d-8afe-949ac61ea0a6 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:55.938387 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e5444-d858-4273-89a8-3283f0dde197 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:55.966783 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed33955-d0b6-4a9e-9850-419a078ef3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:55.967431 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed33955-d0b6-4a9e-9850-419a078ef3bd None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:55.967718 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed33955-d0b6-4a9e-9850-419a078ef3bd None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:55.967991 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed33955-d0b6-4a9e-9850-419a078ef3bd None admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:55.968739 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed33955-d0b6-4a9e-9850-419a078ef3bd None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:55.969043 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed33955-d0b6-4a9e-9850-419a078ef3bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:55.970466 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed33955-d0b6-4a9e-9850-419a078ef3bd None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:55.971811 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9a0068-98e9-4f94-89a7-b5530fa977c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:55.973044 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a0068-98e9-4f94-89a7-b5530fa977c7 None admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:55.973323 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a0068-98e9-4f94-89a7-b5530fa977c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:55.973596 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a0068-98e9-4f94-89a7-b5530fa977c7 None admin] PATH_INFO: `/v3/services` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:55.974272 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9a0068-98e9-4f94-89a7-b5530fa977c7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:55.975661 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9a0068-98e9-4f94-89a7-b5530fa977c7 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:55.991246 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 497/981] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Aug 2 15:16:55 2022] POST /identity/v3/services => generated 242 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:16:55.991246 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9a0068-98e9-4f94-89a7-b5530fa977c7 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:56.009107 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 485/982] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 2 15:16:55 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:56.010020 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed33955-d0b6-4a9e-9850-419a078ef3bd None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:56.168427 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed33955-d0b6-4a9e-9850-419a078ef3bd None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:56.172135 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:56.177735 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:56.194319 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9a0068-98e9-4f94-89a7-b5530fa977c7 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:56.217873 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9354f7-05f4-4605-8d88-926699066d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:56.218993 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9354f7-05f4-4605-8d88-926699066d74 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:56.219414 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9354f7-05f4-4605-8d88-926699066d74 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:56.219789 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9354f7-05f4-4605-8d88-926699066d74 None admin] PATH_INFO: `/v3/services` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:56.220544 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9354f7-05f4-4605-8d88-926699066d74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:56.223054 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9354f7-05f4-4605-8d88-926699066d74 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:56.232481 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 486/983] 10.222.0.42 () {56 vars in 1087 bytes} [Tue Aug 2 15:16:56 2022] GET /identity/v3/services => generated 1727 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:16:56.253912 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee4cec-2cd8-4920-8194-99df20a5336c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:56.255015 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee4cec-2cd8-4920-8194-99df20a5336c None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:56.255555 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee4cec-2cd8-4920-8194-99df20a5336c None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:56.256058 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee4cec-2cd8-4920-8194-99df20a5336c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:56.341652 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ee4cec-2cd8-4920-8194-99df20a5336c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:56.343172 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ee4cec-2cd8-4920-8194-99df20a5336c None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:56.448226 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:56.461174 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 498/984] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 2 15:16:55 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 15:16:56.462544 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9354f7-05f4-4605-8d88-926699066d74 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:56.566524 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9354f7-05f4-4605-8d88-926699066d74 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:56.603899 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eededfb-7cc8-4bbb-95e7-178326f356a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:56.604845 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eededfb-7cc8-4bbb-95e7-178326f356a3 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:56.605343 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eededfb-7cc8-4bbb-95e7-178326f356a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:56.605763 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eededfb-7cc8-4bbb-95e7-178326f356a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:56.617054 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eededfb-7cc8-4bbb-95e7-178326f356a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:56.618766 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eededfb-7cc8-4bbb-95e7-178326f356a3 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:56.635390 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-0eededfb-7cc8-4bbb-95e7-178326f356a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:56.635390 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:56.635390 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:56.635390 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:56.635390 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:56.635390 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:56.635390 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:56.635390 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:56.635390 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:56.635390 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:56.635390 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:56.635390 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:56.635390 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:16:56.635390 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:16:56.635390 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:16:56.636468 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:16:56.636468 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:56.636468 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:56.636468 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:56.636468 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:56.636468 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:56.636468 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:56.636468 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:56.636468 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:56.636468 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:56.636468 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:56.636468 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:56.636468 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:56.636468 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:56.636468 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:56.636468 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:56.636468 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:56.637596 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:16:56.637596 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:16:56.637596 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:16:56.637596 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:56.643422 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 487/985] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:16:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:56.645187 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee4cec-2cd8-4920-8194-99df20a5336c None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:56.754600 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee4cec-2cd8-4920-8194-99df20a5336c None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:56.789781 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a8a405-8263-4f8a-b4dc-711083ff34d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:56.790641 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a8a405-8263-4f8a-b4dc-711083ff34d0 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:56.791093 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a8a405-8263-4f8a-b4dc-711083ff34d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:56.791540 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a8a405-8263-4f8a-b4dc-711083ff34d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:56.792403 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a8a405-8263-4f8a-b4dc-711083ff34d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:56.792854 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a8a405-8263-4f8a-b4dc-711083ff34d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:56.794360 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a8a405-8263-4f8a-b4dc-711083ff34d0 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:56.811638 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 499/986] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:16:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:56.813255 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eededfb-7cc8-4bbb-95e7-178326f356a3 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:56.833283 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:56.927664 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eededfb-7cc8-4bbb-95e7-178326f356a3 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:56.961069 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09882a2-886b-432c-95d4-1825c711fbab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:56.961795 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09882a2-886b-432c-95d4-1825c711fbab None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:56.962145 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09882a2-886b-432c-95d4-1825c711fbab None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:56.962489 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09882a2-886b-432c-95d4-1825c711fbab None admin] PATH_INFO: `/v3/projects/service` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:56.969248 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09882a2-886b-432c-95d4-1825c711fbab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:56.970810 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09882a2-886b-432c-95d4-1825c711fbab None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:56.982795 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-b09882a2-886b-432c-95d4-1825c711fbab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:16:56.982795 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:56.982795 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:56.982795 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:56.982795 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:56.982795 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:56.982795 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:56.982795 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:56.982795 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:56.982795 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:56.982795 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:56.982795 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:56.982795 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 15:16:56.982795 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 15:16:56.982795 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 15:16:56.983962 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 15:16:56.983962 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:56.983962 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:56.983962 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:56.983962 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:56.983962 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:56.983962 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:56.983962 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:56.983962 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:56.983962 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:56.983962 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:56.983962 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:56.983962 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:56.983962 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:56.983962 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:56.983962 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:56.983962 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:56.984841 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 15:16:56.984841 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 15:16:56.984841 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 15:16:56.984841 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 15:16:56.984841 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 15:16:56.984841 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 15:16:56.984841 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:16:56.984841 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:56.987295 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 488/987] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 2 15:16:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:56.990857 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a8a405-8263-4f8a-b4dc-711083ff34d0 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:57.049140 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:57.094221 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a8a405-8263-4f8a-b4dc-711083ff34d0 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:57.128694 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a63a363-5bd5-4f1f-886e-284de54ba7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:57.129310 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63a363-5bd5-4f1f-886e-284de54ba7c2 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:57.129594 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63a363-5bd5-4f1f-886e-284de54ba7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:57.129923 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63a363-5bd5-4f1f-886e-284de54ba7c2 None admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:57.130784 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a63a363-5bd5-4f1f-886e-284de54ba7c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:57.131128 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a63a363-5bd5-4f1f-886e-284de54ba7c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:57.132625 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a63a363-5bd5-4f1f-886e-284de54ba7c2 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:57.149951 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 500/988] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 2 15:16:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:57.151357 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09882a2-886b-432c-95d4-1825c711fbab None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:57.238277 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:57.262508 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09882a2-886b-432c-95d4-1825c711fbab None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:57.297580 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3711dbe7-cf70-428b-a309-7e698bb63ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:57.298287 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3711dbe7-cf70-428b-a309-7e698bb63ce7 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:57.298639 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3711dbe7-cf70-428b-a309-7e698bb63ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:57.298987 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3711dbe7-cf70-428b-a309-7e698bb63ce7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:57.300010 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3711dbe7-cf70-428b-a309-7e698bb63ce7 None admin] RBAC: Adding query filter params (role.id=1df4511e5e2b47278b0bf4cd5acbeb38, scope.project.id=cc19d22b4cd64dd1bc89ed78155d2732, user.id=dfe8c00c0c3d4c4b8b6f36e39a3a2e71) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:57.300344 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3711dbe7-cf70-428b-a309-7e698bb63ce7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:57.301888 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3711dbe7-cf70-428b-a309-7e698bb63ce7 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:57.315263 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 489/989] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 2 15:16:57 2022] GET /identity/v3/role_assignments?user.id=dfe8c00c0c3d4c4b8b6f36e39a3a2e71&scope.project.id=cc19d22b4cd64dd1bc89ed78155d2732&role.id=1df4511e5e2b47278b0bf4cd5acbeb38 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:58.125885 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea9219-bb18-4c83-9160-b60049d9d275 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:58.126427 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea9219-bb18-4c83-9160-b60049d9d275 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:58.126427 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea9219-bb18-4c83-9160-b60049d9d275 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:58.127996 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 501/990] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:16:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:16:58.133011 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18219bb-5687-4ec9-b1a7-6829b248cb50 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:58.133438 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18219bb-5687-4ec9-b1a7-6829b248cb50 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:58.133583 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18219bb-5687-4ec9-b1a7-6829b248cb50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:58.156746 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-a18219bb-5687-4ec9-b1a7-6829b248cb50 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:16:58.157944 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-a18219bb-5687-4ec9-b1a7-6829b248cb50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:16:58.228719 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 490/991] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:16:58 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 15:16:58.250786 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea9219-bb18-4c83-9160-b60049d9d275 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:58.258013 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf41fd-4bb1-4478-9e6c-d22088113c12 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:58.258013 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf41fd-4bb1-4478-9e6c-d22088113c12 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:58.258013 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf41fd-4bb1-4478-9e6c-d22088113c12 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:58.258013 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 491/992] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:16:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 15:16:58.262896 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca05d4-a505-42c9-bc68-08e34b4a63f2 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:58.263181 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca05d4-a505-42c9-bc68-08e34b4a63f2 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:58.263743 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca05d4-a505-42c9-bc68-08e34b4a63f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:58.281979 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-73ca05d4-a505-42c9-bc68-08e34b4a63f2 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:16:58.283152 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-73ca05d4-a505-42c9-bc68-08e34b4a63f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:16:58.355155 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 492/993] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:16:58 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 15:16:58.362236 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea9219-bb18-4c83-9160-b60049d9d275 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:58.376895 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ca05d4-a505-42c9-bc68-08e34b4a63f2 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:58.379472 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:58.380975 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:58.401332 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d466020-6176-4198-b7ed-44f50a0f627a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:58.402171 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d466020-6176-4198-b7ed-44f50a0f627a None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:58.402282 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d466020-6176-4198-b7ed-44f50a0f627a None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:58.402538 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d466020-6176-4198-b7ed-44f50a0f627a None admin] PATH_INFO: `/v3/services/compute` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:58.403171 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d466020-6176-4198-b7ed-44f50a0f627a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:58.404596 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d466020-6176-4198-b7ed-44f50a0f627a None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:58.413770 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-6d466020-6176-4198-b7ed-44f50a0f627a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 15:16:58.413770 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:58.413770 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 15:16:58.413770 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 15:16:58.413770 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 15:16:58.413770 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 15:16:58.413770 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 15:16:58.413770 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 15:16:58.413770 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 15:16:58.413770 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:58.413770 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 15:16:58.413770 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:58.413770 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:58.413770 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:58.413770 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:58.413770 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:58.413770 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:58.415152 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:58.415152 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:58.415152 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:58.415152 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:58.415152 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:58.415152 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:58.415152 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 15:16:58.415152 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 15:16:58.415152 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 15:16:58.415152 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 15:16:58.415152 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:58.415152 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:58.415152 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:58.415152 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:58.415152 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:58.415152 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:58.420984 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:58.420984 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:58.420984 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:58.420984 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:58.420984 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:58.420984 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:58.420984 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:58.420984 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:58.420984 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:58.420984 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:58.420984 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 15:16:58.420984 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 15:16:58.420984 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 15:16:58.420984 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:16:58.420984 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 502/994] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 2 15:16:58 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 15:16:58.421790 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d466020-6176-4198-b7ed-44f50a0f627a None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:58.497498 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ca05d4-a505-42c9-bc68-08e34b4a63f2 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:58.533180 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d466020-6176-4198-b7ed-44f50a0f627a None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:58.537268 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73050be2-d345-4fd7-a060-c91ef5f5d233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:58.537916 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73050be2-d345-4fd7-a060-c91ef5f5d233 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:58.538199 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73050be2-d345-4fd7-a060-c91ef5f5d233 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:58.538472 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73050be2-d345-4fd7-a060-c91ef5f5d233 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:58.539389 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73050be2-d345-4fd7-a060-c91ef5f5d233 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:58.541352 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73050be2-d345-4fd7-a060-c91ef5f5d233 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:58.553346 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-73050be2-d345-4fd7-a060-c91ef5f5d233 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 15:16:58.553346 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:58.553346 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 15:16:58.553346 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 15:16:58.553346 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 15:16:58.553346 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 15:16:58.553346 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 15:16:58.553346 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 15:16:58.553346 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 15:16:58.553346 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:58.553346 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 15:16:58.553346 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:58.553346 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:58.553346 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:58.553346 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:58.553346 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:58.553346 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:58.554326 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:58.554326 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:58.554326 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:58.554326 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:58.554326 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:58.554326 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:58.554326 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 15:16:58.554326 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 15:16:58.554326 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 15:16:58.554326 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 15:16:58.554326 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:58.554326 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:58.554326 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:58.554326 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:58.554326 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:58.554326 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:58.555161 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:58.555161 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:58.555161 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:58.555161 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:58.555161 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:58.555161 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:58.555161 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:58.555161 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:58.555161 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:58.555161 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:58.555161 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 15:16:58.555161 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 15:16:58.555161 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 15:16:58.555161 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:58.556531 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 493/995] 10.222.0.42 () {56 vars in 1126 bytes} [Tue Aug 2 15:16:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 15:16:58.560880 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73050be2-d345-4fd7-a060-c91ef5f5d233 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:58.573673 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e66b63-139d-40d4-96c0-596ec89f8f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:58.574296 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e66b63-139d-40d4-96c0-596ec89f8f3c None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:58.574624 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e66b63-139d-40d4-96c0-596ec89f8f3c None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:58.574967 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e66b63-139d-40d4-96c0-596ec89f8f3c None admin] PATH_INFO: `/v3/services` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:58.575624 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e66b63-139d-40d4-96c0-596ec89f8f3c None admin] RBAC: Adding query filter params (name=compute) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:58.575909 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e66b63-139d-40d4-96c0-596ec89f8f3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:58.577362 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e66b63-139d-40d4-96c0-596ec89f8f3c None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:58.588012 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 503/996] 10.222.0.42 () {56 vars in 1112 bytes} [Tue Aug 2 15:16:58 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:58.589461 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e66b63-139d-40d4-96c0-596ec89f8f3c None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:58.634349 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:58.640087 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:58.676792 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73050be2-d345-4fd7-a060-c91ef5f5d233 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:58.697079 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e66b63-139d-40d4-96c0-596ec89f8f3c None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:58.715093 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6a40ff-c7b3-44ba-978e-4d185e91917b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:58.715995 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a40ff-c7b3-44ba-978e-4d185e91917b None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:58.716456 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a40ff-c7b3-44ba-978e-4d185e91917b None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:58.717057 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a40ff-c7b3-44ba-978e-4d185e91917b None admin] PATH_INFO: `/v3/services` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:58.717728 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6a40ff-c7b3-44ba-978e-4d185e91917b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:58.718034 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6a40ff-c7b3-44ba-978e-4d185e91917b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:58.719423 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6a40ff-c7b3-44ba-978e-4d185e91917b None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:58.725531 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 494/997] 10.222.0.42 () {56 vars in 1122 bytes} [Tue Aug 2 15:16:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:16:58.730888 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6a40ff-c7b3-44ba-978e-4d185e91917b None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:58.731793 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe10a6c-c01c-4b92-8a56-d489e56bbe3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:58.732409 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe10a6c-c01c-4b92-8a56-d489e56bbe3d None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:58.732687 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe10a6c-c01c-4b92-8a56-d489e56bbe3d None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:58.732959 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe10a6c-c01c-4b92-8a56-d489e56bbe3d None admin] PATH_INFO: `/v3/services` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:58.733630 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe10a6c-c01c-4b92-8a56-d489e56bbe3d None admin] RBAC: Adding query filter params (type=compute) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:58.733930 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe10a6c-c01c-4b92-8a56-d489e56bbe3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:58.735347 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe10a6c-c01c-4b92-8a56-d489e56bbe3d None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:58.744819 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 504/998] 10.222.0.42 () {56 vars in 1112 bytes} [Tue Aug 2 15:16:58 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:58.745804 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe10a6c-c01c-4b92-8a56-d489e56bbe3d None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:58.839432 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6a40ff-c7b3-44ba-978e-4d185e91917b None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:58.851020 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe10a6c-c01c-4b92-8a56-d489e56bbe3d None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:58.859851 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:58.872874 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:58.879895 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c3329b-1af3-42e6-9b49-5a08ee383691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:58.880520 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3329b-1af3-42e6-9b49-5a08ee383691 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:58.880799 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3329b-1af3-42e6-9b49-5a08ee383691 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:58.881072 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3329b-1af3-42e6-9b49-5a08ee383691 None admin] PATH_INFO: `/v3/services` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:58.881743 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c3329b-1af3-42e6-9b49-5a08ee383691 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:58.882046 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c3329b-1af3-42e6-9b49-5a08ee383691 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:58.883441 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c3329b-1af3-42e6-9b49-5a08ee383691 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:58.888241 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8546cb9a-57c3-4ddb-8a86-c999e7f5b2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:58.888381 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 495/999] 10.222.0.42 () {56 vars in 1122 bytes} [Tue Aug 2 15:16:58 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:16:58.889113 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546cb9a-57c3-4ddb-8a86-c999e7f5b2a2 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:58.889543 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546cb9a-57c3-4ddb-8a86-c999e7f5b2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:58.889965 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546cb9a-57c3-4ddb-8a86-c999e7f5b2a2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:58.890950 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8546cb9a-57c3-4ddb-8a86-c999e7f5b2a2 None admin] RBAC: Adding query filter params (interface=public, service_id=bd5a32fe64ce431d9140553ac7834e91, region_id=RegionOne) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:58.891450 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8546cb9a-57c3-4ddb-8a86-c999e7f5b2a2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:58.893047 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8546cb9a-57c3-4ddb-8a86-c999e7f5b2a2 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:58.895188 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c3329b-1af3-42e6-9b49-5a08ee383691 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:58.899781 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 505/1000] 10.222.0.42 () {56 vars in 1251 bytes} [Tue Aug 2 15:16:58 2022] GET /identity/v3/endpoints?service_id=bd5a32fe64ce431d9140553ac7834e91&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:16:58.905028 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8546cb9a-57c3-4ddb-8a86-c999e7f5b2a2 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:58.999622 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c3329b-1af3-42e6-9b49-5a08ee383691 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:59.014301 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8546cb9a-57c3-4ddb-8a86-c999e7f5b2a2 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:59.036189 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f5262-3415-4184-b57b-dca840abe3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:59.036812 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f5262-3415-4184-b57b-dca840abe3db None admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:59.037089 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f5262-3415-4184-b57b-dca840abe3db None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:59.037360 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f5262-3415-4184-b57b-dca840abe3db None admin] PATH_INFO: `/v3/endpoints` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:59.038078 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f5262-3415-4184-b57b-dca840abe3db None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:59.039737 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f5262-3415-4184-b57b-dca840abe3db None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:59.057673 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 496/1001] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:16:58 2022] POST /identity/v3/endpoints => generated 325 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 15:16:59.065287 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b9fad5-73fd-4a32-9011-4e57c676173d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:59.066762 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9fad5-73fd-4a32-9011-4e57c676173d None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:59.067199 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9fad5-73fd-4a32-9011-4e57c676173d None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:59.067654 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9fad5-73fd-4a32-9011-4e57c676173d None admin] PATH_INFO: `/v3/services` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:59.068496 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b9fad5-73fd-4a32-9011-4e57c676173d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:59.070123 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b9fad5-73fd-4a32-9011-4e57c676173d None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:59.077446 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 506/1002] 10.222.0.42 () {56 vars in 1087 bytes} [Tue Aug 2 15:16:58 2022] GET /identity/v3/services => generated 1727 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 15:16:59.400154 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1630a5-c037-45bb-979d-96eddeda7a43 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:59.400813 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1630a5-c037-45bb-979d-96eddeda7a43 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:59.400813 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1630a5-c037-45bb-979d-96eddeda7a43 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:59.402370 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 497/1003] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:16:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:16:59.407929 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79bc16f-ef27-4b69-b771-edccf489e96b None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:59.408418 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79bc16f-ef27-4b69-b771-edccf489e96b None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:59.408516 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79bc16f-ef27-4b69-b771-edccf489e96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:59.427869 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-b79bc16f-ef27-4b69-b771-edccf489e96b None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:16:59.429067 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-b79bc16f-ef27-4b69-b771-edccf489e96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:16:59.457021 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:59.503979 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 507/1004] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:16:59 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 15:16:59.522973 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1630a5-c037-45bb-979d-96eddeda7a43 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:59.588630 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:59.639328 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1630a5-c037-45bb-979d-96eddeda7a43 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:59.674818 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f30a5e5-5e94-4dc0-ab40-cee7a6703c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:59.675416 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30a5e5-5e94-4dc0-ab40-cee7a6703c1d None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:59.675699 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30a5e5-5e94-4dc0-ab40-cee7a6703c1d None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:59.675971 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30a5e5-5e94-4dc0-ab40-cee7a6703c1d None admin] PATH_INFO: `/v3/services/image` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:59.676623 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f30a5e5-5e94-4dc0-ab40-cee7a6703c1d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:59.677991 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f30a5e5-5e94-4dc0-ab40-cee7a6703c1d None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:59.686857 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-9f30a5e5-5e94-4dc0-ab40-cee7a6703c1d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 15:16:59.686857 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:59.686857 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 15:16:59.686857 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 15:16:59.686857 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 15:16:59.686857 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 15:16:59.686857 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 15:16:59.686857 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 15:16:59.686857 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 15:16:59.686857 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:59.686857 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 15:16:59.686857 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:59.686857 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:16:59.686857 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:16:59.686857 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:16:59.686857 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:16:59.686857 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:16:59.688021 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:16:59.688021 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:16:59.688021 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:16:59.688021 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:16:59.688021 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:16:59.688021 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:16:59.688021 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 15:16:59.688021 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 15:16:59.688021 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 15:16:59.688021 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 15:16:59.688021 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:16:59.688021 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:16:59.688021 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:16:59.688021 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:16:59.688021 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:16:59.688021 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:16:59.689109 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:16:59.689109 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:16:59.689109 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:16:59.689109 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:16:59.689109 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:16:59.689109 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:16:59.689109 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:16:59.689109 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:16:59.689109 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:16:59.689109 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:16:59.689109 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 15:16:59.689109 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 15:16:59.689109 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 15:16:59.689109 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:16:59.689109 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 498/1005] 10.222.0.42 () {56 vars in 1105 bytes} [Tue Aug 2 15:16:59 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:16:59.697074 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79bc16f-ef27-4b69-b771-edccf489e96b None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:59.803683 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79bc16f-ef27-4b69-b771-edccf489e96b None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:59.840016 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98ccc03-b9fc-464c-b23f-32528de4d4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:59.840627 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ccc03-b9fc-464c-b23f-32528de4d4fc None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:59.840963 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ccc03-b9fc-464c-b23f-32528de4d4fc None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:59.841239 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ccc03-b9fc-464c-b23f-32528de4d4fc None admin] PATH_INFO: `/v3/services` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:59.841920 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98ccc03-b9fc-464c-b23f-32528de4d4fc None admin] RBAC: Adding query filter params (name=image) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:59.842224 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98ccc03-b9fc-464c-b23f-32528de4d4fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:59.843628 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98ccc03-b9fc-464c-b23f-32528de4d4fc None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:16:59.853521 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 508/1006] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:16:59 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:16:59.855096 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f30a5e5-5e94-4dc0-ab40-cee7a6703c1d None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:16:59.954991 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f30a5e5-5e94-4dc0-ab40-cee7a6703c1d None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:16:59.972342 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:16:59.989991 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab15d04-9d25-4c51-85dd-80abb3995d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:16:59.990625 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab15d04-9d25-4c51-85dd-80abb3995d6f None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:16:59.990904 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab15d04-9d25-4c51-85dd-80abb3995d6f None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:16:59.991177 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab15d04-9d25-4c51-85dd-80abb3995d6f None admin] PATH_INFO: `/v3/services` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:16:59.991869 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab15d04-9d25-4c51-85dd-80abb3995d6f None admin] RBAC: Adding query filter params (type=image) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:16:59.992173 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab15d04-9d25-4c51-85dd-80abb3995d6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:16:59.993527 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab15d04-9d25-4c51-85dd-80abb3995d6f None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:00.004025 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 499/1007] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:16:59 2022] GET /identity/v3/services?type=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:17:01.110308 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d42ce-88c2-45e4-bfb0-4a0756514bf7 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:01.110894 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d42ce-88c2-45e4-bfb0-4a0756514bf7 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:01.110894 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d42ce-88c2-45e4-bfb0-4a0756514bf7 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:01.112402 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 509/1008] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:17:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:17:01.118110 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75daf75-3f6e-4106-8e61-f2402208c48b None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:01.118524 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75daf75-3f6e-4106-8e61-f2402208c48b None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:01.118710 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75daf75-3f6e-4106-8e61-f2402208c48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:01.137881 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-c75daf75-3f6e-4106-8e61-f2402208c48b None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:17:01.139063 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-c75daf75-3f6e-4106-8e61-f2402208c48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:17:01.152061 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4efe6-d3be-45e8-af55-38572bbabc4a None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:01.152348 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4efe6-d3be-45e8-af55-38572bbabc4a None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:01.152625 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4efe6-d3be-45e8-af55-38572bbabc4a None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:01.154252 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 510/1009] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:17:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 15:17:01.159159 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f6dec-e238-40ec-8c3e-5534baf29b30 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:01.159470 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f6dec-e238-40ec-8c3e-5534baf29b30 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:01.159749 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f6dec-e238-40ec-8c3e-5534baf29b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:01.178339 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-0a7f6dec-e238-40ec-8c3e-5534baf29b30 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:17:01.179676 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-0a7f6dec-e238-40ec-8c3e-5534baf29b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:17:01.206665 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:01.217549 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 500/1010] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:17:01 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 15:17:01.241490 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75daf75-3f6e-4106-8e61-f2402208c48b None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:01.271399 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 511/1011] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:17:01 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 15:17:01.291308 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7f6dec-e238-40ec-8c3e-5534baf29b30 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:01.353969 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75daf75-3f6e-4106-8e61-f2402208c48b None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:01.375792 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:01.398991 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf00788-025e-4bd0-8aba-00b489bcf176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:01.399788 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf00788-025e-4bd0-8aba-00b489bcf176 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:01.400135 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf00788-025e-4bd0-8aba-00b489bcf176 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:01.400417 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf00788-025e-4bd0-8aba-00b489bcf176 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:01.401656 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf00788-025e-4bd0-8aba-00b489bcf176 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:01.403051 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf00788-025e-4bd0-8aba-00b489bcf176 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:01.404919 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 501/1012] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:17:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:17:01.409782 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7f6dec-e238-40ec-8c3e-5534baf29b30 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:01.410862 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf00788-025e-4bd0-8aba-00b489bcf176 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:01.448766 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f8a4b5-7d21-4dd7-9940-c30cca130e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:01.449494 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8a4b5-7d21-4dd7-9940-c30cca130e2b None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:01.449780 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8a4b5-7d21-4dd7-9940-c30cca130e2b None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:01.450056 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8a4b5-7d21-4dd7-9940-c30cca130e2b None admin] PATH_INFO: `/v3/services/compute` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:01.451005 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f8a4b5-7d21-4dd7-9940-c30cca130e2b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:01.452879 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f8a4b5-7d21-4dd7-9940-c30cca130e2b None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:01.462911 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-68f8a4b5-7d21-4dd7-9940-c30cca130e2b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 15:17:01.462911 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:17:01.462911 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 15:17:01.462911 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 15:17:01.462911 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 15:17:01.462911 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 15:17:01.462911 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 15:17:01.462911 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 15:17:01.462911 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 15:17:01.462911 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:17:01.462911 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 15:17:01.462911 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:17:01.462911 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:17:01.462911 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:17:01.462911 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:17:01.462911 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:17:01.462911 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:17:01.464154 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:17:01.464154 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:17:01.464154 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:17:01.464154 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:17:01.464154 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:17:01.464154 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:17:01.464154 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 15:17:01.464154 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 15:17:01.464154 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 15:17:01.464154 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 15:17:01.464154 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:17:01.464154 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:17:01.464154 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:17:01.464154 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:17:01.464154 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:17:01.464154 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:17:01.465256 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:17:01.465256 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:17:01.465256 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:17:01.465256 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:17:01.465256 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:17:01.465256 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:17:01.465256 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:17:01.465256 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:17:01.465256 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:17:01.465256 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:17:01.465256 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 15:17:01.465256 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 15:17:01.465256 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 15:17:01.465256 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:17:01.465256 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 512/1013] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 2 15:17:01 2022] GET /identity/v3/services/compute => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 15:17:01.470114 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f8a4b5-7d21-4dd7-9940-c30cca130e2b None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:01.497262 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:01.526351 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf00788-025e-4bd0-8aba-00b489bcf176 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:01.563766 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8857c5e4-1c61-43d6-93aa-65abd78c9aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:01.564384 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8857c5e4-1c61-43d6-93aa-65abd78c9aaf None admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:01.564652 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8857c5e4-1c61-43d6-93aa-65abd78c9aaf None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:01.564923 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8857c5e4-1c61-43d6-93aa-65abd78c9aaf None admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:01.565582 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8857c5e4-1c61-43d6-93aa-65abd78c9aaf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:01.567562 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8857c5e4-1c61-43d6-93aa-65abd78c9aaf None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:01.583342 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f8a4b5-7d21-4dd7-9940-c30cca130e2b None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:01.596537 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 502/1014] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Aug 2 15:17:01 2022] POST /identity/v3/projects => generated 311 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:17:01.621164 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d433d960-b509-49e5-8df1-f9b10049ccf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:01.621768 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433d960-b509-49e5-8df1-f9b10049ccf2 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:01.622049 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433d960-b509-49e5-8df1-f9b10049ccf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:01.622325 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433d960-b509-49e5-8df1-f9b10049ccf2 None admin] PATH_INFO: `/v3/services` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:01.623025 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d433d960-b509-49e5-8df1-f9b10049ccf2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:17:01.623411 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d433d960-b509-49e5-8df1-f9b10049ccf2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:01.624855 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d433d960-b509-49e5-8df1-f9b10049ccf2 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:01.631470 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 513/1015] 10.222.0.42 () {56 vars in 1112 bytes} [Tue Aug 2 15:17:01 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:17:01.636762 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8857c5e4-1c61-43d6-93aa-65abd78c9aaf None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:01.674061 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:01.766893 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8857c5e4-1c61-43d6-93aa-65abd78c9aaf None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:01.803337 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d1f5b6-30b9-4b3b-b3a2-c70c7f64b326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:01.803976 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1f5b6-30b9-4b3b-b3a2-c70c7f64b326 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:01.804263 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1f5b6-30b9-4b3b-b3a2-c70c7f64b326 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:01.804545 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1f5b6-30b9-4b3b-b3a2-c70c7f64b326 None admin] PATH_INFO: `/v3/services` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:01.805255 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d1f5b6-30b9-4b3b-b3a2-c70c7f64b326 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:17:01.805567 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d1f5b6-30b9-4b3b-b3a2-c70c7f64b326 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:01.806944 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d1f5b6-30b9-4b3b-b3a2-c70c7f64b326 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:01.812658 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 503/1016] 10.222.0.42 () {56 vars in 1112 bytes} [Tue Aug 2 15:17:01 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:17:01.818785 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d433d960-b509-49e5-8df1-f9b10049ccf2 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:01.906887 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:01.924982 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d433d960-b509-49e5-8df1-f9b10049ccf2 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:01.960147 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8ba7b-4771-4b26-8a9c-b3d162b6ebd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:01.960940 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8ba7b-4771-4b26-8a9c-b3d162b6ebd9 None admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:01.961229 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8ba7b-4771-4b26-8a9c-b3d162b6ebd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:01.961504 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8ba7b-4771-4b26-8a9c-b3d162b6ebd9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:01.962209 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa8ba7b-4771-4b26-8a9c-b3d162b6ebd9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:01.963611 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa8ba7b-4771-4b26-8a9c-b3d162b6ebd9 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:01.987306 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 514/1017] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:17:01 2022] POST /identity/v3/endpoints => generated 334 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:17:02.003347 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a657d6-ccb7-452f-a00f-8d891743cb59 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:02.003660 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a657d6-ccb7-452f-a00f-8d891743cb59 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:02.003929 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a657d6-ccb7-452f-a00f-8d891743cb59 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:02.009168 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 504/1018] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:17:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:17:02.011551 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834ae04-1f90-48a6-ae57-7588bc56529c None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:02.011965 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834ae04-1f90-48a6-ae57-7588bc56529c None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:02.012397 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834ae04-1f90-48a6-ae57-7588bc56529c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:02.032517 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-5834ae04-1f90-48a6-ae57-7588bc56529c None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:17:02.033858 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-5834ae04-1f90-48a6-ae57-7588bc56529c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:17:02.115584 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 515/1019] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:17:02 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 15:17:02.141532 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a657d6-ccb7-452f-a00f-8d891743cb59 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:02.254266 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:02.263443 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a657d6-ccb7-452f-a00f-8d891743cb59 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:02.298412 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a429e0-d1ee-48fd-90ac-7037ae7dbc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:02.299038 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a429e0-d1ee-48fd-90ac-7037ae7dbc0c None admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:02.299354 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a429e0-d1ee-48fd-90ac-7037ae7dbc0c None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:02.299636 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a429e0-d1ee-48fd-90ac-7037ae7dbc0c None admin] PATH_INFO: `/v3/services` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:02.300391 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a429e0-d1ee-48fd-90ac-7037ae7dbc0c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:02.301791 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a429e0-d1ee-48fd-90ac-7037ae7dbc0c None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:02.319253 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 505/1020] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Aug 2 15:17:02 2022] POST /identity/v3/services => generated 242 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:17:03.661882 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4c9f1-07ea-4287-b73f-4a1000e724f1 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:03.662410 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4c9f1-07ea-4287-b73f-4a1000e724f1 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:03.662491 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4c9f1-07ea-4287-b73f-4a1000e724f1 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:03.664347 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 516/1021] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:17:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:17:03.669679 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8cd465-83a0-4a14-8626-80d64bbaee9f None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:03.670095 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8cd465-83a0-4a14-8626-80d64bbaee9f None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:03.670297 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8cd465-83a0-4a14-8626-80d64bbaee9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:03.688887 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-aa8cd465-83a0-4a14-8626-80d64bbaee9f None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:17:03.690077 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-aa8cd465-83a0-4a14-8626-80d64bbaee9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:17:03.767908 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 506/1022] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:17:03 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 15:17:03.793463 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4c9f1-07ea-4287-b73f-4a1000e724f1 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:03.869381 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:03.907760 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4c9f1-07ea-4287-b73f-4a1000e724f1 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:03.943468 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9575d6e0-cd31-4a34-b36b-efea4c97d5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:03.944114 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9575d6e0-cd31-4a34-b36b-efea4c97d5e8 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:03.944400 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9575d6e0-cd31-4a34-b36b-efea4c97d5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:03.944676 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9575d6e0-cd31-4a34-b36b-efea4c97d5e8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:03.945836 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9575d6e0-cd31-4a34-b36b-efea4c97d5e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:03.947300 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9575d6e0-cd31-4a34-b36b-efea4c97d5e8 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:03.956835 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 517/1023] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:17:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:17:03.957026 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8cd465-83a0-4a14-8626-80d64bbaee9f None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:04.043536 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:04.064807 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8cd465-83a0-4a14-8626-80d64bbaee9f None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:04.107654 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6311b-9f00-4e3c-a6f8-1e45a789a91f None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:04.108011 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6311b-9f00-4e3c-a6f8-1e45a789a91f None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:04.108187 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd22df-49e3-408a-846f-7f9fae3b831a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:04.108303 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6311b-9f00-4e3c-a6f8-1e45a789a91f None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:04.108775 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd22df-49e3-408a-846f-7f9fae3b831a None admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:04.109052 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd22df-49e3-408a-846f-7f9fae3b831a None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:04.109324 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd22df-49e3-408a-846f-7f9fae3b831a None admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:04.109850 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 518/1024] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:17:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 15:17:04.110039 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fd22df-49e3-408a-846f-7f9fae3b831a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:04.111485 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fd22df-49e3-408a-846f-7f9fae3b831a None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:04.114843 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b45ae-3bc0-4f57-bafe-07998a276763 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:04.115130 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b45ae-3bc0-4f57-bafe-07998a276763 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:04.115643 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b45ae-3bc0-4f57-bafe-07998a276763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:04.134793 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 507/1025] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Aug 2 15:17:03 2022] POST /identity/v3/users => generated 285 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 15:17:04.143508 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-615b45ae-3bc0-4f57-bafe-07998a276763 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:17:04.143508 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-615b45ae-3bc0-4f57-bafe-07998a276763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:17:04.226418 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 519/1026] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:17:04 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 15:17:04.249693 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd22df-49e3-408a-846f-7f9fae3b831a None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:04.337351 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97600ca-f60d-459d-85af-67ef8d098ef0 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:04.337688 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97600ca-f60d-459d-85af-67ef8d098ef0 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:04.337942 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97600ca-f60d-459d-85af-67ef8d098ef0 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:04.339556 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 520/1027] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:17:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:17:04.344490 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204dfd8-a5bc-4a57-b959-93fd4bf2e25e None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:04.345009 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204dfd8-a5bc-4a57-b959-93fd4bf2e25e None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:04.345482 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204dfd8-a5bc-4a57-b959-93fd4bf2e25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:04.361021 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd22df-49e3-408a-846f-7f9fae3b831a None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:04.371315 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-8204dfd8-a5bc-4a57-b959-93fd4bf2e25e None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:17:04.372517 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-8204dfd8-a5bc-4a57-b959-93fd4bf2e25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:17:04.404124 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a7cdf-55e0-467b-a9f1-58e94ce81c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:04.405019 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a7cdf-55e0-467b-a9f1-58e94ce81c54 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:04.405445 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a7cdf-55e0-467b-a9f1-58e94ce81c54 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:04.405896 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a7cdf-55e0-467b-a9f1-58e94ce81c54 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:04.415057 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:04.418646 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6a7cdf-55e0-467b-a9f1-58e94ce81c54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:17:04.424185 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-fd6a7cdf-55e0-467b-a9f1-58e94ce81c54 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 15:17:04.424185 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:17:04.424185 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:17:04.424185 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:17:04.424185 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:17:04.424185 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:17:04.424185 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:17:04.424185 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:17:04.424185 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:17:04.424185 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:17:04.424185 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:17:04.424185 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:17:04.424185 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:17:04.424185 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:17:04.424185 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:17:04.424185 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:17:04.425200 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:17:04.425200 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:17:04.425200 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:17:04.425200 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:17:04.425200 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:17:04.425200 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:17:04.425200 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:17:04.425200 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:17:04.425200 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:17:04.425200 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:17:04.425200 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:17:04.425200 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:17:04.425200 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:17:04.425200 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:17:04.425200 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:17:04.425200 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:17:04.426027 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:17:04.426027 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:17:04.426027 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:17:04.426027 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:17:04.426027 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:17:04.426027 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:17:04.426027 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:17:04.426027 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:17:04.426027 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:17:04.426027 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:17:04.426027 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 15:17:04.426027 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:17:04.428419 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 508/1028] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Aug 2 15:17:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:17:04.434239 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a7cdf-55e0-467b-a9f1-58e94ce81c54 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:04.443000 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:04.459562 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 521/1029] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:17:04 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 15:17:04.476821 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8204dfd8-a5bc-4a57-b959-93fd4bf2e25e None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:04.543508 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a7cdf-55e0-467b-a9f1-58e94ce81c54 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:04.579727 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d92fe2-1e22-4b8c-ab4d-bf48db2d3cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:04.580342 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d92fe2-1e22-4b8c-ab4d-bf48db2d3cff None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:04.580623 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d92fe2-1e22-4b8c-ab4d-bf48db2d3cff None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:04.580897 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d92fe2-1e22-4b8c-ab4d-bf48db2d3cff None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:04.581668 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d92fe2-1e22-4b8c-ab4d-bf48db2d3cff None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:17:04.582184 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d92fe2-1e22-4b8c-ab4d-bf48db2d3cff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:04.583698 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d92fe2-1e22-4b8c-ab4d-bf48db2d3cff None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:04.585528 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8204dfd8-a5bc-4a57-b959-93fd4bf2e25e None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:04.592184 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 509/1030] 10.222.0.42 () {56 vars in 1115 bytes} [Tue Aug 2 15:17:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:17:04.598621 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d92fe2-1e22-4b8c-ab4d-bf48db2d3cff None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:04.623466 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf549e8-ac6f-4a34-a6fa-45444bbc695f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:04.624542 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf549e8-ac6f-4a34-a6fa-45444bbc695f None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:04.624832 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf549e8-ac6f-4a34-a6fa-45444bbc695f None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:04.625106 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf549e8-ac6f-4a34-a6fa-45444bbc695f None admin] PATH_INFO: `/v3/services/image` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:04.625891 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf549e8-ac6f-4a34-a6fa-45444bbc695f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:04.627284 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf549e8-ac6f-4a34-a6fa-45444bbc695f None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:04.636391 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-fdf549e8-ac6f-4a34-a6fa-45444bbc695f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 15:17:04.636391 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:17:04.636391 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 15:17:04.636391 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 15:17:04.636391 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 15:17:04.636391 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 15:17:04.636391 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 15:17:04.636391 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 15:17:04.636391 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 15:17:04.636391 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:17:04.636391 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 15:17:04.636391 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:17:04.636391 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:17:04.636391 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:17:04.636391 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:17:04.636391 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:17:04.636391 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:17:04.637480 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:17:04.637480 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:17:04.637480 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:17:04.637480 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:17:04.637480 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:17:04.637480 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:17:04.637480 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 15:17:04.637480 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 15:17:04.637480 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 15:17:04.637480 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 15:17:04.637480 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:17:04.637480 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:17:04.637480 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:17:04.637480 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:17:04.637480 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:17:04.637480 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:17:04.639191 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:17:04.639191 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:17:04.639191 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:17:04.639191 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:17:04.639191 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:17:04.639191 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:17:04.639191 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:17:04.639191 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:17:04.639191 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:17:04.639191 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:17:04.639191 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 15:17:04.639191 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 15:17:04.639191 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 15:17:04.639191 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:17:04.639191 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 522/1031] 10.222.0.42 () {56 vars in 1105 bytes} [Tue Aug 2 15:17:04 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:17:04.643468 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf549e8-ac6f-4a34-a6fa-45444bbc695f None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:04.666899 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:04.705032 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:04.714388 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d92fe2-1e22-4b8c-ab4d-bf48db2d3cff None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:04.749487 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf549e8-ac6f-4a34-a6fa-45444bbc695f None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:04.750355 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cda22b-f7fb-4c1c-ad7a-4f45f58caeca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:04.751080 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cda22b-f7fb-4c1c-ad7a-4f45f58caeca None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:04.751526 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cda22b-f7fb-4c1c-ad7a-4f45f58caeca None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:04.751873 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cda22b-f7fb-4c1c-ad7a-4f45f58caeca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:04.763231 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cda22b-f7fb-4c1c-ad7a-4f45f58caeca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:04.764670 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cda22b-f7fb-4c1c-ad7a-4f45f58caeca None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:04.779360 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-f5cda22b-f7fb-4c1c-ad7a-4f45f58caeca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:17:04.779360 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:17:04.779360 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:17:04.779360 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:17:04.779360 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:17:04.779360 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:17:04.779360 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:17:04.779360 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:17:04.779360 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:17:04.779360 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:17:04.779360 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:17:04.779360 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:17:04.779360 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:17:04.779360 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:17:04.779360 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:17:04.780300 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:17:04.780300 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:17:04.780300 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:17:04.780300 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:17:04.780300 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:17:04.780300 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:17:04.780300 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:17:04.780300 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:17:04.780300 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:17:04.780300 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:17:04.780300 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:17:04.780300 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:17:04.780300 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:17:04.780300 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:17:04.780300 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:17:04.780300 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:17:04.780300 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:17:04.781187 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:17:04.781187 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:17:04.781187 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:17:04.781187 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:17:04.781187 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 510/1032] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:17:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:17:04.786176 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cda22b-f7fb-4c1c-ad7a-4f45f58caeca None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:04.786992 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f9533c-b569-4adf-a8ed-2ee6d0148f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:04.787646 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9533c-b569-4adf-a8ed-2ee6d0148f8b None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:04.787928 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9533c-b569-4adf-a8ed-2ee6d0148f8b None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:04.788202 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9533c-b569-4adf-a8ed-2ee6d0148f8b None admin] PATH_INFO: `/v3/services` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:04.789124 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f9533c-b569-4adf-a8ed-2ee6d0148f8b None admin] RBAC: Adding query filter params (name=image) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:17:04.789436 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f9533c-b569-4adf-a8ed-2ee6d0148f8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:04.790802 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f9533c-b569-4adf-a8ed-2ee6d0148f8b None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:04.795765 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 523/1033] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:17:04 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:17:04.801930 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f9533c-b569-4adf-a8ed-2ee6d0148f8b None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:04.899735 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cda22b-f7fb-4c1c-ad7a-4f45f58caeca None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:04.910009 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f9533c-b569-4adf-a8ed-2ee6d0148f8b None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:04.913756 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:04.936123 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:04.940848 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922beb78-ae39-4eec-af11-5211718ba275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:04.941480 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922beb78-ae39-4eec-af11-5211718ba275 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:04.941757 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922beb78-ae39-4eec-af11-5211718ba275 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:04.942032 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922beb78-ae39-4eec-af11-5211718ba275 None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:04.942713 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922beb78-ae39-4eec-af11-5211718ba275 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:17:04.943027 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922beb78-ae39-4eec-af11-5211718ba275 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:04.944418 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922beb78-ae39-4eec-af11-5211718ba275 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:04.950056 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ee9c9-4e12-4be7-9119-d997f0badb7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:04.950901 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ee9c9-4e12-4be7-9119-d997f0badb7a None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:04.951392 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ee9c9-4e12-4be7-9119-d997f0badb7a None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:04.951846 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ee9c9-4e12-4be7-9119-d997f0badb7a None admin] PATH_INFO: `/v3/services` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:04.952700 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934ee9c9-4e12-4be7-9119-d997f0badb7a None admin] RBAC: Adding query filter params (type=image) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:17:04.953073 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934ee9c9-4e12-4be7-9119-d997f0badb7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:04.954737 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934ee9c9-4e12-4be7-9119-d997f0badb7a None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:04.958511 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 511/1034] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:17:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:17:04.963442 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 524/1035] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:17:04 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:17:04.964061 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922beb78-ae39-4eec-af11-5211718ba275 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:04.967429 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ee9c9-4e12-4be7-9119-d997f0badb7a None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:05.074823 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922beb78-ae39-4eec-af11-5211718ba275 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:05.079630 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ee9c9-4e12-4be7-9119-d997f0badb7a None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:05.109605 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f719dc4a-bc9b-40ff-a152-20161d441bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:05.110238 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719dc4a-bc9b-40ff-a152-20161d441bc5 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:05.110515 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719dc4a-bc9b-40ff-a152-20161d441bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:05.110786 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719dc4a-bc9b-40ff-a152-20161d441bc5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:05.117797 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf1f6ee-c31c-4a3f-b411-93cb7d55cfdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:05.117943 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f719dc4a-bc9b-40ff-a152-20161d441bc5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:05.118789 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf1f6ee-c31c-4a3f-b411-93cb7d55cfdd None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:05.119353 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf1f6ee-c31c-4a3f-b411-93cb7d55cfdd None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:05.119462 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f719dc4a-bc9b-40ff-a152-20161d441bc5 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:05.120128 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf1f6ee-c31c-4a3f-b411-93cb7d55cfdd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:05.121066 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf1f6ee-c31c-4a3f-b411-93cb7d55cfdd None admin] RBAC: Adding query filter params (interface=public, service_id=82c02db67cc540b5b6bd75c8015e7794, region_id=RegionOne) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:17:05.121409 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf1f6ee-c31c-4a3f-b411-93cb7d55cfdd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:05.123300 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf1f6ee-c31c-4a3f-b411-93cb7d55cfdd None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:05.133742 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 525/1036] 10.222.0.42 () {56 vars in 1251 bytes} [Tue Aug 2 15:17:04 2022] GET /identity/v3/endpoints?service_id=82c02db67cc540b5b6bd75c8015e7794&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:17:05.133899 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-f719dc4a-bc9b-40ff-a152-20161d441bc5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 15:17:05.133899 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:17:05.133899 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:17:05.133899 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:17:05.133899 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:17:05.133899 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:17:05.133899 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:17:05.133899 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:17:05.133899 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:17:05.133899 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:17:05.133899 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:17:05.133899 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:17:05.133899 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 15:17:05.133899 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 15:17:05.133899 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 15:17:05.133899 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 15:17:05.134863 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:17:05.134863 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:17:05.134863 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 15:17:05.134863 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:17:05.134863 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 15:17:05.134863 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:17:05.134863 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:17:05.134863 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:17:05.134863 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:17:05.134863 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:17:05.134863 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:17:05.134863 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:17:05.134863 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:17:05.134863 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:17:05.134863 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:17:05.134863 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:17:05.134863 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:17:05.134863 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:17:05.135848 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:17:05.135848 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:17:05.135848 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 15:17:05.135848 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 15:17:05.135848 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 15:17:05.135848 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 15:17:05.135848 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 15:17:05.135848 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 15:17:05.135848 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 15:17:05.135848 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:17:05.135848 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 512/1037] 10.222.0.42 () {56 vars in 1093 bytes} [Tue Aug 2 15:17:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 15:17:05.138188 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf1f6ee-c31c-4a3f-b411-93cb7d55cfdd None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:05.138322 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f719dc4a-bc9b-40ff-a152-20161d441bc5 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:05.177222 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:05.197192 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:05.250638 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf1f6ee-c31c-4a3f-b411-93cb7d55cfdd None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:05.264235 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f719dc4a-bc9b-40ff-a152-20161d441bc5 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:05.291423 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2f5b60-361d-47d0-b7dd-e9e30ab5ddfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:05.292040 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f5b60-361d-47d0-b7dd-e9e30ab5ddfd None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:05.292322 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f5b60-361d-47d0-b7dd-e9e30ab5ddfd None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:05.292746 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f5b60-361d-47d0-b7dd-e9e30ab5ddfd None admin] PATH_INFO: `/v3/services` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:05.293236 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2f5b60-361d-47d0-b7dd-e9e30ab5ddfd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:05.294607 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2f5b60-361d-47d0-b7dd-e9e30ab5ddfd None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:05.301364 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb96257-887e-4d6c-bda6-cc866f8dc6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:05.301978 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb96257-887e-4d6c-bda6-cc866f8dc6b0 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:05.302383 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 526/1038] 10.222.0.42 () {56 vars in 1087 bytes} [Tue Aug 2 15:17:05 2022] GET /identity/v3/services => generated 1957 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:17:05.303337 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb96257-887e-4d6c-bda6-cc866f8dc6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:05.303653 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb96257-887e-4d6c-bda6-cc866f8dc6b0 None admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:05.304458 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb96257-887e-4d6c-bda6-cc866f8dc6b0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:17:05.304767 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb96257-887e-4d6c-bda6-cc866f8dc6b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:05.306260 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb96257-887e-4d6c-bda6-cc866f8dc6b0 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:05.327294 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 513/1039] 10.222.0.42 () {56 vars in 1133 bytes} [Tue Aug 2 15:17:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:17:05.333104 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2f5b60-361d-47d0-b7dd-e9e30ab5ddfd None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:05.444775 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2f5b60-361d-47d0-b7dd-e9e30ab5ddfd None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:05.461696 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:05.485541 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbabb79-6f14-409e-815c-a2969c57a472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:05.486159 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbabb79-6f14-409e-815c-a2969c57a472 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:05.486438 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbabb79-6f14-409e-815c-a2969c57a472 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:05.486709 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbabb79-6f14-409e-815c-a2969c57a472 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:05.554813 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbabb79-6f14-409e-815c-a2969c57a472 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:05.556291 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbabb79-6f14-409e-815c-a2969c57a472 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:05.654361 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 527/1040] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 2 15:17:05 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 15:17:05.661118 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb96257-887e-4d6c-bda6-cc866f8dc6b0 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:05.750806 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:05.762175 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb96257-887e-4d6c-bda6-cc866f8dc6b0 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:05.797064 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe83bac-ef22-4f70-b091-73c069181c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:05.797711 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe83bac-ef22-4f70-b091-73c069181c0f None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:05.797988 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe83bac-ef22-4f70-b091-73c069181c0f None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:05.798461 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe83bac-ef22-4f70-b091-73c069181c0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:05.809549 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe83bac-ef22-4f70-b091-73c069181c0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:05.810998 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe83bac-ef22-4f70-b091-73c069181c0f None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:05.826349 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-3fe83bac-ef22-4f70-b091-73c069181c0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:17:05.826349 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:17:05.826349 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:17:05.826349 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:17:05.826349 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:17:05.826349 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:17:05.826349 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:17:05.826349 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:17:05.826349 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:17:05.826349 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:17:05.826349 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:17:05.826349 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:17:05.826349 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:17:05.826349 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:17:05.826349 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:17:05.827491 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:17:05.827491 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:17:05.827491 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:17:05.827491 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:17:05.827491 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:17:05.827491 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:17:05.827491 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:17:05.827491 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:17:05.827491 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:17:05.827491 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:17:05.827491 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:17:05.827491 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:17:05.827491 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:17:05.827491 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:17:05.827491 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:17:05.827491 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:17:05.827491 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:17:05.828418 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:17:05.828418 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:17:05.828418 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:17:05.828418 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:17:05.828418 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 514/1041] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:17:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 15:17:05.834064 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbabb79-6f14-409e-815c-a2969c57a472 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:05.850565 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:05.939540 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbabb79-6f14-409e-815c-a2969c57a472 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:05.975074 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db21d9a-fd78-495e-a955-30b599c99ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:05.975728 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db21d9a-fd78-495e-a955-30b599c99ba4 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:05.976015 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db21d9a-fd78-495e-a955-30b599c99ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:05.976292 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db21d9a-fd78-495e-a955-30b599c99ba4 None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:05.976988 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db21d9a-fd78-495e-a955-30b599c99ba4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:17:05.977304 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db21d9a-fd78-495e-a955-30b599c99ba4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:05.978675 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db21d9a-fd78-495e-a955-30b599c99ba4 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:05.994619 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 528/1042] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:17:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:17:05.996092 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe83bac-ef22-4f70-b091-73c069181c0f None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:06.100120 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe83bac-ef22-4f70-b091-73c069181c0f None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:06.133785 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e8e27a-740f-4557-ae46-ada291f477be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:06.134417 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e8e27a-740f-4557-ae46-ada291f477be None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:06.134702 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e8e27a-740f-4557-ae46-ada291f477be None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:06.134971 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e8e27a-740f-4557-ae46-ada291f477be None admin] PATH_INFO: `/v3/projects/service` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:06.141681 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e8e27a-740f-4557-ae46-ada291f477be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:06.143116 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e8e27a-740f-4557-ae46-ada291f477be None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:06.162810 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-42e8e27a-740f-4557-ae46-ada291f477be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:17:06.162810 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:17:06.162810 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:17:06.162810 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:17:06.162810 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:17:06.162810 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:17:06.162810 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:17:06.162810 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:17:06.162810 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:17:06.162810 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:17:06.162810 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:17:06.162810 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:17:06.162810 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 15:17:06.162810 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 15:17:06.162810 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 15:17:06.163794 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 15:17:06.163794 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:17:06.163794 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:17:06.163794 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:17:06.163794 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:17:06.163794 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:17:06.163794 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:17:06.163794 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:17:06.163794 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:17:06.163794 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:17:06.163794 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:17:06.163794 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:17:06.163794 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:17:06.163794 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:17:06.163794 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:17:06.163794 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:17:06.163794 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:17:06.164979 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 15:17:06.164979 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 15:17:06.164979 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 15:17:06.164979 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 15:17:06.164979 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 15:17:06.164979 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 15:17:06.164979 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:17:06.164979 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:17:06.167525 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 515/1043] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 2 15:17:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:17:06.169967 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db21d9a-fd78-495e-a955-30b599c99ba4 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:06.248907 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:06.276326 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db21d9a-fd78-495e-a955-30b599c99ba4 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:06.276892 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab18d13-3157-48bc-935c-ea8cf9ca83d2 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:06.277187 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab18d13-3157-48bc-935c-ea8cf9ca83d2 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:06.277469 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab18d13-3157-48bc-935c-ea8cf9ca83d2 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:06.278830 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 516/1044] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:17:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 15:17:06.283857 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9db2a-3c64-4798-a4a1-7c681f85a22a None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:06.284142 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9db2a-3c64-4798-a4a1-7c681f85a22a None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:06.284978 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9db2a-3c64-4798-a4a1-7c681f85a22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:06.291587 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:06.306529 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-d5d9db2a-3c64-4798-a4a1-7c681f85a22a None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:17:06.308268 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-d5d9db2a-3c64-4798-a4a1-7c681f85a22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:17:06.312417 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b72a15-747a-490e-b22f-73e3c071e3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:06.313036 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b72a15-747a-490e-b22f-73e3c071e3c5 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:06.313330 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b72a15-747a-490e-b22f-73e3c071e3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:06.313595 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b72a15-747a-490e-b22f-73e3c071e3c5 None admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:06.314340 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b72a15-747a-490e-b22f-73e3c071e3c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:17:06.314653 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b72a15-747a-490e-b22f-73e3c071e3c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:06.316300 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b72a15-747a-490e-b22f-73e3c071e3c5 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:06.334683 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 529/1045] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 2 15:17:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:17:06.335833 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b72a15-747a-490e-b22f-73e3c071e3c5 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:06.387396 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 517/1046] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:17:06 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 15:17:06.409058 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d9db2a-3c64-4798-a4a1-7c681f85a22a None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:06.452144 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b72a15-747a-490e-b22f-73e3c071e3c5 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:06.489627 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b77ed1f-d35e-440f-9c8a-1aa568a75c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:06.490262 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77ed1f-d35e-440f-9c8a-1aa568a75c25 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:06.490542 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77ed1f-d35e-440f-9c8a-1aa568a75c25 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:06.490815 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77ed1f-d35e-440f-9c8a-1aa568a75c25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:06.491639 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b77ed1f-d35e-440f-9c8a-1aa568a75c25 None admin] RBAC: Adding query filter params (role.id=1df4511e5e2b47278b0bf4cd5acbeb38, scope.project.id=cc19d22b4cd64dd1bc89ed78155d2732, user.id=4c0865af59bf43dfa4c84213d7db53c5) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:17:06.491951 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b77ed1f-d35e-440f-9c8a-1aa568a75c25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:06.493407 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b77ed1f-d35e-440f-9c8a-1aa568a75c25 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:06.495480 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:06.500062 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 530/1047] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 2 15:17:06 2022] GET /identity/v3/role_assignments?user.id=4c0865af59bf43dfa4c84213d7db53c5&scope.project.id=cc19d22b4cd64dd1bc89ed78155d2732&role.id=1df4511e5e2b47278b0bf4cd5acbeb38 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:17:06.539723 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d9db2a-3c64-4798-a4a1-7c681f85a22a None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:06.573358 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:06.580232 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e56fe-dacc-460d-afb6-d8ca9782a2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:06.580896 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e56fe-dacc-460d-afb6-d8ca9782a2e8 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:06.581724 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e56fe-dacc-460d-afb6-d8ca9782a2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:06.582117 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e56fe-dacc-460d-afb6-d8ca9782a2e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:06.593749 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9e56fe-dacc-460d-afb6-d8ca9782a2e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:17:06.598859 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-1a9e56fe-dacc-460d-afb6-d8ca9782a2e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 15:17:06.598859 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:17:06.598859 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:17:06.598859 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:17:06.598859 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:17:06.598859 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:17:06.598859 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:17:06.598859 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:17:06.598859 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:17:06.598859 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:17:06.598859 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:17:06.598859 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:17:06.598859 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:17:06.598859 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:17:06.598859 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:17:06.598859 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:17:06.599946 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:17:06.599946 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:17:06.599946 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:17:06.599946 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:17:06.599946 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:17:06.599946 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:17:06.599946 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:17:06.599946 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:17:06.599946 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:17:06.599946 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:17:06.599946 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:17:06.599946 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:17:06.599946 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:17:06.599946 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:17:06.599946 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:17:06.599946 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:17:06.600785 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:17:06.600785 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:17:06.600785 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:17:06.600785 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:17:06.600785 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:17:06.600785 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:17:06.600785 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:17:06.600785 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:17:06.600785 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:17:06.600785 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:17:06.600785 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 15:17:06.600785 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:17:06.600785 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 518/1048] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 2 15:17:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 15:17:06.607349 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b77ed1f-d35e-440f-9c8a-1aa568a75c25 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:06.718276 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b77ed1f-d35e-440f-9c8a-1aa568a75c25 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:06.752491 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088eb51-735c-49d3-8a91-fbef4f253cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:06.753670 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088eb51-735c-49d3-8a91-fbef4f253cbb None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:06.753959 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088eb51-735c-49d3-8a91-fbef4f253cbb None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:06.754237 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088eb51-735c-49d3-8a91-fbef4f253cbb None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:06.754943 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4088eb51-735c-49d3-8a91-fbef4f253cbb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:17:06.755287 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4088eb51-735c-49d3-8a91-fbef4f253cbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:06.756793 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4088eb51-735c-49d3-8a91-fbef4f253cbb None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:06.788122 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 531/1049] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 2 15:17:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:17:06.790322 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e56fe-dacc-460d-afb6-d8ca9782a2e8 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:06.902056 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e56fe-dacc-460d-afb6-d8ca9782a2e8 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:06.937515 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e01871-7662-4823-8417-3cfd6b8ec8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:06.938155 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e01871-7662-4823-8417-3cfd6b8ec8a0 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:06.938437 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e01871-7662-4823-8417-3cfd6b8ec8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:06.938714 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e01871-7662-4823-8417-3cfd6b8ec8a0 None admin] PATH_INFO: `/v3/users/5bce7b11f8314be7ae635e1218cf345e` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:06.954257 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e01871-7662-4823-8417-3cfd6b8ec8a0 None admin] RBAC: Authorizing `identity:get_user(user_id=5bce7b11f8314be7ae635e1218cf345e)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:06.955751 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e01871-7662-4823-8417-3cfd6b8ec8a0 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:06.958193 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 519/1050] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 2 15:17:06 2022] GET /identity/v3/users/5bce7b11f8314be7ae635e1218cf345e => generated 285 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:17:06.963817 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088eb51-735c-49d3-8a91-fbef4f253cbb None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:07.025424 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:07.067498 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088eb51-735c-49d3-8a91-fbef4f253cbb None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:07.103430 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5839f093-1ed2-4700-9985-983107010555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:07.103946 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839f093-1ed2-4700-9985-983107010555 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:07.104398 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839f093-1ed2-4700-9985-983107010555 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:07.104545 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839f093-1ed2-4700-9985-983107010555 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:07.186628 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5839f093-1ed2-4700-9985-983107010555 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:07.188126 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5839f093-1ed2-4700-9985-983107010555 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:07.248920 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:07.297763 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 532/1051] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 2 15:17:06 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 15:17:07.298992 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e01871-7662-4823-8417-3cfd6b8ec8a0 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:07.349457 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:07.400680 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e01871-7662-4823-8417-3cfd6b8ec8a0 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:07.403146 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9675a-cc4f-46a0-bde4-8f5b5b026958 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:07.403474 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9675a-cc4f-46a0-bde4-8f5b5b026958 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:07.403758 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9675a-cc4f-46a0-bde4-8f5b5b026958 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:07.405126 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 533/1052] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:17:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:17:07.410467 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c835b-5f69-4c01-871c-49b5df78d0fc None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:07.410939 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c835b-5f69-4c01-871c-49b5df78d0fc None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:07.411243 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c835b-5f69-4c01-871c-49b5df78d0fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:07.430159 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-012c835b-5f69-4c01-871c-49b5df78d0fc None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:17:07.431583 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-012c835b-5f69-4c01-871c-49b5df78d0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:17:07.436442 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b46170e-28af-4976-9535-960b27817617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:07.437089 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46170e-28af-4976-9535-960b27817617 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:07.437372 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46170e-28af-4976-9535-960b27817617 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:07.437648 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46170e-28af-4976-9535-960b27817617 None admin] PATH_INFO: `/v3/projects/88589b88dded4dd187aaa069c3f09997` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:07.438822 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b46170e-28af-4976-9535-960b27817617 None admin] RBAC: Authorizing `identity:get_project(project_id=88589b88dded4dd187aaa069c3f09997)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:07.440296 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b46170e-28af-4976-9535-960b27817617 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:07.442573 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 520/1053] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 2 15:17:07 2022] GET /identity/v3/projects/88589b88dded4dd187aaa069c3f09997 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:17:07.449103 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b46170e-28af-4976-9535-960b27817617 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:07.513727 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 534/1054] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:17:07 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 15:17:07.536634 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c835b-5f69-4c01-871c-49b5df78d0fc None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:07.562479 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b46170e-28af-4976-9535-960b27817617 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:07.584005 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:07.603029 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096889e6-d909-46ab-8981-ce7dec0482aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:07.603975 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096889e6-d909-46ab-8981-ce7dec0482aa None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:07.604256 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096889e6-d909-46ab-8981-ce7dec0482aa None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:07.604644 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096889e6-d909-46ab-8981-ce7dec0482aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:07.605449 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096889e6-d909-46ab-8981-ce7dec0482aa None admin] RBAC: Adding query filter params (role.id=d75c9572cb294caeb8eb456521ff6f57, scope.project.id=88589b88dded4dd187aaa069c3f09997, user.id=5bce7b11f8314be7ae635e1218cf345e) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:17:07.605765 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096889e6-d909-46ab-8981-ce7dec0482aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:07.607294 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096889e6-d909-46ab-8981-ce7dec0482aa None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:07.614049 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 521/1055] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 2 15:17:07 2022] GET /identity/v3/role_assignments?user.id=5bce7b11f8314be7ae635e1218cf345e&scope.project.id=88589b88dded4dd187aaa069c3f09997&role.id=d75c9572cb294caeb8eb456521ff6f57 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:17:07.649776 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:07.664259 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c835b-5f69-4c01-871c-49b5df78d0fc None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:07.704418 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78eb35a-ed96-43aa-97e4-9953a19f834b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:07.705089 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78eb35a-ed96-43aa-97e4-9953a19f834b None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:07.705374 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78eb35a-ed96-43aa-97e4-9953a19f834b None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:07.705655 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78eb35a-ed96-43aa-97e4-9953a19f834b None admin] PATH_INFO: `/v3/services/image` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:07.706295 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78eb35a-ed96-43aa-97e4-9953a19f834b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:07.707738 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78eb35a-ed96-43aa-97e4-9953a19f834b None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:07.717731 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-c78eb35a-ed96-43aa-97e4-9953a19f834b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 15:17:07.717731 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:17:07.717731 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 15:17:07.717731 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 15:17:07.717731 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 15:17:07.717731 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 15:17:07.717731 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 15:17:07.717731 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 15:17:07.717731 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 15:17:07.717731 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:17:07.717731 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 15:17:07.717731 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:17:07.717731 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:17:07.717731 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:17:07.717731 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:17:07.717731 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:17:07.717731 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:17:07.718813 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:17:07.718813 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:17:07.718813 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:17:07.718813 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:17:07.718813 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:17:07.718813 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:17:07.718813 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 15:17:07.718813 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 15:17:07.718813 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 15:17:07.718813 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 15:17:07.718813 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:17:07.718813 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:17:07.718813 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:17:07.718813 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:17:07.718813 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:17:07.718813 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:17:07.719718 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:17:07.719718 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:17:07.719718 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:17:07.719718 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:17:07.719718 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:17:07.719718 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:17:07.719718 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:17:07.719718 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:17:07.719718 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:17:07.719718 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:17:07.719718 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 15:17:07.719718 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 15:17:07.719718 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 15:17:07.719718 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:17:07.723599 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 535/1056] 10.222.0.42 () {56 vars in 1105 bytes} [Tue Aug 2 15:17:07 2022] GET /identity/v3/services/image => generated 86 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 15:17:07.725414 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096889e6-d909-46ab-8981-ce7dec0482aa None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:07.833045 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096889e6-d909-46ab-8981-ce7dec0482aa None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:07.867456 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e18e0d-7c50-4e84-b505-a26eca04bdab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:07.868074 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e18e0d-7c50-4e84-b505-a26eca04bdab None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:07.868352 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e18e0d-7c50-4e84-b505-a26eca04bdab None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:07.868623 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e18e0d-7c50-4e84-b505-a26eca04bdab None admin] PATH_INFO: `/v3/services` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:07.869297 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e18e0d-7c50-4e84-b505-a26eca04bdab None admin] RBAC: Adding query filter params (name=image) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:17:07.869598 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e18e0d-7c50-4e84-b505-a26eca04bdab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:07.870948 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e18e0d-7c50-4e84-b505-a26eca04bdab None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:07.876149 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 522/1057] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:17:07 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:17:07.882164 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78eb35a-ed96-43aa-97e4-9953a19f834b None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:07.991245 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78eb35a-ed96-43aa-97e4-9953a19f834b None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:08.025258 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ca209-2c87-4f2c-87df-225fef38bc87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:08.025877 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ca209-2c87-4f2c-87df-225fef38bc87 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:08.026160 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ca209-2c87-4f2c-87df-225fef38bc87 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:08.026436 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ca209-2c87-4f2c-87df-225fef38bc87 None admin] PATH_INFO: `/v3/services` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:08.027111 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20ca209-2c87-4f2c-87df-225fef38bc87 None admin] RBAC: Adding query filter params (type=image) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:17:08.027446 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20ca209-2c87-4f2c-87df-225fef38bc87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:08.028831 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20ca209-2c87-4f2c-87df-225fef38bc87 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:08.039286 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 536/1058] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:17:07 2022] GET /identity/v3/services?type=image => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:17:08.040522 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e18e0d-7c50-4e84-b505-a26eca04bdab None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:08.090358 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:08.149299 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e18e0d-7c50-4e84-b505-a26eca04bdab None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:08.186879 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de40d76f-316a-48bd-be71-cfecbaee4b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:08.187543 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40d76f-316a-48bd-be71-cfecbaee4b6a None admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:08.187819 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40d76f-316a-48bd-be71-cfecbaee4b6a None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:08.188090 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40d76f-316a-48bd-be71-cfecbaee4b6a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:08.188804 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de40d76f-316a-48bd-be71-cfecbaee4b6a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:08.190162 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de40d76f-316a-48bd-be71-cfecbaee4b6a None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:08.211463 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 523/1059] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:17:08 2022] POST /identity/v3/endpoints => generated 327 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 15:17:08.526276 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e03bb6-595b-4333-ad66-571afa0edf0f None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:08.526677 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e03bb6-595b-4333-ad66-571afa0edf0f None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:08.526855 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e03bb6-595b-4333-ad66-571afa0edf0f None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:08.528279 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 537/1060] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:17:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:17:08.533386 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339bde8-0651-4f3e-9538-46ad30f56b5b None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:08.533683 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339bde8-0651-4f3e-9538-46ad30f56b5b None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:08.533968 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339bde8-0651-4f3e-9538-46ad30f56b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:08.553465 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-a339bde8-0651-4f3e-9538-46ad30f56b5b None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:17:08.554650 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-a339bde8-0651-4f3e-9538-46ad30f56b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:17:08.630286 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 524/1061] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:17:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 15:17:08.652225 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e03bb6-595b-4333-ad66-571afa0edf0f None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:08.672475 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:08.767394 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e03bb6-595b-4333-ad66-571afa0edf0f None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:08.803887 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec0a78-fe04-45b9-a2de-f15c5100f26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:08.804447 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec0a78-fe04-45b9-a2de-f15c5100f26c None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:08.804729 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec0a78-fe04-45b9-a2de-f15c5100f26c None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:08.805004 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec0a78-fe04-45b9-a2de-f15c5100f26c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:08.815993 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cec0a78-fe04-45b9-a2de-f15c5100f26c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:17:08.820895 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-0cec0a78-fe04-45b9-a2de-f15c5100f26c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 15:17:08.820895 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:17:08.820895 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:17:08.820895 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:17:08.820895 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:17:08.820895 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:17:08.820895 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:17:08.820895 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:17:08.820895 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:17:08.820895 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:17:08.820895 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:17:08.820895 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:17:08.820895 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:17:08.820895 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:17:08.820895 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:17:08.820895 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:17:08.821990 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:17:08.821990 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:17:08.821990 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:17:08.821990 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:17:08.821990 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:17:08.821990 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:17:08.821990 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:17:08.821990 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:17:08.821990 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:17:08.821990 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:17:08.821990 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:17:08.821990 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:17:08.821990 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:17:08.821990 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:17:08.821990 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:17:08.821990 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:17:08.822814 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:17:08.822814 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:17:08.822814 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:17:08.822814 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:17:08.822814 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:17:08.822814 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:17:08.822814 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:17:08.822814 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:17:08.822814 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:17:08.822814 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:17:08.822814 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 15:17:08.822814 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:17:08.827031 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 538/1062] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Aug 2 15:17:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:17:08.828063 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339bde8-0651-4f3e-9538-46ad30f56b5b None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:08.861476 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:08.944229 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339bde8-0651-4f3e-9538-46ad30f56b5b None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:08.978028 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3246d24e-76cd-4389-b6b9-57f4fc17c34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:08.978654 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3246d24e-76cd-4389-b6b9-57f4fc17c34c None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:08.978935 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3246d24e-76cd-4389-b6b9-57f4fc17c34c None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:08.979208 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3246d24e-76cd-4389-b6b9-57f4fc17c34c None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:08.979943 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3246d24e-76cd-4389-b6b9-57f4fc17c34c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:17:08.980247 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3246d24e-76cd-4389-b6b9-57f4fc17c34c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:08.981605 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3246d24e-76cd-4389-b6b9-57f4fc17c34c None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:08.994720 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 525/1063] 10.222.0.42 () {56 vars in 1115 bytes} [Tue Aug 2 15:17:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:17:08.996384 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec0a78-fe04-45b9-a2de-f15c5100f26c None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:09.075529 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:09.099036 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec0a78-fe04-45b9-a2de-f15c5100f26c None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:09.133773 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f164d1-d9f9-414b-8386-fa524024d3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:09.134409 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f164d1-d9f9-414b-8386-fa524024d3e6 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:09.134686 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f164d1-d9f9-414b-8386-fa524024d3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:09.135007 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f164d1-d9f9-414b-8386-fa524024d3e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:09.148639 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f164d1-d9f9-414b-8386-fa524024d3e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:09.150098 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f164d1-d9f9-414b-8386-fa524024d3e6 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:09.165722 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-01f164d1-d9f9-414b-8386-fa524024d3e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:17:09.165722 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:17:09.165722 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:17:09.165722 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:17:09.165722 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:17:09.165722 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:17:09.165722 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:17:09.165722 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:17:09.165722 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:17:09.165722 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:17:09.165722 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:17:09.165722 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:17:09.165722 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:17:09.165722 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:17:09.165722 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:17:09.166605 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:17:09.166605 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:17:09.166605 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:17:09.166605 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:17:09.166605 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:17:09.166605 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:17:09.166605 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:17:09.166605 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:17:09.166605 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:17:09.166605 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:17:09.166605 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:17:09.166605 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:17:09.166605 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:17:09.166605 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:17:09.166605 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:17:09.166605 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:17:09.166605 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:17:09.172331 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:17:09.172331 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:17:09.172331 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:17:09.172331 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:17:09.172331 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 539/1064] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:17:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:17:09.174228 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3246d24e-76cd-4389-b6b9-57f4fc17c34c None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:09.274263 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:09.285671 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3246d24e-76cd-4389-b6b9-57f4fc17c34c None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:09.319268 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0dd8b-1f54-495d-85f3-84efe2d1aa45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:09.319740 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0dd8b-1f54-495d-85f3-84efe2d1aa45 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:09.320024 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0dd8b-1f54-495d-85f3-84efe2d1aa45 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:09.320303 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0dd8b-1f54-495d-85f3-84efe2d1aa45 None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:09.320989 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0dd8b-1f54-495d-85f3-84efe2d1aa45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:17:09.321298 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0dd8b-1f54-495d-85f3-84efe2d1aa45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:09.322664 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0dd8b-1f54-495d-85f3-84efe2d1aa45 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:09.339820 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 526/1065] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:17:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:17:09.341400 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f164d1-d9f9-414b-8386-fa524024d3e6 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:09.447823 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f164d1-d9f9-414b-8386-fa524024d3e6 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:09.476436 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:09.483583 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f55bb2-391a-42fb-b355-dc948d107192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:09.484221 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f55bb2-391a-42fb-b355-dc948d107192 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:09.484499 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f55bb2-391a-42fb-b355-dc948d107192 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:09.484768 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f55bb2-391a-42fb-b355-dc948d107192 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:09.492282 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f55bb2-391a-42fb-b355-dc948d107192 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:09.493718 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f55bb2-391a-42fb-b355-dc948d107192 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:09.504983 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-28f55bb2-391a-42fb-b355-dc948d107192 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 15:17:09.504983 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:17:09.504983 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:17:09.504983 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:17:09.504983 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:17:09.504983 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:17:09.504983 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:17:09.504983 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:17:09.504983 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:17:09.504983 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:17:09.504983 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:17:09.504983 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:17:09.504983 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 15:17:09.504983 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 15:17:09.504983 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 15:17:09.504983 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 15:17:09.505977 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:17:09.505977 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:17:09.505977 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 15:17:09.505977 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:17:09.505977 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 15:17:09.505977 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:17:09.505977 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:17:09.505977 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:17:09.505977 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:17:09.505977 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:17:09.505977 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:17:09.505977 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:17:09.505977 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:17:09.505977 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:17:09.505977 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:17:09.505977 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:17:09.505977 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:17:09.505977 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:17:09.506945 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:17:09.506945 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:17:09.506945 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 15:17:09.506945 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 15:17:09.506945 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 15:17:09.506945 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 15:17:09.506945 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 15:17:09.506945 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 15:17:09.506945 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 15:17:09.506945 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:17:09.510845 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 540/1066] 10.222.0.42 () {56 vars in 1093 bytes} [Tue Aug 2 15:17:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:17:09.512316 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0dd8b-1f54-495d-85f3-84efe2d1aa45 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:09.617286 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0dd8b-1f54-495d-85f3-84efe2d1aa45 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:09.649847 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2326ed-8697-4d92-a946-2a55ab3043d2 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:09.650122 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2326ed-8697-4d92-a946-2a55ab3043d2 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:09.650391 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2326ed-8697-4d92-a946-2a55ab3043d2 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:09.655246 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 541/1067] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:17:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:17:09.656762 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d181a-43c0-499f-a1a0-9d2438ec529f None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:09.657050 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d181a-43c0-499f-a1a0-9d2438ec529f None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:09.657340 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d181a-43c0-499f-a1a0-9d2438ec529f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:09.658183 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c7feba-cfc0-4909-b6fb-9e423a5381a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:09.658812 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c7feba-cfc0-4909-b6fb-9e423a5381a5 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:09.659093 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c7feba-cfc0-4909-b6fb-9e423a5381a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:09.659445 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c7feba-cfc0-4909-b6fb-9e423a5381a5 None admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:09.660236 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c7feba-cfc0-4909-b6fb-9e423a5381a5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:17:09.660548 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c7feba-cfc0-4909-b6fb-9e423a5381a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:09.661970 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c7feba-cfc0-4909-b6fb-9e423a5381a5 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:09.677206 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-e07d181a-43c0-499f-a1a0-9d2438ec529f None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:17:09.678592 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-e07d181a-43c0-499f-a1a0-9d2438ec529f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:17:09.685490 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 527/1068] 10.222.0.42 () {56 vars in 1133 bytes} [Tue Aug 2 15:17:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:17:09.687108 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c7feba-cfc0-4909-b6fb-9e423a5381a5 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:09.699103 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:09.750775 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 542/1069] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:17:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 15:17:09.774001 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07d181a-43c0-499f-a1a0-9d2438ec529f None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:09.800159 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c7feba-cfc0-4909-b6fb-9e423a5381a5 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:09.836017 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd8dc7-17f1-477b-896b-71a7c09f4bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:09.836664 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd8dc7-17f1-477b-896b-71a7c09f4bbf None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:09.836948 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd8dc7-17f1-477b-896b-71a7c09f4bbf None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:09.837225 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd8dc7-17f1-477b-896b-71a7c09f4bbf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:09.847383 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dd8dc7-17f1-477b-896b-71a7c09f4bbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:09.848830 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dd8dc7-17f1-477b-896b-71a7c09f4bbf None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:09.864052 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-21dd8dc7-17f1-477b-896b-71a7c09f4bbf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:17:09.864052 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:17:09.864052 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:17:09.864052 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:17:09.864052 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:17:09.864052 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:17:09.864052 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:17:09.864052 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:17:09.864052 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:17:09.864052 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:17:09.864052 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:17:09.864052 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:17:09.864052 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:17:09.864052 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:17:09.864052 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:17:09.865415 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:17:09.865415 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:17:09.865415 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:17:09.865415 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:17:09.865415 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:17:09.865415 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:17:09.865415 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:17:09.865415 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:17:09.865415 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:17:09.865415 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:17:09.865415 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:17:09.865415 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:17:09.865415 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:17:09.865415 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:17:09.865415 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:17:09.865415 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:17:09.865415 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:17:09.866351 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:17:09.866351 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:17:09.866351 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:17:09.866351 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:17:09.866351 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 528/1070] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:17:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 15:17:09.870995 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd8dc7-17f1-477b-896b-71a7c09f4bbf None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:09.891635 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07d181a-43c0-499f-a1a0-9d2438ec529f None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:09.915128 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:09.932156 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81295275-df91-45ee-9444-cd1bee1c1c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:09.933127 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81295275-df91-45ee-9444-cd1bee1c1c48 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:09.933541 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:09.934296 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81295275-df91-45ee-9444-cd1bee1c1c48 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:09.934799 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81295275-df91-45ee-9444-cd1bee1c1c48 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:09.946550 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81295275-df91-45ee-9444-cd1bee1c1c48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:17:09.951500 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-81295275-df91-45ee-9444-cd1bee1c1c48 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 15:17:09.951500 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:17:09.951500 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:17:09.951500 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:17:09.951500 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:17:09.951500 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:17:09.951500 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:17:09.951500 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:17:09.951500 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:17:09.951500 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:17:09.951500 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:17:09.951500 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:17:09.951500 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:17:09.951500 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:17:09.951500 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:17:09.951500 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:17:09.952475 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:17:09.952475 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:17:09.952475 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:17:09.952475 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:17:09.952475 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:17:09.952475 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:17:09.952475 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:17:09.952475 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:17:09.952475 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:17:09.952475 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:17:09.952475 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:17:09.952475 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:17:09.952475 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:17:09.952475 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:17:09.952475 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:17:09.952475 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:17:09.953346 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:17:09.953346 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:17:09.953346 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:17:09.953346 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:17:09.953346 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:17:09.953346 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:17:09.953346 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:17:09.953346 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:17:09.953346 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:17:09.953346 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:17:09.953346 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 15:17:09.953346 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:17:09.955580 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 543/1071] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 2 15:17:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 15:17:09.958588 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81295275-df91-45ee-9444-cd1bee1c1c48 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:09.979204 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd8dc7-17f1-477b-896b-71a7c09f4bbf None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:10.014637 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565a552d-2ee6-48ad-b540-78c119774881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:10.015280 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a552d-2ee6-48ad-b540-78c119774881 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:10.015593 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a552d-2ee6-48ad-b540-78c119774881 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:10.015849 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a552d-2ee6-48ad-b540-78c119774881 None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:10.016533 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565a552d-2ee6-48ad-b540-78c119774881 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:17:10.016839 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565a552d-2ee6-48ad-b540-78c119774881 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:10.018202 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565a552d-2ee6-48ad-b540-78c119774881 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:10.030421 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 529/1072] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:17:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:17:10.035793 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565a552d-2ee6-48ad-b540-78c119774881 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:10.065187 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81295275-df91-45ee-9444-cd1bee1c1c48 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:10.103123 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36a385-40ae-4087-9952-6e90dd2abf46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:10.103770 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36a385-40ae-4087-9952-6e90dd2abf46 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:10.104053 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36a385-40ae-4087-9952-6e90dd2abf46 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:10.104330 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36a385-40ae-4087-9952-6e90dd2abf46 None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:10.105043 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b36a385-40ae-4087-9952-6e90dd2abf46 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:17:10.105347 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b36a385-40ae-4087-9952-6e90dd2abf46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:10.106716 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b36a385-40ae-4087-9952-6e90dd2abf46 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:10.115939 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 544/1073] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 2 15:17:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:17:10.121632 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36a385-40ae-4087-9952-6e90dd2abf46 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:10.150596 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565a552d-2ee6-48ad-b540-78c119774881 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:10.170128 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:10.178826 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:10.199701 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef82c79c-e6ec-44fa-ac01-247c1866f074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:10.200346 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82c79c-e6ec-44fa-ac01-247c1866f074 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:10.200618 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82c79c-e6ec-44fa-ac01-247c1866f074 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:10.200902 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82c79c-e6ec-44fa-ac01-247c1866f074 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:10.208435 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef82c79c-e6ec-44fa-ac01-247c1866f074 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:10.209715 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef82c79c-e6ec-44fa-ac01-247c1866f074 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:10.224955 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-ef82c79c-e6ec-44fa-ac01-247c1866f074 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:17:10.224955 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:17:10.224955 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:17:10.224955 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:17:10.224955 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:17:10.224955 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:17:10.224955 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:17:10.224955 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:17:10.224955 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:17:10.224955 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:17:10.224955 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:17:10.224955 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:17:10.224955 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 15:17:10.224955 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 15:17:10.224955 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 15:17:10.225947 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 15:17:10.225947 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:17:10.225947 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:17:10.225947 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:17:10.225947 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:17:10.225947 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:17:10.225947 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:17:10.225947 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:17:10.225947 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:17:10.225947 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:17:10.225947 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:17:10.225947 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:17:10.225947 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:17:10.225947 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:17:10.225947 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:17:10.225947 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:17:10.225947 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:17:10.226924 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 15:17:10.226924 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 15:17:10.226924 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 15:17:10.226924 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 15:17:10.226924 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 15:17:10.226924 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 15:17:10.226924 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:17:10.226924 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:17:10.226924 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 530/1074] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 2 15:17:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 15:17:10.232036 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef82c79c-e6ec-44fa-ac01-247c1866f074 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:10.252893 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36a385-40ae-4087-9952-6e90dd2abf46 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:10.289856 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab36c33f-31c0-4779-953f-cc45902ea575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:10.290488 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36c33f-31c0-4779-953f-cc45902ea575 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:10.290766 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36c33f-31c0-4779-953f-cc45902ea575 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:10.291037 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36c33f-31c0-4779-953f-cc45902ea575 None admin] PATH_INFO: `/v3/users/5bce7b11f8314be7ae635e1218cf345e` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:10.292238 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab36c33f-31c0-4779-953f-cc45902ea575 None admin] RBAC: Authorizing `identity:get_user(user_id=5bce7b11f8314be7ae635e1218cf345e)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:10.293680 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab36c33f-31c0-4779-953f-cc45902ea575 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:10.295297 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 545/1075] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 2 15:17:10 2022] GET /identity/v3/users/5bce7b11f8314be7ae635e1218cf345e => generated 285 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:17:10.296415 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36439f0-ac66-466b-b2cb-e8586d82775f None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:10.296695 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36439f0-ac66-466b-b2cb-e8586d82775f None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:10.296968 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36439f0-ac66-466b-b2cb-e8586d82775f None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:10.298155 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 546/1076] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:17:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:17:10.301546 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36439f0-ac66-466b-b2cb-e8586d82775f None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:10.349278 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef82c79c-e6ec-44fa-ac01-247c1866f074 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:10.382409 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80190037-1b2a-4bb4-a12e-21ebe271a331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:10.382927 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80190037-1b2a-4bb4-a12e-21ebe271a331 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:10.383231 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80190037-1b2a-4bb4-a12e-21ebe271a331 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:10.383517 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80190037-1b2a-4bb4-a12e-21ebe271a331 None admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:10.384266 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80190037-1b2a-4bb4-a12e-21ebe271a331 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:17:10.384577 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80190037-1b2a-4bb4-a12e-21ebe271a331 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:10.386012 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80190037-1b2a-4bb4-a12e-21ebe271a331 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:10.398831 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 531/1077] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 2 15:17:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:17:10.400198 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eeaead-2266-48fc-95a7-1bef23c1a86f None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:10.400490 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eeaead-2266-48fc-95a7-1bef23c1a86f None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:10.400764 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eeaead-2266-48fc-95a7-1bef23c1a86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:10.404825 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36439f0-ac66-466b-b2cb-e8586d82775f None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:10.416795 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:10.418137 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-29eeaead-2266-48fc-95a7-1bef23c1a86f None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:17:10.419390 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-29eeaead-2266-48fc-95a7-1bef23c1a86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:17:10.442328 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f1bd08-687d-483b-8043-b6d7ee7c1fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:10.442968 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1bd08-687d-483b-8043-b6d7ee7c1fec None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:10.443278 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1bd08-687d-483b-8043-b6d7ee7c1fec None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:10.443559 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1bd08-687d-483b-8043-b6d7ee7c1fec None admin] PATH_INFO: `/v3/projects/88589b88dded4dd187aaa069c3f09997` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:10.444696 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f1bd08-687d-483b-8043-b6d7ee7c1fec None admin] RBAC: Authorizing `identity:get_project(project_id=88589b88dded4dd187aaa069c3f09997)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:10.446131 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f1bd08-687d-483b-8043-b6d7ee7c1fec None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:10.447898 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 547/1078] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 2 15:17:10 2022] GET /identity/v3/projects/88589b88dded4dd187aaa069c3f09997 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:17:10.448640 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f1bd08-687d-483b-8043-b6d7ee7c1fec None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:10.454682 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:10.488342 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 532/1079] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:17:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 15:17:10.489236 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eeaead-2266-48fc-95a7-1bef23c1a86f None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:10.553497 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f1bd08-687d-483b-8043-b6d7ee7c1fec None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:10.587117 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d47e97-e26f-46c6-8cbf-02e2ad20a9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:10.587813 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d47e97-e26f-46c6-8cbf-02e2ad20a9df None admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:10.588094 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d47e97-e26f-46c6-8cbf-02e2ad20a9df None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:10.588369 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d47e97-e26f-46c6-8cbf-02e2ad20a9df None admin] PATH_INFO: `/v3/projects/cc19d22b4cd64dd1bc89ed78155d2732/users/4c0865af59bf43dfa4c84213d7db53c5/roles/1df4511e5e2b47278b0bf4cd5acbeb38` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:10.589054 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eeaead-2266-48fc-95a7-1bef23c1a86f None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:10.590557 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d47e97-e26f-46c6-8cbf-02e2ad20a9df None admin] RBAC: Authorizing `identity:create_grant(project_id=cc19d22b4cd64dd1bc89ed78155d2732, user_id=4c0865af59bf43dfa4c84213d7db53c5, role_id=1df4511e5e2b47278b0bf4cd5acbeb38)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:10.592030 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d47e97-e26f-46c6-8cbf-02e2ad20a9df None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:10.606728 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 548/1080] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 2 15:17:10 2022] PUT /identity/v3/projects/cc19d22b4cd64dd1bc89ed78155d2732/users/4c0865af59bf43dfa4c84213d7db53c5/roles/1df4511e5e2b47278b0bf4cd5acbeb38 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:17:10.607567 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d47e97-e26f-46c6-8cbf-02e2ad20a9df None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:10.631476 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f2a77-9a7a-478d-9f81-322d19014c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:10.632281 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f2a77-9a7a-478d-9f81-322d19014c85 None admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:10.632620 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f2a77-9a7a-478d-9f81-322d19014c85 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:10.632980 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f2a77-9a7a-478d-9f81-322d19014c85 None admin] PATH_INFO: `/v3/projects/88589b88dded4dd187aaa069c3f09997/users/5bce7b11f8314be7ae635e1218cf345e/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:10.635024 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95f2a77-9a7a-478d-9f81-322d19014c85 None admin] RBAC: Authorizing `identity:create_grant(project_id=88589b88dded4dd187aaa069c3f09997, user_id=5bce7b11f8314be7ae635e1218cf345e, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:10.636536 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95f2a77-9a7a-478d-9f81-322d19014c85 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:10.651492 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 533/1081] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 2 15:17:10 2022] PUT /identity/v3/projects/88589b88dded4dd187aaa069c3f09997/users/5bce7b11f8314be7ae635e1218cf345e/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:17:10.664261 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:10.736910 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d47e97-e26f-46c6-8cbf-02e2ad20a9df None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:10.777040 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49e1599-1232-45a3-b531-363a2eb30c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:10.777695 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e1599-1232-45a3-b531-363a2eb30c86 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:10.777977 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e1599-1232-45a3-b531-363a2eb30c86 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:10.778255 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e1599-1232-45a3-b531-363a2eb30c86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:10.859994 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49e1599-1232-45a3-b531-363a2eb30c86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:10.861830 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49e1599-1232-45a3-b531-363a2eb30c86 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:10.901932 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:10.966157 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 549/1082] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 2 15:17:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 15:17:10.972059 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f2a77-9a7a-478d-9f81-322d19014c85 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:11.004466 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:11.078732 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f2a77-9a7a-478d-9f81-322d19014c85 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:11.117300 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19963a2-3d34-4aa3-be05-8fa0b7a507e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:11.117982 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19963a2-3d34-4aa3-be05-8fa0b7a507e8 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:11.118289 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19963a2-3d34-4aa3-be05-8fa0b7a507e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:11.118569 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19963a2-3d34-4aa3-be05-8fa0b7a507e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:11.128996 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19963a2-3d34-4aa3-be05-8fa0b7a507e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:11.130456 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19963a2-3d34-4aa3-be05-8fa0b7a507e8 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:11.146266 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-a19963a2-3d34-4aa3-be05-8fa0b7a507e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:17:11.146266 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:17:11.146266 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:17:11.146266 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:17:11.146266 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:17:11.146266 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:17:11.146266 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:17:11.146266 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:17:11.146266 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:17:11.146266 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:17:11.146266 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:17:11.146266 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:17:11.146266 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:17:11.146266 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:17:11.146266 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:17:11.147201 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:17:11.147201 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:17:11.147201 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:17:11.147201 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:17:11.147201 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:17:11.147201 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:17:11.147201 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:17:11.147201 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:17:11.147201 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:17:11.147201 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:17:11.147201 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:17:11.147201 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:17:11.147201 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:17:11.147201 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:17:11.147201 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:17:11.147201 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:17:11.147201 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:17:11.148399 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:17:11.148399 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:17:11.148399 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:17:11.148399 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:17:11.151588 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 534/1083] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:17:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:17:11.153431 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49e1599-1232-45a3-b531-363a2eb30c86 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:11.258614 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49e1599-1232-45a3-b531-363a2eb30c86 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:11.297980 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce84f91c-b151-4125-967b-18c277ce1575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:11.298599 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce84f91c-b151-4125-967b-18c277ce1575 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:11.298881 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce84f91c-b151-4125-967b-18c277ce1575 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:11.299158 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce84f91c-b151-4125-967b-18c277ce1575 None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:11.299930 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce84f91c-b151-4125-967b-18c277ce1575 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:17:11.300240 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce84f91c-b151-4125-967b-18c277ce1575 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:11.301616 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce84f91c-b151-4125-967b-18c277ce1575 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:11.308545 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:11.315900 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 550/1084] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:17:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:17:12.714476 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b461a8-5b99-4087-8ab1-5f033aee1430 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:12.715055 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b461a8-5b99-4087-8ab1-5f033aee1430 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:12.715055 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b461a8-5b99-4087-8ab1-5f033aee1430 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:12.716525 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 535/1085] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:17:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:17:12.723170 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd510fb-b324-47fa-8fd6-f4dcb4248569 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:12.723697 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd510fb-b324-47fa-8fd6-f4dcb4248569 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:12.723808 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd510fb-b324-47fa-8fd6-f4dcb4248569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:12.741749 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ceaba-6a07-4727-9dc5-9061d34630a4 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:12.742036 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ceaba-6a07-4727-9dc5-9061d34630a4 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:12.742322 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ceaba-6a07-4727-9dc5-9061d34630a4 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:12.742513 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-9cd510fb-b324-47fa-8fd6-f4dcb4248569 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:17:12.743763 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-9cd510fb-b324-47fa-8fd6-f4dcb4248569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:17:12.744028 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 536/1086] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:17:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:17:12.749183 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322e76e-dcfc-4233-9326-28b9aa7baa87 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:12.749465 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322e76e-dcfc-4233-9326-28b9aa7baa87 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:12.749739 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322e76e-dcfc-4233-9326-28b9aa7baa87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:12.767369 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-a322e76e-dcfc-4233-9326-28b9aa7baa87 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:17:12.768576 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-a322e76e-dcfc-4233-9326-28b9aa7baa87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:17:12.812658 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 551/1087] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:17:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 15:17:12.836251 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd510fb-b324-47fa-8fd6-f4dcb4248569 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:12.837752 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 537/1088] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:17:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 15:17:12.860881 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a322e76e-dcfc-4233-9326-28b9aa7baa87 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:12.875539 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:12.938958 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd510fb-b324-47fa-8fd6-f4dcb4248569 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:12.966646 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:12.975805 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c7f86c-669d-4860-8424-36e3bdb06014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:12.976440 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7f86c-669d-4860-8424-36e3bdb06014 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:12.976728 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7f86c-669d-4860-8424-36e3bdb06014 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:12.977024 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7f86c-669d-4860-8424-36e3bdb06014 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:12.981804 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a322e76e-dcfc-4233-9326-28b9aa7baa87 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:12.989153 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c7f86c-669d-4860-8424-36e3bdb06014 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:17:12.994055 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-23c7f86c-669d-4860-8424-36e3bdb06014 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 15:17:12.994055 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:17:12.994055 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:17:12.994055 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:17:12.994055 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:17:12.994055 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:17:12.994055 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:17:12.994055 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:17:12.994055 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:17:12.994055 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:17:12.994055 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:17:12.994055 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:17:12.994055 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:17:12.994055 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:17:12.994055 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:17:12.994055 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:17:12.995021 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:17:12.995021 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:17:12.995021 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:17:12.995021 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:17:12.995021 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:17:12.995021 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:17:12.995021 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:17:12.995021 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:17:12.995021 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:17:12.995021 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:17:12.995021 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:17:12.995021 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:17:12.995021 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:17:12.995021 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:17:12.995021 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:17:12.995021 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:17:12.996061 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:17:12.996061 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:17:12.996061 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:17:12.996061 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:17:12.996061 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:17:12.996061 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:17:12.996061 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:17:12.996061 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:17:12.996061 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:17:12.996061 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:17:12.996061 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 15:17:12.996061 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:17:12.996061 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 552/1089] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Aug 2 15:17:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 15:17:13.001577 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c7f86c-669d-4860-8424-36e3bdb06014 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:13.021316 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac58656-84c8-41b8-844e-d07ebb0dc94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:13.021974 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac58656-84c8-41b8-844e-d07ebb0dc94d None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:13.022258 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac58656-84c8-41b8-844e-d07ebb0dc94d None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:13.022541 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac58656-84c8-41b8-844e-d07ebb0dc94d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:13.035825 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac58656-84c8-41b8-844e-d07ebb0dc94d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:17:13.041752 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-3ac58656-84c8-41b8-844e-d07ebb0dc94d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 15:17:13.041752 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:17:13.041752 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:17:13.041752 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:17:13.041752 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:17:13.041752 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:17:13.041752 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:17:13.041752 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:17:13.041752 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:17:13.041752 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:17:13.041752 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:17:13.041752 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:17:13.041752 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:17:13.041752 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:17:13.041752 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:17:13.041752 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:17:13.042884 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:17:13.042884 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:17:13.042884 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:17:13.042884 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:17:13.042884 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:17:13.042884 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:17:13.042884 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:17:13.042884 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:17:13.042884 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:17:13.042884 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:17:13.042884 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:17:13.042884 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:17:13.042884 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:17:13.042884 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:17:13.042884 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:17:13.042884 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:17:13.043776 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:17:13.043776 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:17:13.043776 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:17:13.043776 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:17:13.043776 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:17:13.043776 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:17:13.043776 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:17:13.043776 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:17:13.043776 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:17:13.043776 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:17:13.043776 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 15:17:13.043776 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:17:13.043776 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 538/1090] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 2 15:17:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:17:13.050889 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac58656-84c8-41b8-844e-d07ebb0dc94d None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:13.116607 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c7f86c-669d-4860-8424-36e3bdb06014 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:13.154306 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:13.159882 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f0b0a-9636-4312-8c6b-43f7ff9e8eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:13.160574 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f0b0a-9636-4312-8c6b-43f7ff9e8eb6 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:13.160866 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f0b0a-9636-4312-8c6b-43f7ff9e8eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:13.161146 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f0b0a-9636-4312-8c6b-43f7ff9e8eb6 None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:13.162507 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f0b0a-9636-4312-8c6b-43f7ff9e8eb6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:17:13.162823 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f0b0a-9636-4312-8c6b-43f7ff9e8eb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:13.164951 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f0b0a-9636-4312-8c6b-43f7ff9e8eb6 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:13.176621 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 553/1091] 10.222.0.42 () {56 vars in 1115 bytes} [Tue Aug 2 15:17:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:17:13.181155 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f0b0a-9636-4312-8c6b-43f7ff9e8eb6 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:13.189086 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac58656-84c8-41b8-844e-d07ebb0dc94d None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:13.227590 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2884307-49b4-4ae5-bad5-e4823ac82339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:13.228130 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2884307-49b4-4ae5-bad5-e4823ac82339 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:13.228410 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2884307-49b4-4ae5-bad5-e4823ac82339 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:13.228700 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2884307-49b4-4ae5-bad5-e4823ac82339 None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:13.229411 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2884307-49b4-4ae5-bad5-e4823ac82339 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:17:13.229714 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2884307-49b4-4ae5-bad5-e4823ac82339 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:13.231101 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2884307-49b4-4ae5-bad5-e4823ac82339 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:13.241515 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:13.242789 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 539/1092] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 2 15:17:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:17:13.249694 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2884307-49b4-4ae5-bad5-e4823ac82339 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:13.304416 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f0b0a-9636-4312-8c6b-43f7ff9e8eb6 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:13.347141 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea726e58-821f-46c2-9dcf-1b7dcb8776af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:13.348051 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea726e58-821f-46c2-9dcf-1b7dcb8776af None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:13.348337 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea726e58-821f-46c2-9dcf-1b7dcb8776af None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:13.348675 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea726e58-821f-46c2-9dcf-1b7dcb8776af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:13.365560 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea726e58-821f-46c2-9dcf-1b7dcb8776af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:13.367694 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea726e58-821f-46c2-9dcf-1b7dcb8776af None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:13.369926 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2884307-49b4-4ae5-bad5-e4823ac82339 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:13.383163 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-ea726e58-821f-46c2-9dcf-1b7dcb8776af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:17:13.383163 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:17:13.383163 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:17:13.383163 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:17:13.383163 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:17:13.383163 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:17:13.383163 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:17:13.383163 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:17:13.383163 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:17:13.383163 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:17:13.383163 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:17:13.383163 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:17:13.383163 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:17:13.383163 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:17:13.383163 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:17:13.384267 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:17:13.384267 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:17:13.384267 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:17:13.384267 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:17:13.384267 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:17:13.384267 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:17:13.384267 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:17:13.384267 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:17:13.384267 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:17:13.384267 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:17:13.384267 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:17:13.384267 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:17:13.384267 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:17:13.384267 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:17:13.384267 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:17:13.384267 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:17:13.384267 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:17:13.385850 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:17:13.385850 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:17:13.385850 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:17:13.385850 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:17:13.385850 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 554/1093] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:17:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 15:17:13.390036 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea726e58-821f-46c2-9dcf-1b7dcb8776af None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:13.419409 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b14ec35-cd6f-4221-a0ad-28da0b4cc489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:13.420093 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14ec35-cd6f-4221-a0ad-28da0b4cc489 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:13.420373 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14ec35-cd6f-4221-a0ad-28da0b4cc489 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:13.420704 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14ec35-cd6f-4221-a0ad-28da0b4cc489 None admin] PATH_INFO: `/v3/users/5bce7b11f8314be7ae635e1218cf345e` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:13.421919 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b14ec35-cd6f-4221-a0ad-28da0b4cc489 None admin] RBAC: Authorizing `identity:get_user(user_id=5bce7b11f8314be7ae635e1218cf345e)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:13.423441 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b14ec35-cd6f-4221-a0ad-28da0b4cc489 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:13.425192 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 540/1094] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 2 15:17:13 2022] GET /identity/v3/users/5bce7b11f8314be7ae635e1218cf345e => generated 285 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:17:13.433409 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b14ec35-cd6f-4221-a0ad-28da0b4cc489 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:13.436255 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:13.506529 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea726e58-821f-46c2-9dcf-1b7dcb8776af None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:13.508125 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:13.546687 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b14ec35-cd6f-4221-a0ad-28da0b4cc489 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:13.552130 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82fe390-566d-472f-90da-a4db1a30fa02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:13.552761 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82fe390-566d-472f-90da-a4db1a30fa02 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:13.553046 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82fe390-566d-472f-90da-a4db1a30fa02 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:13.553483 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82fe390-566d-472f-90da-a4db1a30fa02 None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:13.556007 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82fe390-566d-472f-90da-a4db1a30fa02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:17:13.556007 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82fe390-566d-472f-90da-a4db1a30fa02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:13.556521 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82fe390-566d-472f-90da-a4db1a30fa02 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:13.568642 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 555/1095] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:17:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:17:13.576322 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82fe390-566d-472f-90da-a4db1a30fa02 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:13.581884 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93d667-c453-4b75-acfa-a0aab4677086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:13.582498 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93d667-c453-4b75-acfa-a0aab4677086 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:13.582775 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93d667-c453-4b75-acfa-a0aab4677086 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:13.583047 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93d667-c453-4b75-acfa-a0aab4677086 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:13.657114 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea93d667-c453-4b75-acfa-a0aab4677086 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:13.658562 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea93d667-c453-4b75-acfa-a0aab4677086 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:13.660998 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:13.702050 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82fe390-566d-472f-90da-a4db1a30fa02 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:13.745287 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c530d6cd-6332-4048-8518-4fbaceb866af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:13.745984 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c530d6cd-6332-4048-8518-4fbaceb866af None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:13.746187 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c530d6cd-6332-4048-8518-4fbaceb866af None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:13.746459 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c530d6cd-6332-4048-8518-4fbaceb866af None admin] PATH_INFO: `/v3/users/nova` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:13.754877 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c530d6cd-6332-4048-8518-4fbaceb866af None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:13.756370 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c530d6cd-6332-4048-8518-4fbaceb866af None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:13.769055 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-c530d6cd-6332-4048-8518-4fbaceb866af None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 15:17:13.769055 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:17:13.769055 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:17:13.769055 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:17:13.769055 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:17:13.769055 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:17:13.769055 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:17:13.769055 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:17:13.769055 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:17:13.769055 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:17:13.769055 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:17:13.769055 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:17:13.769055 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 15:17:13.769055 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 15:17:13.769055 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 15:17:13.769055 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 15:17:13.770184 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:17:13.770184 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:17:13.770184 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 15:17:13.770184 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:17:13.770184 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 15:17:13.770184 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:17:13.770184 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:17:13.770184 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:17:13.770184 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:17:13.770184 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:17:13.770184 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:17:13.770184 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:17:13.770184 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:17:13.770184 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:17:13.770184 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:17:13.770184 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:17:13.770184 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:17:13.770184 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:17:13.771148 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:17:13.771148 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:17:13.771148 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 15:17:13.771148 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 15:17:13.771148 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 15:17:13.771148 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 15:17:13.771148 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 15:17:13.771148 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 15:17:13.771148 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 15:17:13.771148 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:17:13.771148 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 556/1096] 10.222.0.42 () {56 vars in 1093 bytes} [Tue Aug 2 15:17:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 15:17:13.773008 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 541/1097] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 2 15:17:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 02 15:17:13.776226 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c530d6cd-6332-4048-8518-4fbaceb866af None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:13.778423 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93d667-c453-4b75-acfa-a0aab4677086 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:13.802446 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:13.877704 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c530d6cd-6332-4048-8518-4fbaceb866af None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:13.879137 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93d667-c453-4b75-acfa-a0aab4677086 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:13.880710 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:13.911877 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37963d1-3bd5-411b-aff1-d1035418e7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:13.912493 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37963d1-3bd5-411b-aff1-d1035418e7ca None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:13.912779 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37963d1-3bd5-411b-aff1-d1035418e7ca None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:13.912984 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63d22d4-d302-4b3e-9a4d-36b6ad914b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:13.913109 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37963d1-3bd5-411b-aff1-d1035418e7ca None admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:13.913629 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d22d4-d302-4b3e-9a4d-36b6ad914b28 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:13.913819 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37963d1-3bd5-411b-aff1-d1035418e7ca None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:17:13.913898 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d22d4-d302-4b3e-9a4d-36b6ad914b28 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:13.914396 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37963d1-3bd5-411b-aff1-d1035418e7ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:13.914494 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d22d4-d302-4b3e-9a4d-36b6ad914b28 None admin] PATH_INFO: `/v3/projects/88589b88dded4dd187aaa069c3f09997` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:13.915603 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63d22d4-d302-4b3e-9a4d-36b6ad914b28 None admin] RBAC: Authorizing `identity:get_project(project_id=88589b88dded4dd187aaa069c3f09997)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:13.915877 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37963d1-3bd5-411b-aff1-d1035418e7ca None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:13.917002 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63d22d4-d302-4b3e-9a4d-36b6ad914b28 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:13.918993 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 542/1098] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 2 15:17:13 2022] GET /identity/v3/projects/88589b88dded4dd187aaa069c3f09997 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:17:13.925211 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63d22d4-d302-4b3e-9a4d-36b6ad914b28 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:13.933854 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 557/1099] 10.222.0.42 () {56 vars in 1133 bytes} [Tue Aug 2 15:17:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:17:13.939484 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37963d1-3bd5-411b-aff1-d1035418e7ca None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:14.025879 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:14.048443 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37963d1-3bd5-411b-aff1-d1035418e7ca None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:14.048971 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63d22d4-d302-4b3e-9a4d-36b6ad914b28 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:14.085065 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb42ff14-6690-41a4-a86f-38170b5ba271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:14.085692 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb42ff14-6690-41a4-a86f-38170b5ba271 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:14.085968 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb42ff14-6690-41a4-a86f-38170b5ba271 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:14.086244 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb42ff14-6690-41a4-a86f-38170b5ba271 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:14.087034 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb42ff14-6690-41a4-a86f-38170b5ba271 None admin] RBAC: Adding query filter params (role.id=d75c9572cb294caeb8eb456521ff6f57, scope.project.id=88589b88dded4dd187aaa069c3f09997, user.id=5bce7b11f8314be7ae635e1218cf345e) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:17:14.087373 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb42ff14-6690-41a4-a86f-38170b5ba271 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:14.088796 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef6152-85bb-42cd-a24e-056cd0a46a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:14.088927 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb42ff14-6690-41a4-a86f-38170b5ba271 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:14.089415 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef6152-85bb-42cd-a24e-056cd0a46a9d None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:14.089693 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef6152-85bb-42cd-a24e-056cd0a46a9d None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:14.089967 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef6152-85bb-42cd-a24e-056cd0a46a9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:14.094721 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 543/1100] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 2 15:17:13 2022] GET /identity/v3/role_assignments?user.id=5bce7b11f8314be7ae635e1218cf345e&scope.project.id=88589b88dded4dd187aaa069c3f09997&role.id=d75c9572cb294caeb8eb456521ff6f57 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:17:14.167102 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ef6152-85bb-42cd-a24e-056cd0a46a9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:14.167934 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ef6152-85bb-42cd-a24e-056cd0a46a9d None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:14.258625 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:14.286426 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 558/1101] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 2 15:17:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 15:17:14.292378 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb42ff14-6690-41a4-a86f-38170b5ba271 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:14.332908 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:14.403034 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb42ff14-6690-41a4-a86f-38170b5ba271 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:14.435795 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c06ee94-b97b-4799-9139-8f272f68ba64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:14.436429 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06ee94-b97b-4799-9139-8f272f68ba64 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:14.436711 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06ee94-b97b-4799-9139-8f272f68ba64 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:14.436986 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06ee94-b97b-4799-9139-8f272f68ba64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:14.449008 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c06ee94-b97b-4799-9139-8f272f68ba64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:14.450452 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c06ee94-b97b-4799-9139-8f272f68ba64 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:14.464437 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-5c06ee94-b97b-4799-9139-8f272f68ba64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:17:14.464437 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:17:14.464437 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:17:14.464437 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:17:14.464437 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:17:14.464437 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:17:14.464437 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:17:14.464437 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:17:14.464437 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:17:14.464437 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:17:14.464437 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:17:14.464437 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:17:14.464437 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:17:14.464437 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:17:14.464437 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:17:14.465511 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:17:14.465511 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:17:14.465511 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:17:14.465511 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:17:14.465511 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:17:14.465511 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:17:14.465511 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:17:14.465511 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:17:14.465511 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:17:14.465511 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:17:14.465511 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:17:14.465511 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:17:14.465511 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:17:14.465511 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:17:14.465511 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:17:14.465511 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:17:14.465511 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:17:14.470942 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:17:14.470942 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:17:14.470942 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:17:14.470942 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:17:14.470942 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 544/1102] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:17:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:17:14.471246 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef6152-85bb-42cd-a24e-056cd0a46a9d None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:14.569521 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef6152-85bb-42cd-a24e-056cd0a46a9d None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:14.604454 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4ca935-a37e-425a-828c-fd89f09500f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:14.605074 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ca935-a37e-425a-828c-fd89f09500f1 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:14.605356 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ca935-a37e-425a-828c-fd89f09500f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:14.605632 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ca935-a37e-425a-828c-fd89f09500f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:14.606318 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4ca935-a37e-425a-828c-fd89f09500f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:17:14.606620 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4ca935-a37e-425a-828c-fd89f09500f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:14.608015 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4ca935-a37e-425a-828c-fd89f09500f1 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:14.626515 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 559/1103] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:17:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:17:14.628531 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c06ee94-b97b-4799-9139-8f272f68ba64 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:14.733347 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:14.748977 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c06ee94-b97b-4799-9139-8f272f68ba64 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:14.782412 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0168e9f6-4a61-4536-b471-d2f4bc3ad1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:14.783060 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168e9f6-4a61-4536-b471-d2f4bc3ad1f6 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:14.783384 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168e9f6-4a61-4536-b471-d2f4bc3ad1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:14.783665 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168e9f6-4a61-4536-b471-d2f4bc3ad1f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:14.791525 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0168e9f6-4a61-4536-b471-d2f4bc3ad1f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:14.792974 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0168e9f6-4a61-4536-b471-d2f4bc3ad1f6 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:14.804901 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-0168e9f6-4a61-4536-b471-d2f4bc3ad1f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:17:14.804901 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:17:14.804901 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:17:14.804901 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:17:14.804901 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:17:14.804901 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:17:14.804901 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:17:14.804901 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:17:14.804901 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:17:14.804901 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:17:14.804901 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:17:14.804901 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:17:14.804901 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 15:17:14.804901 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 15:17:14.804901 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 15:17:14.805987 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 15:17:14.805987 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:17:14.805987 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:17:14.805987 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:17:14.805987 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:17:14.805987 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:17:14.805987 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:17:14.805987 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:17:14.805987 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:17:14.805987 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:17:14.805987 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:17:14.805987 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:17:14.805987 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:17:14.805987 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:17:14.805987 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:17:14.805987 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:17:14.805987 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:17:14.806927 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 15:17:14.806927 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 15:17:14.806927 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 15:17:14.806927 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 15:17:14.806927 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 15:17:14.806927 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 15:17:14.806927 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:17:14.806927 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:17:14.806927 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 545/1104] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 2 15:17:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 15:17:14.811900 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4ca935-a37e-425a-828c-fd89f09500f1 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:14.854384 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:14.912754 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4ca935-a37e-425a-828c-fd89f09500f1 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:14.955261 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87197bf5-309a-4d07-8814-555a6ce29afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:14.955899 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87197bf5-309a-4d07-8814-555a6ce29afa None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:14.956235 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87197bf5-309a-4d07-8814-555a6ce29afa None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:14.956516 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87197bf5-309a-4d07-8814-555a6ce29afa None admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:14.957269 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87197bf5-309a-4d07-8814-555a6ce29afa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:17:14.957574 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87197bf5-309a-4d07-8814-555a6ce29afa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:14.959025 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87197bf5-309a-4d07-8814-555a6ce29afa None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:14.971123 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 560/1105] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 2 15:17:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:17:14.978173 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0168e9f6-4a61-4536-b471-d2f4bc3ad1f6 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:15.076897 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0168e9f6-4a61-4536-b471-d2f4bc3ad1f6 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:15.110341 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575525fc-fe8e-4002-b013-2e04a8b56a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:15.110890 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575525fc-fe8e-4002-b013-2e04a8b56a72 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:15.111174 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575525fc-fe8e-4002-b013-2e04a8b56a72 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:15.111480 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575525fc-fe8e-4002-b013-2e04a8b56a72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:15.112295 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575525fc-fe8e-4002-b013-2e04a8b56a72 None admin] RBAC: Adding query filter params (role.id=1df4511e5e2b47278b0bf4cd5acbeb38, scope.project.id=cc19d22b4cd64dd1bc89ed78155d2732, user.id=4c0865af59bf43dfa4c84213d7db53c5) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:17:15.113148 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575525fc-fe8e-4002-b013-2e04a8b56a72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:15.114577 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575525fc-fe8e-4002-b013-2e04a8b56a72 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:15.120452 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 546/1106] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 2 15:17:14 2022] GET /identity/v3/role_assignments?user.id=4c0865af59bf43dfa4c84213d7db53c5&scope.project.id=cc19d22b4cd64dd1bc89ed78155d2732&role.id=1df4511e5e2b47278b0bf4cd5acbeb38 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:17:16.234424 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e86170-6a0a-4414-a8c6-443d309691a8 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:16.235024 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e86170-6a0a-4414-a8c6-443d309691a8 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:16.235024 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e86170-6a0a-4414-a8c6-443d309691a8 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:16.236513 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 561/1107] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:17:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:17:16.241943 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922e2e2-0b60-45d4-bf2d-5f4bf2e47679 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:16.242432 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922e2e2-0b60-45d4-bf2d-5f4bf2e47679 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:16.242545 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922e2e2-0b60-45d4-bf2d-5f4bf2e47679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:16.263489 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-1922e2e2-0b60-45d4-bf2d-5f4bf2e47679 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:17:16.264691 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-1922e2e2-0b60-45d4-bf2d-5f4bf2e47679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:17:16.267661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:16.340117 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 547/1108] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:17:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 15:17:16.370380 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e86170-6a0a-4414-a8c6-443d309691a8 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:16.489880 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:16.494190 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e86170-6a0a-4414-a8c6-443d309691a8 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:16.538232 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da310ad4-eff3-42e0-9659-85dd3d80f1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:16.539288 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da310ad4-eff3-42e0-9659-85dd3d80f1cd None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:16.539705 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da310ad4-eff3-42e0-9659-85dd3d80f1cd None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:16.539985 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da310ad4-eff3-42e0-9659-85dd3d80f1cd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:16.541770 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da310ad4-eff3-42e0-9659-85dd3d80f1cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:16.543905 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da310ad4-eff3-42e0-9659-85dd3d80f1cd None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:16.546147 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 562/1109] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:17:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:17:16.552670 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1922e2e2-0b60-45d4-bf2d-5f4bf2e47679 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:16.654583 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1922e2e2-0b60-45d4-bf2d-5f4bf2e47679 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:16.691385 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f84016-b593-4ef0-b430-f61f22a6e46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:16.692002 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f84016-b593-4ef0-b430-f61f22a6e46c None admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:16.692283 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f84016-b593-4ef0-b430-f61f22a6e46c None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:16.692559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f84016-b593-4ef0-b430-f61f22a6e46c None admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:16.693246 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f84016-b593-4ef0-b430-f61f22a6e46c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:16.694669 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f84016-b593-4ef0-b430-f61f22a6e46c None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:16.705674 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:16.718216 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 548/1110] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Aug 2 15:17:16 2022] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 15:17:18.904061 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c1281-e646-4c7f-8b79-9e5a57a82d48 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:18.904634 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c1281-e646-4c7f-8b79-9e5a57a82d48 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:18.904634 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c1281-e646-4c7f-8b79-9e5a57a82d48 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:18.905968 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 563/1111] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:17:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:17:18.912652 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ed521-166f-4710-b8a1-79cc9b640f30 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:18.913155 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ed521-166f-4710-b8a1-79cc9b640f30 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:18.913655 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ed521-166f-4710-b8a1-79cc9b640f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:18.934076 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-095ed521-166f-4710-b8a1-79cc9b640f30 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:17:18.935340 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-095ed521-166f-4710-b8a1-79cc9b640f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:17:19.013085 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 549/1112] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:17:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 15:17:19.037575 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c1281-e646-4c7f-8b79-9e5a57a82d48 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:19.135733 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c1281-e646-4c7f-8b79-9e5a57a82d48 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:19.177302 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa515b1-922f-4c2b-b98c-19b81d715506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:19.178728 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa515b1-922f-4c2b-b98c-19b81d715506 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:19.179008 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa515b1-922f-4c2b-b98c-19b81d715506 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:19.179325 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa515b1-922f-4c2b-b98c-19b81d715506 None admin] PATH_INFO: `/v3/roles/3e1c8e0567ff4244aef0d6a62fc8b18d` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:19.180798 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa515b1-922f-4c2b-b98c-19b81d715506 None admin] RBAC: Authorizing `identity:get_role(role_id=3e1c8e0567ff4244aef0d6a62fc8b18d)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:19.182178 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa515b1-922f-4c2b-b98c-19b81d715506 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:19.183587 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 564/1113] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 2 15:17:19 2022] GET /identity/v3/roles/3e1c8e0567ff4244aef0d6a62fc8b18d => generated 223 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:17:19.189592 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095ed521-166f-4710-b8a1-79cc9b640f30 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:19.301599 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095ed521-166f-4710-b8a1-79cc9b640f30 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:19.326365 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:19.337097 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a7109-4b9e-4822-875a-29c2060a3c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:19.337744 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a7109-4b9e-4822-875a-29c2060a3c6e None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:19.338030 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a7109-4b9e-4822-875a-29c2060a3c6e None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:19.338304 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a7109-4b9e-4822-875a-29c2060a3c6e None admin] PATH_INFO: `/v3/users/7c40d1b59a07478db9e84b30550e12f7` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:19.352413 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825a7109-4b9e-4822-875a-29c2060a3c6e None admin] RBAC: Authorizing `identity:get_user(user_id=7c40d1b59a07478db9e84b30550e12f7)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:19.353857 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825a7109-4b9e-4822-875a-29c2060a3c6e None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:19.355559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 550/1114] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 2 15:17:19 2022] GET /identity/v3/users/7c40d1b59a07478db9e84b30550e12f7 => generated 286 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:17:19.361438 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa515b1-922f-4c2b-b98c-19b81d715506 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:19.397164 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:19.483371 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa515b1-922f-4c2b-b98c-19b81d715506 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:19.527395 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c57e3cf-affa-4f4f-b9d4-04a6efa28229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:19.528244 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c57e3cf-affa-4f4f-b9d4-04a6efa28229 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:19.528642 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c57e3cf-affa-4f4f-b9d4-04a6efa28229 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:19.528981 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c57e3cf-affa-4f4f-b9d4-04a6efa28229 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:19.601210 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c57e3cf-affa-4f4f-b9d4-04a6efa28229 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:19.602676 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c57e3cf-affa-4f4f-b9d4-04a6efa28229 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:19.638920 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:19.714994 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 565/1115] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 2 15:17:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 15:17:19.721548 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a7109-4b9e-4822-875a-29c2060a3c6e None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:19.840176 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a7109-4b9e-4822-875a-29c2060a3c6e None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:19.884086 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b88189-ba43-494f-aa32-4892ef3034be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:19.884718 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b88189-ba43-494f-aa32-4892ef3034be None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:19.884999 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b88189-ba43-494f-aa32-4892ef3034be None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:19.885270 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b88189-ba43-494f-aa32-4892ef3034be None admin] PATH_INFO: `/v3/projects/88589b88dded4dd187aaa069c3f09997` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:19.886426 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b88189-ba43-494f-aa32-4892ef3034be None admin] RBAC: Authorizing `identity:get_project(project_id=88589b88dded4dd187aaa069c3f09997)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:19.887872 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b88189-ba43-494f-aa32-4892ef3034be None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:19.889523 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 551/1116] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 2 15:17:19 2022] GET /identity/v3/projects/88589b88dded4dd187aaa069c3f09997 => generated 311 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:17:19.897157 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c57e3cf-affa-4f4f-b9d4-04a6efa28229 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:19.998290 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c57e3cf-affa-4f4f-b9d4-04a6efa28229 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:20.037370 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa504103-bd1d-4063-b3b1-088bfe741328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:20.037982 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa504103-bd1d-4063-b3b1-088bfe741328 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:20.038261 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa504103-bd1d-4063-b3b1-088bfe741328 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:20.038532 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa504103-bd1d-4063-b3b1-088bfe741328 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:20.039605 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa504103-bd1d-4063-b3b1-088bfe741328 None admin] RBAC: Adding query filter params (role.id=3e1c8e0567ff4244aef0d6a62fc8b18d, scope.project.id=88589b88dded4dd187aaa069c3f09997, user.id=7c40d1b59a07478db9e84b30550e12f7) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:17:20.039914 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa504103-bd1d-4063-b3b1-088bfe741328 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:20.041447 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa504103-bd1d-4063-b3b1-088bfe741328 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:20.044325 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:20.052846 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 566/1117] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 2 15:17:19 2022] GET /identity/v3/role_assignments?user.id=7c40d1b59a07478db9e84b30550e12f7&scope.project.id=88589b88dded4dd187aaa069c3f09997&role.id=3e1c8e0567ff4244aef0d6a62fc8b18d => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:17:22.114132 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420530a2-d9a4-4873-8ab9-34a19a23fdbb None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:22.114695 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420530a2-d9a4-4873-8ab9-34a19a23fdbb None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:22.114695 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420530a2-d9a4-4873-8ab9-34a19a23fdbb None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:22.116052 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 552/1118] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:17:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:17:22.121264 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae3b1d-7c05-47f9-b255-5117576c91d1 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:22.121661 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae3b1d-7c05-47f9-b255-5117576c91d1 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:22.121827 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae3b1d-7c05-47f9-b255-5117576c91d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:22.139925 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-bdae3b1d-7c05-47f9-b255-5117576c91d1 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:17:22.141224 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-bdae3b1d-7c05-47f9-b255-5117576c91d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:17:22.208352 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 567/1119] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:17:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 15:17:22.230864 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420530a2-d9a4-4873-8ab9-34a19a23fdbb None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:22.289245 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:22.342286 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420530a2-d9a4-4873-8ab9-34a19a23fdbb None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:22.377392 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb5414-d639-4532-89b6-ca51147fcfc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:22.377959 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb5414-d639-4532-89b6-ca51147fcfc9 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:22.378240 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb5414-d639-4532-89b6-ca51147fcfc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:22.378514 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb5414-d639-4532-89b6-ca51147fcfc9 None admin] PATH_INFO: `/v3/roles/3e1c8e0567ff4244aef0d6a62fc8b18d` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:22.379970 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecb5414-d639-4532-89b6-ca51147fcfc9 None admin] RBAC: Authorizing `identity:get_role(role_id=3e1c8e0567ff4244aef0d6a62fc8b18d)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:22.381333 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecb5414-d639-4532-89b6-ca51147fcfc9 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:22.382669 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 553/1120] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 2 15:17:22 2022] GET /identity/v3/roles/3e1c8e0567ff4244aef0d6a62fc8b18d => generated 223 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:17:22.388663 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdae3b1d-7c05-47f9-b255-5117576c91d1 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:22.492722 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdae3b1d-7c05-47f9-b255-5117576c91d1 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:22.519770 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:22.525973 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d64f80-15a0-4db1-9f7c-6af87c57ed12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:22.526609 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d64f80-15a0-4db1-9f7c-6af87c57ed12 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:22.526892 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d64f80-15a0-4db1-9f7c-6af87c57ed12 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:22.527167 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d64f80-15a0-4db1-9f7c-6af87c57ed12 None admin] PATH_INFO: `/v3/users/7c40d1b59a07478db9e84b30550e12f7` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:22.528362 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d64f80-15a0-4db1-9f7c-6af87c57ed12 None admin] RBAC: Authorizing `identity:get_user(user_id=7c40d1b59a07478db9e84b30550e12f7)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:22.529795 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d64f80-15a0-4db1-9f7c-6af87c57ed12 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:22.531433 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 568/1121] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 2 15:17:22 2022] GET /identity/v3/users/7c40d1b59a07478db9e84b30550e12f7 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:17:22.537712 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb5414-d639-4532-89b6-ca51147fcfc9 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:22.644014 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb5414-d639-4532-89b6-ca51147fcfc9 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:22.665054 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:22.679534 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e189dc6-02c1-4060-8917-b4f65fddb617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:22.680173 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e189dc6-02c1-4060-8917-b4f65fddb617 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:22.680452 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e189dc6-02c1-4060-8917-b4f65fddb617 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:22.680725 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e189dc6-02c1-4060-8917-b4f65fddb617 None admin] PATH_INFO: `/v3/projects/88589b88dded4dd187aaa069c3f09997` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:22.681866 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e189dc6-02c1-4060-8917-b4f65fddb617 None admin] RBAC: Authorizing `identity:get_project(project_id=88589b88dded4dd187aaa069c3f09997)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:22.683319 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e189dc6-02c1-4060-8917-b4f65fddb617 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:22.684966 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 554/1122] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 2 15:17:22 2022] GET /identity/v3/projects/88589b88dded4dd187aaa069c3f09997 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:17:22.691557 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d64f80-15a0-4db1-9f7c-6af87c57ed12 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:22.797672 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d64f80-15a0-4db1-9f7c-6af87c57ed12 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:22.831370 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b9bc47-757d-478d-986e-3abc00cc8623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:22.832031 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9bc47-757d-478d-986e-3abc00cc8623 None admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:22.832320 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9bc47-757d-478d-986e-3abc00cc8623 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:22.832597 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9bc47-757d-478d-986e-3abc00cc8623 None admin] PATH_INFO: `/v3/projects/88589b88dded4dd187aaa069c3f09997/users/7c40d1b59a07478db9e84b30550e12f7/roles/3e1c8e0567ff4244aef0d6a62fc8b18d` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:22.834739 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b9bc47-757d-478d-986e-3abc00cc8623 None admin] RBAC: Authorizing `identity:create_grant(project_id=88589b88dded4dd187aaa069c3f09997, user_id=7c40d1b59a07478db9e84b30550e12f7, role_id=3e1c8e0567ff4244aef0d6a62fc8b18d)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:22.836214 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b9bc47-757d-478d-986e-3abc00cc8623 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:22.849351 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 569/1123] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 2 15:17:22 2022] PUT /identity/v3/projects/88589b88dded4dd187aaa069c3f09997/users/7c40d1b59a07478db9e84b30550e12f7/roles/3e1c8e0567ff4244aef0d6a62fc8b18d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:17:24.861567 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd6434-46bd-499f-ba09-58d55959841e None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:24.862139 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd6434-46bd-499f-ba09-58d55959841e None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:24.862251 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd6434-46bd-499f-ba09-58d55959841e None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:24.864055 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 555/1124] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:17:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:17:24.869170 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ccafd-e155-4456-9235-11a31d8361e8 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:24.869549 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ccafd-e155-4456-9235-11a31d8361e8 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:24.869727 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ccafd-e155-4456-9235-11a31d8361e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:24.887238 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-828ccafd-e155-4456-9235-11a31d8361e8 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:17:24.888427 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-828ccafd-e155-4456-9235-11a31d8361e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:17:24.940680 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:24.954731 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 570/1125] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:17:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 15:17:24.978367 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd6434-46bd-499f-ba09-58d55959841e None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:25.080353 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd6434-46bd-499f-ba09-58d55959841e None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:25.113969 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6ef47c-f46c-413b-b429-09e14e6f956b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:25.114528 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ef47c-f46c-413b-b429-09e14e6f956b None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:25.114810 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ef47c-f46c-413b-b429-09e14e6f956b None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:25.115089 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ef47c-f46c-413b-b429-09e14e6f956b None admin] PATH_INFO: `/v3/roles/3e1c8e0567ff4244aef0d6a62fc8b18d` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:25.116567 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6ef47c-f46c-413b-b429-09e14e6f956b None admin] RBAC: Authorizing `identity:get_role(role_id=3e1c8e0567ff4244aef0d6a62fc8b18d)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:25.117933 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6ef47c-f46c-413b-b429-09e14e6f956b None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:25.119298 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 556/1126] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 2 15:17:24 2022] GET /identity/v3/roles/3e1c8e0567ff4244aef0d6a62fc8b18d => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:17:25.125181 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828ccafd-e155-4456-9235-11a31d8361e8 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:25.224398 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828ccafd-e155-4456-9235-11a31d8361e8 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:25.258101 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50051c63-d7e3-4864-a181-8363d6005ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:25.258741 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50051c63-d7e3-4864-a181-8363d6005ac9 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:25.259023 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50051c63-d7e3-4864-a181-8363d6005ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:25.259327 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50051c63-d7e3-4864-a181-8363d6005ac9 None admin] PATH_INFO: `/v3/users/7c40d1b59a07478db9e84b30550e12f7` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:25.260478 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50051c63-d7e3-4864-a181-8363d6005ac9 None admin] RBAC: Authorizing `identity:get_user(user_id=7c40d1b59a07478db9e84b30550e12f7)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:25.261916 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50051c63-d7e3-4864-a181-8363d6005ac9 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:25.263625 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 571/1127] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 2 15:17:25 2022] GET /identity/v3/users/7c40d1b59a07478db9e84b30550e12f7 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:17:25.270034 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6ef47c-f46c-413b-b429-09e14e6f956b None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:25.324948 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:25.367525 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6ef47c-f46c-413b-b429-09e14e6f956b None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:25.400729 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d726cb-43a8-40b5-9d44-cbf9bfe51405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:25.401337 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d726cb-43a8-40b5-9d44-cbf9bfe51405 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:25.401620 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d726cb-43a8-40b5-9d44-cbf9bfe51405 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:25.401899 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d726cb-43a8-40b5-9d44-cbf9bfe51405 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:25.476214 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d726cb-43a8-40b5-9d44-cbf9bfe51405 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:25.477665 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d726cb-43a8-40b5-9d44-cbf9bfe51405 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:25.529557 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:25.574005 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 557/1128] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 2 15:17:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 15:17:25.580037 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50051c63-d7e3-4864-a181-8363d6005ac9 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:25.635845 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:25.679346 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50051c63-d7e3-4864-a181-8363d6005ac9 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:25.713525 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0395995f-89f5-48b4-a9c6-ec127c0ae7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:25.714165 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0395995f-89f5-48b4-a9c6-ec127c0ae7f8 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:25.714448 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0395995f-89f5-48b4-a9c6-ec127c0ae7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:25.714724 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0395995f-89f5-48b4-a9c6-ec127c0ae7f8 None admin] PATH_INFO: `/v3/projects/88589b88dded4dd187aaa069c3f09997` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:25.715901 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0395995f-89f5-48b4-a9c6-ec127c0ae7f8 None admin] RBAC: Authorizing `identity:get_project(project_id=88589b88dded4dd187aaa069c3f09997)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:25.717338 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0395995f-89f5-48b4-a9c6-ec127c0ae7f8 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:25.718999 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 572/1129] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 2 15:17:25 2022] GET /identity/v3/projects/88589b88dded4dd187aaa069c3f09997 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:17:25.725369 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d726cb-43a8-40b5-9d44-cbf9bfe51405 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:25.821527 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d726cb-43a8-40b5-9d44-cbf9bfe51405 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:25.854007 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9544c5c-c8ad-46e5-b96b-68402b3fba22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:25.854610 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9544c5c-c8ad-46e5-b96b-68402b3fba22 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:25.854887 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9544c5c-c8ad-46e5-b96b-68402b3fba22 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:25.855159 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9544c5c-c8ad-46e5-b96b-68402b3fba22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:25.855951 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9544c5c-c8ad-46e5-b96b-68402b3fba22 None admin] RBAC: Adding query filter params (role.id=3e1c8e0567ff4244aef0d6a62fc8b18d, scope.project.id=88589b88dded4dd187aaa069c3f09997, user.id=7c40d1b59a07478db9e84b30550e12f7) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:17:25.856260 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9544c5c-c8ad-46e5-b96b-68402b3fba22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:25.857664 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9544c5c-c8ad-46e5-b96b-68402b3fba22 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:25.863849 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 558/1130] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 2 15:17:25 2022] GET /identity/v3/role_assignments?user.id=7c40d1b59a07478db9e84b30550e12f7&scope.project.id=88589b88dded4dd187aaa069c3f09997&role.id=3e1c8e0567ff4244aef0d6a62fc8b18d => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:17:27.866390 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905b0a9-361e-4af0-aa78-d36c636a07bc None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:27.866930 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905b0a9-361e-4af0-aa78-d36c636a07bc None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:27.866930 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905b0a9-361e-4af0-aa78-d36c636a07bc None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:27.868315 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 573/1131] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:17:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:17:27.873329 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a26d22-72a9-4161-b6f4-5fe6f751778e None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:27.873720 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a26d22-72a9-4161-b6f4-5fe6f751778e None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:27.873879 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a26d22-72a9-4161-b6f4-5fe6f751778e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:27.892306 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-f0a26d22-72a9-4161-b6f4-5fe6f751778e None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:17:27.893529 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-f0a26d22-72a9-4161-b6f4-5fe6f751778e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:17:27.907251 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:27.958651 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 559/1132] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:17:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 15:17:27.981609 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4905b0a9-361e-4af0-aa78-d36c636a07bc None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:28.086219 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4905b0a9-361e-4af0-aa78-d36c636a07bc None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:28.109562 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:28.120245 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c330237-1f2f-4b72-9c48-a4680bd7f9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:28.120811 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c330237-1f2f-4b72-9c48-a4680bd7f9f6 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:28.121092 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c330237-1f2f-4b72-9c48-a4680bd7f9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:28.121368 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c330237-1f2f-4b72-9c48-a4680bd7f9f6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:28.122897 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c330237-1f2f-4b72-9c48-a4680bd7f9f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:28.124362 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c330237-1f2f-4b72-9c48-a4680bd7f9f6 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:28.125947 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 574/1133] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:17:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:17:28.131818 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a26d22-72a9-4161-b6f4-5fe6f751778e None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:28.228789 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a26d22-72a9-4161-b6f4-5fe6f751778e None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:28.264257 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6902504-a33a-481a-afe9-5ddc7f1368ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:28.264870 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6902504-a33a-481a-afe9-5ddc7f1368ba None admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:28.265150 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6902504-a33a-481a-afe9-5ddc7f1368ba None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:28.265423 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6902504-a33a-481a-afe9-5ddc7f1368ba None admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:28.266097 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6902504-a33a-481a-afe9-5ddc7f1368ba None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:28.267554 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6902504-a33a-481a-afe9-5ddc7f1368ba None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:28.294608 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 560/1134] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Aug 2 15:17:28 2022] POST /identity/v3/projects => generated 311 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:17:30.457624 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ebe4da-8c90-45d9-b912-cf6ef5c86666 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:30.458166 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ebe4da-8c90-45d9-b912-cf6ef5c86666 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:30.458166 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ebe4da-8c90-45d9-b912-cf6ef5c86666 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:30.459608 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 575/1135] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:17:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:17:30.464774 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d01412-8f55-4487-935c-96fde6438df9 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:30.465196 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d01412-8f55-4487-935c-96fde6438df9 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:30.465332 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d01412-8f55-4487-935c-96fde6438df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:30.472178 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:30.485969 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-70d01412-8f55-4487-935c-96fde6438df9 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:17:30.487185 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-70d01412-8f55-4487-935c-96fde6438df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:17:30.552013 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 561/1136] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:17:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 15:17:30.577545 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ebe4da-8c90-45d9-b912-cf6ef5c86666 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:30.676156 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ebe4da-8c90-45d9-b912-cf6ef5c86666 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:30.709475 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2feddb-8695-4a6f-aa21-0e3e9cb1a9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:30.710036 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2feddb-8695-4a6f-aa21-0e3e9cb1a9af None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:30.710299 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2feddb-8695-4a6f-aa21-0e3e9cb1a9af None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:30.710568 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2feddb-8695-4a6f-aa21-0e3e9cb1a9af None admin] PATH_INFO: `/v3/domains/default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:30.711724 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2feddb-8695-4a6f-aa21-0e3e9cb1a9af None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:30.713205 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2feddb-8695-4a6f-aa21-0e3e9cb1a9af None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:30.714781 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 576/1137] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:17:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:17:30.720673 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d01412-8f55-4487-935c-96fde6438df9 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:30.817353 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d01412-8f55-4487-935c-96fde6438df9 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:30.845621 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:30.851366 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d75d33-b760-4bab-9057-f027e43bcb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:30.851979 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d75d33-b760-4bab-9057-f027e43bcb96 None admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:30.852258 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d75d33-b760-4bab-9057-f027e43bcb96 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:30.852529 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d75d33-b760-4bab-9057-f027e43bcb96 None admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:30.853216 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d75d33-b760-4bab-9057-f027e43bcb96 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:30.854630 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d75d33-b760-4bab-9057-f027e43bcb96 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:30.876489 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 562/1138] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Aug 2 15:17:30 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:17:32.928247 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b5eca-e7dd-46b1-8385-923f0baf4884 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:32.928793 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b5eca-e7dd-46b1-8385-923f0baf4884 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:32.928793 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b5eca-e7dd-46b1-8385-923f0baf4884 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:32.930142 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 577/1139] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:17:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:17:32.935360 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4fe3ef-9a4b-42a7-a150-320ebce183c9 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:32.935767 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4fe3ef-9a4b-42a7-a150-320ebce183c9 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:32.935920 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4fe3ef-9a4b-42a7-a150-320ebce183c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:32.956486 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-0b4fe3ef-9a4b-42a7-a150-320ebce183c9 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:17:32.959343 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-0b4fe3ef-9a4b-42a7-a150-320ebce183c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:17:33.024859 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 563/1140] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:17:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 15:17:33.048656 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355b5eca-e7dd-46b1-8385-923f0baf4884 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:33.108013 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:33.149557 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355b5eca-e7dd-46b1-8385-923f0baf4884 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:33.183677 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a8312-f560-48b8-9b1a-1bb97aed0bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:33.184315 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a8312-f560-48b8-9b1a-1bb97aed0bfe None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:33.184599 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a8312-f560-48b8-9b1a-1bb97aed0bfe None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:33.184875 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a8312-f560-48b8-9b1a-1bb97aed0bfe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:33.194744 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9a8312-f560-48b8-9b1a-1bb97aed0bfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:17:33.199686 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-bc9a8312-f560-48b8-9b1a-1bb97aed0bfe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 15:17:33.199686 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:17:33.199686 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:17:33.199686 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:17:33.199686 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:17:33.199686 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:17:33.199686 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:17:33.199686 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:17:33.199686 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:17:33.199686 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:17:33.199686 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:17:33.199686 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:17:33.199686 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:17:33.199686 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:17:33.199686 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:17:33.199686 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:17:33.200677 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:17:33.200677 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:17:33.200677 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:17:33.200677 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:17:33.200677 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:17:33.200677 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:17:33.200677 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:17:33.200677 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:17:33.200677 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:17:33.200677 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:17:33.200677 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:17:33.200677 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:17:33.200677 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:17:33.200677 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:17:33.200677 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:17:33.200677 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:17:33.201652 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:17:33.201652 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:17:33.201652 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:17:33.201652 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:17:33.201652 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:17:33.201652 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:17:33.201652 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:17:33.201652 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:17:33.201652 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:17:33.201652 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:17:33.201652 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 15:17:33.201652 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:17:33.201652 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 578/1141] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 2 15:17:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:17:33.207405 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4fe3ef-9a4b-42a7-a150-320ebce183c9 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:33.303058 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4fe3ef-9a4b-42a7-a150-320ebce183c9 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:33.320125 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:33.337894 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1a5502-a051-4a6a-82fa-5e7179b6d1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:33.338507 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a5502-a051-4a6a-82fa-5e7179b6d1a6 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:33.338787 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a5502-a051-4a6a-82fa-5e7179b6d1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:33.339060 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a5502-a051-4a6a-82fa-5e7179b6d1a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:33.339792 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1a5502-a051-4a6a-82fa-5e7179b6d1a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:17:33.340094 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1a5502-a051-4a6a-82fa-5e7179b6d1a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:33.341451 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1a5502-a051-4a6a-82fa-5e7179b6d1a6 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:33.349259 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 564/1142] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 2 15:17:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:17:33.355053 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a8312-f560-48b8-9b1a-1bb97aed0bfe None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:33.453406 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a8312-f560-48b8-9b1a-1bb97aed0bfe None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:33.472714 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:33.487314 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e251c450-9bab-4941-a246-7aab2f4fe6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:33.487943 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e251c450-9bab-4941-a246-7aab2f4fe6eb None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:33.488227 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e251c450-9bab-4941-a246-7aab2f4fe6eb None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:33.488506 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e251c450-9bab-4941-a246-7aab2f4fe6eb None admin] PATH_INFO: `/v3/users/c14eaefc75e04561af47959cb0d08d10` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:33.501989 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e251c450-9bab-4941-a246-7aab2f4fe6eb None admin] RBAC: Authorizing `identity:get_user(user_id=c14eaefc75e04561af47959cb0d08d10)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:33.504112 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e251c450-9bab-4941-a246-7aab2f4fe6eb None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:33.505729 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 579/1143] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 2 15:17:33 2022] GET /identity/v3/users/c14eaefc75e04561af47959cb0d08d10 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:17:33.511689 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1a5502-a051-4a6a-82fa-5e7179b6d1a6 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:33.609970 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1a5502-a051-4a6a-82fa-5e7179b6d1a6 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:33.643681 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b14ae-a8ab-4e93-b9c9-20753b15be45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:33.644280 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b14ae-a8ab-4e93-b9c9-20753b15be45 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:33.644561 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b14ae-a8ab-4e93-b9c9-20753b15be45 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:33.644833 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b14ae-a8ab-4e93-b9c9-20753b15be45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:33.691224 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:33.710556 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021b14ae-a8ab-4e93-b9c9-20753b15be45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:33.711970 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021b14ae-a8ab-4e93-b9c9-20753b15be45 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:33.804706 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 565/1144] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 2 15:17:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 15:17:33.810593 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e251c450-9bab-4941-a246-7aab2f4fe6eb None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:33.907275 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e251c450-9bab-4941-a246-7aab2f4fe6eb None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:33.944609 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec35fe0e-f8d7-48dc-8e61-aae2476cab29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:33.945258 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35fe0e-f8d7-48dc-8e61-aae2476cab29 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:33.945540 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35fe0e-f8d7-48dc-8e61-aae2476cab29 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:33.945815 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35fe0e-f8d7-48dc-8e61-aae2476cab29 None admin] PATH_INFO: `/v3/projects/1327f5b098fc4e6c8d456606ad5ffef8` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:33.946957 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec35fe0e-f8d7-48dc-8e61-aae2476cab29 None admin] RBAC: Authorizing `identity:get_project(project_id=1327f5b098fc4e6c8d456606ad5ffef8)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:33.948420 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec35fe0e-f8d7-48dc-8e61-aae2476cab29 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:33.950076 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 580/1145] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 2 15:17:33 2022] GET /identity/v3/projects/1327f5b098fc4e6c8d456606ad5ffef8 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:17:33.956687 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b14ae-a8ab-4e93-b9c9-20753b15be45 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:34.037554 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:34.057292 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b14ae-a8ab-4e93-b9c9-20753b15be45 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:34.091977 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60077cb-1f65-4fa9-8a1b-38e5fb7e2ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:34.092848 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60077cb-1f65-4fa9-8a1b-38e5fb7e2ab8 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:34.093130 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60077cb-1f65-4fa9-8a1b-38e5fb7e2ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:34.093406 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60077cb-1f65-4fa9-8a1b-38e5fb7e2ab8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:34.094194 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60077cb-1f65-4fa9-8a1b-38e5fb7e2ab8 None admin] RBAC: Adding query filter params (role.id=d75c9572cb294caeb8eb456521ff6f57, scope.project.id=1327f5b098fc4e6c8d456606ad5ffef8, user.id=c14eaefc75e04561af47959cb0d08d10) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:17:34.094506 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60077cb-1f65-4fa9-8a1b-38e5fb7e2ab8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:34.096713 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60077cb-1f65-4fa9-8a1b-38e5fb7e2ab8 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:34.102370 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 566/1146] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 2 15:17:33 2022] GET /identity/v3/role_assignments?user.id=c14eaefc75e04561af47959cb0d08d10&scope.project.id=1327f5b098fc4e6c8d456606ad5ffef8&role.id=d75c9572cb294caeb8eb456521ff6f57 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:17:36.094777 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c3448-89aa-412f-8652-23d506f922d8 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:36.095341 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c3448-89aa-412f-8652-23d506f922d8 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:36.095341 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c3448-89aa-412f-8652-23d506f922d8 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:36.097197 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 581/1147] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:17:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:17:36.102564 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0dd8d-b29d-4f11-92f9-689a3bcc483f None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:36.103016 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0dd8d-b29d-4f11-92f9-689a3bcc483f None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:36.103123 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0dd8d-b29d-4f11-92f9-689a3bcc483f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:36.121644 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-7fb0dd8d-b29d-4f11-92f9-689a3bcc483f None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:17:36.122822 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-7fb0dd8d-b29d-4f11-92f9-689a3bcc483f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:17:36.189440 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 567/1148] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:17:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 15:17:36.212318 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c3448-89aa-412f-8652-23d506f922d8 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:36.261716 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:36.317785 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c3448-89aa-412f-8652-23d506f922d8 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:36.356567 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494b80ee-ae9c-4c87-84d6-34d6a62f724d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:36.357125 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b80ee-ae9c-4c87-84d6-34d6a62f724d None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:36.357412 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b80ee-ae9c-4c87-84d6-34d6a62f724d None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:36.357693 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b80ee-ae9c-4c87-84d6-34d6a62f724d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:36.370184 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494b80ee-ae9c-4c87-84d6-34d6a62f724d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:17:36.375492 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-494b80ee-ae9c-4c87-84d6-34d6a62f724d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 15:17:36.375492 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:17:36.375492 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:17:36.375492 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:17:36.375492 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:17:36.375492 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:17:36.375492 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:17:36.375492 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:17:36.375492 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:17:36.375492 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:17:36.375492 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:17:36.375492 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:17:36.375492 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:17:36.375492 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:17:36.375492 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:17:36.375492 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:17:36.376542 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:17:36.376542 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:17:36.376542 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:17:36.376542 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:17:36.376542 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:17:36.376542 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:17:36.376542 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:17:36.376542 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:17:36.376542 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:17:36.376542 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:17:36.376542 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:17:36.376542 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:17:36.376542 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:17:36.376542 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:17:36.376542 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:17:36.376542 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:17:36.378296 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:17:36.378296 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:17:36.378296 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:17:36.378296 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:17:36.378296 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:17:36.378296 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:17:36.378296 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:17:36.378296 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:17:36.378296 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:17:36.378296 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:17:36.378296 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 15:17:36.378296 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:17:36.378296 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 582/1149] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 2 15:17:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:17:36.384177 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb0dd8d-b29d-4f11-92f9-689a3bcc483f None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:36.456515 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:36.482373 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb0dd8d-b29d-4f11-92f9-689a3bcc483f None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:36.515992 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6637ae9-a08e-4410-b66a-41c156944b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:36.516607 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6637ae9-a08e-4410-b66a-41c156944b92 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:36.516889 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6637ae9-a08e-4410-b66a-41c156944b92 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:36.517164 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6637ae9-a08e-4410-b66a-41c156944b92 None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:36.517904 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6637ae9-a08e-4410-b66a-41c156944b92 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:17:36.518212 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6637ae9-a08e-4410-b66a-41c156944b92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:36.519623 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6637ae9-a08e-4410-b66a-41c156944b92 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:36.527801 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 568/1150] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 2 15:17:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:17:36.534108 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494b80ee-ae9c-4c87-84d6-34d6a62f724d None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:36.648832 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494b80ee-ae9c-4c87-84d6-34d6a62f724d None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:36.656531 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:36.684988 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f893232f-cabf-4a45-a17b-740bc6206ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:36.685627 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893232f-cabf-4a45-a17b-740bc6206ef0 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:36.685906 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893232f-cabf-4a45-a17b-740bc6206ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:36.686180 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893232f-cabf-4a45-a17b-740bc6206ef0 None admin] PATH_INFO: `/v3/users/c14eaefc75e04561af47959cb0d08d10` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:36.687378 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f893232f-cabf-4a45-a17b-740bc6206ef0 None admin] RBAC: Authorizing `identity:get_user(user_id=c14eaefc75e04561af47959cb0d08d10)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:36.688816 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f893232f-cabf-4a45-a17b-740bc6206ef0 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:36.690929 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 583/1151] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 2 15:17:36 2022] GET /identity/v3/users/c14eaefc75e04561af47959cb0d08d10 => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:17:36.696820 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6637ae9-a08e-4410-b66a-41c156944b92 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:36.804149 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6637ae9-a08e-4410-b66a-41c156944b92 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:36.839134 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4712491-145a-4dd5-852f-f8efcbb39c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:36.839819 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4712491-145a-4dd5-852f-f8efcbb39c4a None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:36.840099 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4712491-145a-4dd5-852f-f8efcbb39c4a None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:36.840377 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4712491-145a-4dd5-852f-f8efcbb39c4a None admin] PATH_INFO: `/v3/projects/1327f5b098fc4e6c8d456606ad5ffef8` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:36.841547 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4712491-145a-4dd5-852f-f8efcbb39c4a None admin] RBAC: Authorizing `identity:get_project(project_id=1327f5b098fc4e6c8d456606ad5ffef8)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:36.842987 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4712491-145a-4dd5-852f-f8efcbb39c4a None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:36.844696 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 569/1152] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 2 15:17:36 2022] GET /identity/v3/projects/1327f5b098fc4e6c8d456606ad5ffef8 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:17:36.850967 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f893232f-cabf-4a45-a17b-740bc6206ef0 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:36.970138 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f893232f-cabf-4a45-a17b-740bc6206ef0 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:37.003499 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5796d35-f819-4159-bcbc-f936d64faf5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:37.004150 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5796d35-f819-4159-bcbc-f936d64faf5a None admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:37.004429 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5796d35-f819-4159-bcbc-f936d64faf5a None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:37.004700 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5796d35-f819-4159-bcbc-f936d64faf5a None admin] PATH_INFO: `/v3/projects/1327f5b098fc4e6c8d456606ad5ffef8/users/c14eaefc75e04561af47959cb0d08d10/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:37.006584 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5796d35-f819-4159-bcbc-f936d64faf5a None admin] RBAC: Authorizing `identity:create_grant(project_id=1327f5b098fc4e6c8d456606ad5ffef8, user_id=c14eaefc75e04561af47959cb0d08d10, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:37.008105 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5796d35-f819-4159-bcbc-f936d64faf5a None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:37.021440 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 584/1153] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 2 15:17:36 2022] PUT /identity/v3/projects/1327f5b098fc4e6c8d456606ad5ffef8/users/c14eaefc75e04561af47959cb0d08d10/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:17:39.036331 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e790e1f8-ad13-4885-a990-06f4593b0c30 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:39.036899 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e790e1f8-ad13-4885-a990-06f4593b0c30 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:39.036899 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e790e1f8-ad13-4885-a990-06f4593b0c30 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:39.038363 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 570/1154] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:17:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:17:39.043763 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22967fdc-f41b-4622-87c6-a33647cd8b56 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:39.044176 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22967fdc-f41b-4622-87c6-a33647cd8b56 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:39.044351 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22967fdc-f41b-4622-87c6-a33647cd8b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:39.062233 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-22967fdc-f41b-4622-87c6-a33647cd8b56 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:17:39.063505 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-22967fdc-f41b-4622-87c6-a33647cd8b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:17:39.090160 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:39.132659 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 585/1155] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:17:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 15:17:39.156306 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e790e1f8-ad13-4885-a990-06f4593b0c30 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:39.160194 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:39.259056 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e790e1f8-ad13-4885-a990-06f4593b0c30 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:39.294838 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dfcd53-57da-48fe-94cc-0730aa77e071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:39.295421 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dfcd53-57da-48fe-94cc-0730aa77e071 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:39.295706 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dfcd53-57da-48fe-94cc-0730aa77e071 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:39.295982 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dfcd53-57da-48fe-94cc-0730aa77e071 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:39.307089 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dfcd53-57da-48fe-94cc-0730aa77e071 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:17:39.311968 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-b7dfcd53-57da-48fe-94cc-0730aa77e071 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 15:17:39.311968 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:17:39.311968 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:17:39.311968 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:17:39.311968 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:17:39.311968 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:17:39.311968 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:17:39.311968 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:17:39.311968 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:17:39.311968 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:17:39.311968 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:17:39.311968 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:17:39.311968 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:17:39.311968 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:17:39.311968 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:17:39.311968 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:17:39.313052 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:17:39.313052 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:17:39.313052 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:17:39.313052 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:17:39.313052 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:17:39.313052 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:17:39.313052 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:17:39.313052 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:17:39.313052 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:17:39.313052 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:17:39.313052 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:17:39.313052 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:17:39.313052 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:17:39.313052 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:17:39.313052 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:17:39.313052 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:17:39.314137 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:17:39.314137 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:17:39.314137 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:17:39.314137 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:17:39.314137 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:17:39.314137 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:17:39.314137 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:17:39.314137 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:17:39.314137 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:17:39.314137 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:17:39.314137 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 15:17:39.314137 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:17:39.314137 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 571/1156] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 2 15:17:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:17:39.319834 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22967fdc-f41b-4622-87c6-a33647cd8b56 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:39.432815 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22967fdc-f41b-4622-87c6-a33647cd8b56 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:39.466970 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43845830-ac9e-4239-8c90-b9ae5008c78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:39.467609 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43845830-ac9e-4239-8c90-b9ae5008c78a None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:39.467892 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43845830-ac9e-4239-8c90-b9ae5008c78a None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:39.468163 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43845830-ac9e-4239-8c90-b9ae5008c78a None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:39.468870 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43845830-ac9e-4239-8c90-b9ae5008c78a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:17:39.469172 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43845830-ac9e-4239-8c90-b9ae5008c78a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:39.470555 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43845830-ac9e-4239-8c90-b9ae5008c78a None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:39.479106 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 586/1157] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 2 15:17:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:17:39.485018 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dfcd53-57da-48fe-94cc-0730aa77e071 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:39.546229 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:39.583689 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dfcd53-57da-48fe-94cc-0730aa77e071 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:39.615065 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10330fc-7e7c-438d-b60f-687805a9aca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:39.615721 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10330fc-7e7c-438d-b60f-687805a9aca3 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:39.615998 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10330fc-7e7c-438d-b60f-687805a9aca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:39.616269 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10330fc-7e7c-438d-b60f-687805a9aca3 None admin] PATH_INFO: `/v3/users/c14eaefc75e04561af47959cb0d08d10` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:39.617418 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10330fc-7e7c-438d-b60f-687805a9aca3 None admin] RBAC: Authorizing `identity:get_user(user_id=c14eaefc75e04561af47959cb0d08d10)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:39.618841 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10330fc-7e7c-438d-b60f-687805a9aca3 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:39.620468 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 572/1158] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 2 15:17:39 2022] GET /identity/v3/users/c14eaefc75e04561af47959cb0d08d10 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:17:39.626359 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43845830-ac9e-4239-8c90-b9ae5008c78a None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:39.654174 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:39.725012 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43845830-ac9e-4239-8c90-b9ae5008c78a None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:39.757227 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf9882d-a383-47f4-87c7-f6a6ea424dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:39.757826 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9882d-a383-47f4-87c7-f6a6ea424dfc None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:39.758102 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9882d-a383-47f4-87c7-f6a6ea424dfc None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:39.758374 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9882d-a383-47f4-87c7-f6a6ea424dfc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:39.824853 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf9882d-a383-47f4-87c7-f6a6ea424dfc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:39.826225 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf9882d-a383-47f4-87c7-f6a6ea424dfc None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:39.852197 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:39.922371 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 587/1159] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 2 15:17:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 15:17:39.928772 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10330fc-7e7c-438d-b60f-687805a9aca3 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:40.030666 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10330fc-7e7c-438d-b60f-687805a9aca3 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:40.060400 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:40.065647 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832843fa-05e8-4696-83b7-4e3e0a4ade09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:40.066287 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832843fa-05e8-4696-83b7-4e3e0a4ade09 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:40.066565 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832843fa-05e8-4696-83b7-4e3e0a4ade09 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:40.066854 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832843fa-05e8-4696-83b7-4e3e0a4ade09 None admin] PATH_INFO: `/v3/projects/1327f5b098fc4e6c8d456606ad5ffef8` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:40.068048 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832843fa-05e8-4696-83b7-4e3e0a4ade09 None admin] RBAC: Authorizing `identity:get_project(project_id=1327f5b098fc4e6c8d456606ad5ffef8)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:40.069467 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832843fa-05e8-4696-83b7-4e3e0a4ade09 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:40.071121 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 573/1160] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 2 15:17:39 2022] GET /identity/v3/projects/1327f5b098fc4e6c8d456606ad5ffef8 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:17:40.077520 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf9882d-a383-47f4-87c7-f6a6ea424dfc None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:40.185961 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf9882d-a383-47f4-87c7-f6a6ea424dfc None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:40.212380 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:40.221983 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df4c6d-bae5-4536-91f1-0f05d349f9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:40.222599 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df4c6d-bae5-4536-91f1-0f05d349f9f2 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:40.222882 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df4c6d-bae5-4536-91f1-0f05d349f9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:40.223156 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df4c6d-bae5-4536-91f1-0f05d349f9f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:40.223969 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df4c6d-bae5-4536-91f1-0f05d349f9f2 None admin] RBAC: Adding query filter params (role.id=d75c9572cb294caeb8eb456521ff6f57, scope.project.id=1327f5b098fc4e6c8d456606ad5ffef8, user.id=c14eaefc75e04561af47959cb0d08d10) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:17:40.224283 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df4c6d-bae5-4536-91f1-0f05d349f9f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:40.225722 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df4c6d-bae5-4536-91f1-0f05d349f9f2 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:40.231575 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 588/1161] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 2 15:17:40 2022] GET /identity/v3/role_assignments?user.id=c14eaefc75e04561af47959cb0d08d10&scope.project.id=1327f5b098fc4e6c8d456606ad5ffef8&role.id=d75c9572cb294caeb8eb456521ff6f57 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:17:42.250692 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35b3c8-0a9a-4f25-a870-42b1dd8eb053 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:42.251248 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35b3c8-0a9a-4f25-a870-42b1dd8eb053 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:42.251248 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35b3c8-0a9a-4f25-a870-42b1dd8eb053 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:42.252625 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 574/1162] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:17:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:17:42.258016 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721904a-828b-4f02-a37d-8dd9c7794386 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:42.258457 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721904a-828b-4f02-a37d-8dd9c7794386 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:42.258572 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721904a-828b-4f02-a37d-8dd9c7794386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:42.276767 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-7721904a-828b-4f02-a37d-8dd9c7794386 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:17:42.277959 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-7721904a-828b-4f02-a37d-8dd9c7794386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:17:42.343526 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 589/1163] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:17:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 15:17:42.366548 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e35b3c8-0a9a-4f25-a870-42b1dd8eb053 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:42.474905 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e35b3c8-0a9a-4f25-a870-42b1dd8eb053 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:42.507739 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3789d5fc-3782-4f0f-b3c8-2c7a4186c91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:42.508346 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789d5fc-3782-4f0f-b3c8-2c7a4186c91e None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:42.508628 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789d5fc-3782-4f0f-b3c8-2c7a4186c91e None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:42.508904 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789d5fc-3782-4f0f-b3c8-2c7a4186c91e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:42.573277 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:42.575994 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3789d5fc-3782-4f0f-b3c8-2c7a4186c91e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:42.577766 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3789d5fc-3782-4f0f-b3c8-2c7a4186c91e None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:42.679230 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 575/1164] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 2 15:17:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 15:17:42.685320 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7721904a-828b-4f02-a37d-8dd9c7794386 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:42.782214 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7721904a-828b-4f02-a37d-8dd9c7794386 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:42.802425 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:42.817744 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaf4fba-bb80-40eb-863a-979ce2254d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:42.818377 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf4fba-bb80-40eb-863a-979ce2254d9f None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:42.818658 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf4fba-bb80-40eb-863a-979ce2254d9f None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:42.818928 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf4fba-bb80-40eb-863a-979ce2254d9f None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:42.825555 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaf4fba-bb80-40eb-863a-979ce2254d9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:42.827260 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaf4fba-bb80-40eb-863a-979ce2254d9f None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:42.839141 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-bfaf4fba-bb80-40eb-863a-979ce2254d9f None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 02 15:17:42.839141 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:17:42.839141 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 02 15:17:42.839141 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 02 15:17:42.839141 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 15:17:42.839141 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 15:17:42.839141 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 15:17:42.839141 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 15:17:42.839141 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 02 15:17:42.839141 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:17:42.839141 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 15:17:42.839141 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:17:42.839141 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:17:42.839141 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:17:42.839141 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:17:42.839141 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:17:42.839141 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:17:42.840361 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:17:42.840361 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:17:42.840361 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:17:42.840361 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:17:42.840361 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:17:42.840361 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:17:42.840361 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:17:42.840361 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:17:42.840361 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:17:42.840361 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:17:42.840361 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:17:42.840361 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:17:42.840361 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:17:42.840361 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:17:42.840361 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:17:42.840361 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:17:42.841201 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:17:42.841201 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:17:42.841201 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:17:42.841201 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:17:42.841201 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:17:42.841201 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:17:42.841201 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:17:42.841201 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:17:42.841201 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:17:42.841201 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:17:42.841201 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 02 15:17:42.841201 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:17:42.841201 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 02 15:17:42.841201 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:17:42.841201 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 590/1165] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Aug 2 15:17:42 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:17:42.846843 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3789d5fc-3782-4f0f-b3c8-2c7a4186c91e None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:42.940043 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:42.942954 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3789d5fc-3782-4f0f-b3c8-2c7a4186c91e None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:42.977561 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de434745-62dc-41e7-9ee6-37f24ea61526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:42.978171 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de434745-62dc-41e7-9ee6-37f24ea61526 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:42.978451 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de434745-62dc-41e7-9ee6-37f24ea61526 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:42.978724 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de434745-62dc-41e7-9ee6-37f24ea61526 None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:42.979430 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de434745-62dc-41e7-9ee6-37f24ea61526 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:17:42.979740 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de434745-62dc-41e7-9ee6-37f24ea61526 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:42.981102 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de434745-62dc-41e7-9ee6-37f24ea61526 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:42.988132 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 576/1166] 10.222.0.42 () {56 vars in 1115 bytes} [Tue Aug 2 15:17:42 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:17:44.971323 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c1d63-f591-409b-9c7e-0a239d6bf58c None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:44.971887 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c1d63-f591-409b-9c7e-0a239d6bf58c None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:44.971887 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c1d63-f591-409b-9c7e-0a239d6bf58c None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:44.973242 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 591/1167] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:17:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:17:44.978451 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23882aa5-f8f3-4122-9c32-4c34604e7cb0 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:44.978880 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23882aa5-f8f3-4122-9c32-4c34604e7cb0 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:44.978988 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23882aa5-f8f3-4122-9c32-4c34604e7cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:44.997127 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-23882aa5-f8f3-4122-9c32-4c34604e7cb0 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:17:44.998325 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-23882aa5-f8f3-4122-9c32-4c34604e7cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:17:45.061592 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 577/1168] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:17:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 15:17:45.084607 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c1d63-f591-409b-9c7e-0a239d6bf58c None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:45.188564 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c1d63-f591-409b-9c7e-0a239d6bf58c None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:45.222695 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf8d923-a1fb-4a2c-9cce-8ec26ba162af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:45.223246 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf8d923-a1fb-4a2c-9cce-8ec26ba162af None admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:45.223536 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf8d923-a1fb-4a2c-9cce-8ec26ba162af None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:45.223808 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf8d923-a1fb-4a2c-9cce-8ec26ba162af None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:45.224508 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf8d923-a1fb-4a2c-9cce-8ec26ba162af None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:45.225869 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf8d923-a1fb-4a2c-9cce-8ec26ba162af None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:45.241718 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 592/1169] 10.222.0.42 () {60 vars in 1138 bytes} [Tue Aug 2 15:17:45 2022] POST /identity/v3/domains => generated 267 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:17:47.245315 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2574f3-bb8e-4ecc-a672-be007a1d881f None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:47.245889 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2574f3-bb8e-4ecc-a672-be007a1d881f None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:47.245889 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2574f3-bb8e-4ecc-a672-be007a1d881f None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:47.247175 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 578/1170] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:17:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:17:47.252836 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6536c239-0999-4772-b3a6-2e0471205059 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:47.253306 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6536c239-0999-4772-b3a6-2e0471205059 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:47.253407 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6536c239-0999-4772-b3a6-2e0471205059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:47.271729 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-6536c239-0999-4772-b3a6-2e0471205059 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:17:47.272929 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-6536c239-0999-4772-b3a6-2e0471205059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:17:47.306374 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:47.340628 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 593/1171] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:17:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 15:17:47.363415 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2574f3-bb8e-4ecc-a672-be007a1d881f None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:47.457606 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:47.465381 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2574f3-bb8e-4ecc-a672-be007a1d881f None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:47.498544 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480bb570-d34b-4dd3-90e5-c03221ae0966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:47.499169 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480bb570-d34b-4dd3-90e5-c03221ae0966 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:47.499476 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480bb570-d34b-4dd3-90e5-c03221ae0966 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:47.499752 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480bb570-d34b-4dd3-90e5-c03221ae0966 None admin] PATH_INFO: `/v3/domains/696d293a4fec4fd4a3a7117c9df3e31c` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:47.509873 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480bb570-d34b-4dd3-90e5-c03221ae0966 None admin] RBAC: Authorizing `identity:get_domain(domain_id=696d293a4fec4fd4a3a7117c9df3e31c)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:47.511338 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480bb570-d34b-4dd3-90e5-c03221ae0966 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:47.512952 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 579/1172] 10.222.0.42 () {56 vars in 1183 bytes} [Tue Aug 2 15:17:47 2022] GET /identity/v3/domains/696d293a4fec4fd4a3a7117c9df3e31c => generated 267 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:17:47.519240 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6536c239-0999-4772-b3a6-2e0471205059 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:47.617192 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6536c239-0999-4772-b3a6-2e0471205059 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:47.650827 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6047f5f5-bd78-470a-aaad-616d2df0aac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:47.651463 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047f5f5-bd78-470a-aaad-616d2df0aac2 None admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:47.651750 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047f5f5-bd78-470a-aaad-616d2df0aac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:47.652030 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047f5f5-bd78-470a-aaad-616d2df0aac2 None admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:47.652724 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6047f5f5-bd78-470a-aaad-616d2df0aac2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:47.654162 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6047f5f5-bd78-470a-aaad-616d2df0aac2 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:47.681068 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 594/1173] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Aug 2 15:17:47 2022] POST /identity/v3/projects => generated 361 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:17:49.677169 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168958e-26c9-4cea-92b0-bd8ac8b6fe05 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:49.677724 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168958e-26c9-4cea-92b0-bd8ac8b6fe05 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:49.677724 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168958e-26c9-4cea-92b0-bd8ac8b6fe05 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:49.679080 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 580/1174] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:17:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:17:49.684353 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a3e1e-85dd-4eac-9cfb-97b89ce3146f None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:49.684792 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a3e1e-85dd-4eac-9cfb-97b89ce3146f None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:49.684893 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a3e1e-85dd-4eac-9cfb-97b89ce3146f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:49.703242 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-043a3e1e-85dd-4eac-9cfb-97b89ce3146f None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:17:49.704414 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-043a3e1e-85dd-4eac-9cfb-97b89ce3146f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:17:49.721632 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:49.771530 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 595/1175] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:17:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 15:17:49.796056 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0168958e-26c9-4cea-92b0-bd8ac8b6fe05 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:49.893839 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0168958e-26c9-4cea-92b0-bd8ac8b6fe05 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:49.926330 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d86179-0c1b-4e3b-ba5c-2e3f069596d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:49.926956 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d86179-0c1b-4e3b-ba5c-2e3f069596d1 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:49.927306 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d86179-0c1b-4e3b-ba5c-2e3f069596d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:49.927533 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d86179-0c1b-4e3b-ba5c-2e3f069596d1 None admin] PATH_INFO: `/v3/domains/696d293a4fec4fd4a3a7117c9df3e31c` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:49.928662 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d86179-0c1b-4e3b-ba5c-2e3f069596d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=696d293a4fec4fd4a3a7117c9df3e31c)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:49.930072 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d86179-0c1b-4e3b-ba5c-2e3f069596d1 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:49.931667 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 581/1176] 10.222.0.42 () {56 vars in 1183 bytes} [Tue Aug 2 15:17:49 2022] GET /identity/v3/domains/696d293a4fec4fd4a3a7117c9df3e31c => generated 267 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:17:49.937539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a3e1e-85dd-4eac-9cfb-97b89ce3146f None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:50.038082 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a3e1e-85dd-4eac-9cfb-97b89ce3146f None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:50.071432 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b87766-8e6f-49cf-9a01-0a4a74f3a19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:50.072002 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b87766-8e6f-49cf-9a01-0a4a74f3a19a None admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:50.072286 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b87766-8e6f-49cf-9a01-0a4a74f3a19a None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:50.072565 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b87766-8e6f-49cf-9a01-0a4a74f3a19a None admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:50.073250 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b87766-8e6f-49cf-9a01-0a4a74f3a19a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:50.074687 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b87766-8e6f-49cf-9a01-0a4a74f3a19a None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:50.100036 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 596/1177] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Aug 2 15:17:49 2022] POST /identity/v3/users => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:17:52.160459 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188def7-7633-4bac-a58e-bb3b7740e565 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:52.160882 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188def7-7633-4bac-a58e-bb3b7740e565 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:52.161157 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188def7-7633-4bac-a58e-bb3b7740e565 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:52.163341 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 582/1178] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:17:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:17:52.168885 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113eb51b-6cfc-4cb8-b55c-6c6a85e5048a None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:52.169308 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113eb51b-6cfc-4cb8-b55c-6c6a85e5048a None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:52.169450 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113eb51b-6cfc-4cb8-b55c-6c6a85e5048a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:52.188473 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-113eb51b-6cfc-4cb8-b55c-6c6a85e5048a None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:17:52.189685 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-113eb51b-6cfc-4cb8-b55c-6c6a85e5048a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:17:52.191809 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:52.258058 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 597/1179] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:17:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 15:17:52.281813 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e188def7-7633-4bac-a58e-bb3b7740e565 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:52.306846 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:52.380627 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e188def7-7633-4bac-a58e-bb3b7740e565 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:52.412861 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82dd3f5-f41e-46bd-902d-b34a675967fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:52.413424 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82dd3f5-f41e-46bd-902d-b34a675967fe None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:52.413701 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82dd3f5-f41e-46bd-902d-b34a675967fe None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:52.413969 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82dd3f5-f41e-46bd-902d-b34a675967fe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:52.424800 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82dd3f5-f41e-46bd-902d-b34a675967fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:17:52.429550 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-c82dd3f5-f41e-46bd-902d-b34a675967fe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 15:17:52.429550 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:17:52.429550 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:17:52.429550 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:17:52.429550 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:17:52.429550 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:17:52.429550 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:17:52.429550 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:17:52.429550 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:17:52.429550 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:17:52.429550 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:17:52.429550 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:17:52.429550 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:17:52.429550 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:17:52.429550 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:17:52.429550 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:17:52.430783 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:17:52.430783 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:17:52.430783 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:17:52.430783 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:17:52.430783 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:17:52.430783 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:17:52.430783 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:17:52.430783 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:17:52.430783 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:17:52.430783 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:17:52.430783 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:17:52.430783 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:17:52.430783 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:17:52.430783 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:17:52.430783 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:17:52.430783 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:17:52.432201 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:17:52.432201 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:17:52.432201 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:17:52.432201 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:17:52.432201 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:17:52.432201 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:17:52.432201 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:17:52.432201 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:17:52.432201 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:17:52.432201 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:17:52.432201 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 15:17:52.432201 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:17:52.432201 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 583/1180] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 2 15:17:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:17:52.436765 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113eb51b-6cfc-4cb8-b55c-6c6a85e5048a None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:52.532266 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113eb51b-6cfc-4cb8-b55c-6c6a85e5048a None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:52.565733 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790386e7-9826-403f-88b5-9ab076da2882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:52.566335 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790386e7-9826-403f-88b5-9ab076da2882 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:52.566617 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790386e7-9826-403f-88b5-9ab076da2882 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:52.566889 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790386e7-9826-403f-88b5-9ab076da2882 None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:52.567630 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790386e7-9826-403f-88b5-9ab076da2882 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:17:52.567935 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790386e7-9826-403f-88b5-9ab076da2882 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:52.569297 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790386e7-9826-403f-88b5-9ab076da2882 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:52.574221 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:52.578405 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 598/1181] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 2 15:17:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:17:52.583409 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82dd3f5-f41e-46bd-902d-b34a675967fe None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:52.675106 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:52.693504 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82dd3f5-f41e-46bd-902d-b34a675967fe None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:52.726972 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620eb42f-38ff-40fe-87aa-392498f8b203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:52.727640 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620eb42f-38ff-40fe-87aa-392498f8b203 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:52.727922 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620eb42f-38ff-40fe-87aa-392498f8b203 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:52.728193 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620eb42f-38ff-40fe-87aa-392498f8b203 None admin] PATH_INFO: `/v3/users/36b13e8de0544768a78e602ae5bbdf90` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:52.742083 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620eb42f-38ff-40fe-87aa-392498f8b203 None admin] RBAC: Authorizing `identity:get_user(user_id=36b13e8de0544768a78e602ae5bbdf90)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:52.743550 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620eb42f-38ff-40fe-87aa-392498f8b203 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:52.745189 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 584/1182] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 2 15:17:52 2022] GET /identity/v3/users/36b13e8de0544768a78e602ae5bbdf90 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:17:52.751174 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790386e7-9826-403f-88b5-9ab076da2882 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:52.851226 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790386e7-9826-403f-88b5-9ab076da2882 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:52.883937 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eb78a2-bf48-4638-9186-c5644bdc3522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:52.884537 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb78a2-bf48-4638-9186-c5644bdc3522 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:52.884815 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb78a2-bf48-4638-9186-c5644bdc3522 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:52.885088 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb78a2-bf48-4638-9186-c5644bdc3522 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:52.949341 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:52.952235 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eb78a2-bf48-4638-9186-c5644bdc3522 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:52.953805 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eb78a2-bf48-4638-9186-c5644bdc3522 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:53.050422 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 599/1183] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 2 15:17:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 15:17:53.056427 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620eb42f-38ff-40fe-87aa-392498f8b203 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:53.152994 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620eb42f-38ff-40fe-87aa-392498f8b203 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:53.188163 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5475f4b-3783-4d03-8f84-972a4a81ae82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:53.188787 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5475f4b-3783-4d03-8f84-972a4a81ae82 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:53.189073 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5475f4b-3783-4d03-8f84-972a4a81ae82 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:53.189858 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5475f4b-3783-4d03-8f84-972a4a81ae82 None admin] PATH_INFO: `/v3/projects/a61c7a0145bf41d6812db52b0d1da254` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:53.191009 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5475f4b-3783-4d03-8f84-972a4a81ae82 None admin] RBAC: Authorizing `identity:get_project(project_id=a61c7a0145bf41d6812db52b0d1da254)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:53.192475 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5475f4b-3783-4d03-8f84-972a4a81ae82 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:53.194134 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 585/1184] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 2 15:17:53 2022] GET /identity/v3/projects/a61c7a0145bf41d6812db52b0d1da254 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:17:53.200358 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eb78a2-bf48-4638-9186-c5644bdc3522 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:53.299873 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:53.302836 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eb78a2-bf48-4638-9186-c5644bdc3522 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:53.336960 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95383eee-5cde-4b5e-ac6d-78eea84e6fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:53.337567 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95383eee-5cde-4b5e-ac6d-78eea84e6fb0 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:53.337853 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95383eee-5cde-4b5e-ac6d-78eea84e6fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:53.338133 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95383eee-5cde-4b5e-ac6d-78eea84e6fb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:53.338916 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95383eee-5cde-4b5e-ac6d-78eea84e6fb0 None admin] RBAC: Adding query filter params (role.id=d75c9572cb294caeb8eb456521ff6f57, scope.project.id=a61c7a0145bf41d6812db52b0d1da254, user.id=36b13e8de0544768a78e602ae5bbdf90) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:17:53.339247 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95383eee-5cde-4b5e-ac6d-78eea84e6fb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:53.340687 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95383eee-5cde-4b5e-ac6d-78eea84e6fb0 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:53.345964 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 600/1185] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 2 15:17:53 2022] GET /identity/v3/role_assignments?user.id=36b13e8de0544768a78e602ae5bbdf90&scope.project.id=a61c7a0145bf41d6812db52b0d1da254&role.id=d75c9572cb294caeb8eb456521ff6f57 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:17:55.338984 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294085a-bab8-4cdf-b5e0-12e983a63ccb None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:55.339577 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294085a-bab8-4cdf-b5e0-12e983a63ccb None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:55.339577 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294085a-bab8-4cdf-b5e0-12e983a63ccb None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:55.340925 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 586/1186] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:17:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:17:55.346423 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01293ce9-39a5-4999-8ab5-32b9269dadee None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:55.346857 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01293ce9-39a5-4999-8ab5-32b9269dadee None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:55.346968 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01293ce9-39a5-4999-8ab5-32b9269dadee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:55.365338 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-01293ce9-39a5-4999-8ab5-32b9269dadee None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:17:55.366510 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-01293ce9-39a5-4999-8ab5-32b9269dadee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:17:55.432684 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 601/1187] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:17:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 15:17:55.455571 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0294085a-bab8-4cdf-b5e0-12e983a63ccb None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:55.466317 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:55.554461 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0294085a-bab8-4cdf-b5e0-12e983a63ccb None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:55.588091 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e5f30-20bf-4059-8f01-ae7f2b6c0e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:55.588725 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e5f30-20bf-4059-8f01-ae7f2b6c0e0b None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:55.589007 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e5f30-20bf-4059-8f01-ae7f2b6c0e0b None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:55.589283 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e5f30-20bf-4059-8f01-ae7f2b6c0e0b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:55.599144 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11e5f30-20bf-4059-8f01-ae7f2b6c0e0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:17:55.604146 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-d11e5f30-20bf-4059-8f01-ae7f2b6c0e0b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 15:17:55.604146 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:17:55.604146 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:17:55.604146 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:17:55.604146 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:17:55.604146 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:17:55.604146 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:17:55.604146 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:17:55.604146 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:17:55.604146 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:17:55.604146 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:17:55.604146 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:17:55.604146 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:17:55.604146 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:17:55.604146 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:17:55.604146 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:17:55.605284 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:17:55.605284 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:17:55.605284 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:17:55.605284 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:17:55.605284 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:17:55.605284 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:17:55.605284 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:17:55.605284 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:17:55.605284 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:17:55.605284 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:17:55.605284 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:17:55.605284 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:17:55.605284 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:17:55.605284 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:17:55.605284 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:17:55.605284 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:17:55.606318 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:17:55.606318 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:17:55.606318 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:17:55.606318 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:17:55.606318 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:17:55.606318 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:17:55.606318 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:17:55.606318 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:17:55.606318 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:17:55.606318 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:17:55.606318 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 15:17:55.606318 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:17:55.606318 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 587/1188] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 2 15:17:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:17:55.611315 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01293ce9-39a5-4999-8ab5-32b9269dadee None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:55.703357 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:55.710759 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01293ce9-39a5-4999-8ab5-32b9269dadee None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:55.744099 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5a511-e139-4cfe-95d6-1162dbffe01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:55.744715 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5a511-e139-4cfe-95d6-1162dbffe01f None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:55.745002 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5a511-e139-4cfe-95d6-1162dbffe01f None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:55.745280 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5a511-e139-4cfe-95d6-1162dbffe01f None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:55.745987 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e5a511-e139-4cfe-95d6-1162dbffe01f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:17:55.746294 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e5a511-e139-4cfe-95d6-1162dbffe01f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:55.747705 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e5a511-e139-4cfe-95d6-1162dbffe01f None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:55.755568 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 602/1189] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 2 15:17:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:17:55.761383 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e5f30-20bf-4059-8f01-ae7f2b6c0e0b None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:55.828328 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:55.861812 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e5f30-20bf-4059-8f01-ae7f2b6c0e0b None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:55.897313 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a842d3-c442-4451-a9be-15c0d404a06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:55.898058 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a842d3-c442-4451-a9be-15c0d404a06f None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:55.898522 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a842d3-c442-4451-a9be-15c0d404a06f None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:55.898735 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a842d3-c442-4451-a9be-15c0d404a06f None admin] PATH_INFO: `/v3/users/36b13e8de0544768a78e602ae5bbdf90` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:55.900262 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a842d3-c442-4451-a9be-15c0d404a06f None admin] RBAC: Authorizing `identity:get_user(user_id=36b13e8de0544768a78e602ae5bbdf90)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:55.901989 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a842d3-c442-4451-a9be-15c0d404a06f None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:55.903650 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 588/1190] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 2 15:17:55 2022] GET /identity/v3/users/36b13e8de0544768a78e602ae5bbdf90 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:17:55.910088 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5a511-e139-4cfe-95d6-1162dbffe01f None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:56.008111 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5a511-e139-4cfe-95d6-1162dbffe01f None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:56.040710 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc63eb94-0710-4dd3-81c3-8629d2a84772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:56.041334 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63eb94-0710-4dd3-81c3-8629d2a84772 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:56.041614 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63eb94-0710-4dd3-81c3-8629d2a84772 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:56.041891 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63eb94-0710-4dd3-81c3-8629d2a84772 None admin] PATH_INFO: `/v3/projects/a61c7a0145bf41d6812db52b0d1da254` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:56.043033 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc63eb94-0710-4dd3-81c3-8629d2a84772 None admin] RBAC: Authorizing `identity:get_project(project_id=a61c7a0145bf41d6812db52b0d1da254)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:56.044499 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc63eb94-0710-4dd3-81c3-8629d2a84772 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:56.046145 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 603/1191] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 2 15:17:55 2022] GET /identity/v3/projects/a61c7a0145bf41d6812db52b0d1da254 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:17:56.052755 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a842d3-c442-4451-a9be-15c0d404a06f None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:56.152778 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a842d3-c442-4451-a9be-15c0d404a06f None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:56.187839 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92875710-d24f-4078-97bc-ae0cb344aa43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:56.188501 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92875710-d24f-4078-97bc-ae0cb344aa43 None admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:56.188816 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92875710-d24f-4078-97bc-ae0cb344aa43 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:56.189612 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92875710-d24f-4078-97bc-ae0cb344aa43 None admin] PATH_INFO: `/v3/projects/a61c7a0145bf41d6812db52b0d1da254/users/36b13e8de0544768a78e602ae5bbdf90/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:56.191568 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92875710-d24f-4078-97bc-ae0cb344aa43 None admin] RBAC: Authorizing `identity:create_grant(project_id=a61c7a0145bf41d6812db52b0d1da254, user_id=36b13e8de0544768a78e602ae5bbdf90, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:56.192999 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92875710-d24f-4078-97bc-ae0cb344aa43 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:56.195977 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:56.207831 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 589/1192] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 2 15:17:56 2022] PUT /identity/v3/projects/a61c7a0145bf41d6812db52b0d1da254/users/36b13e8de0544768a78e602ae5bbdf90/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:17:58.219164 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751cde2c-dd0f-4a53-85e9-91190f327166 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:58.219695 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751cde2c-dd0f-4a53-85e9-91190f327166 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:58.219811 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751cde2c-dd0f-4a53-85e9-91190f327166 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:58.221104 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 604/1193] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:17:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:17:58.226288 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e3e31-d07c-4839-8ffe-4a9c56e158a8 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:58.226693 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e3e31-d07c-4839-8ffe-4a9c56e158a8 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:58.226846 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e3e31-d07c-4839-8ffe-4a9c56e158a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:58.246287 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-f79e3e31-d07c-4839-8ffe-4a9c56e158a8 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:17:58.247510 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-f79e3e31-d07c-4839-8ffe-4a9c56e158a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:17:58.313940 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 590/1194] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:17:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 15:17:58.336726 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751cde2c-dd0f-4a53-85e9-91190f327166 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:58.362931 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:58.438032 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751cde2c-dd0f-4a53-85e9-91190f327166 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:58.470784 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a2ade9-5d0a-4acb-8d29-525c7455111e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:58.471426 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2ade9-5d0a-4acb-8d29-525c7455111e None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:58.471705 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2ade9-5d0a-4acb-8d29-525c7455111e None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:58.471972 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2ade9-5d0a-4acb-8d29-525c7455111e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:58.482072 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a2ade9-5d0a-4acb-8d29-525c7455111e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:17:58.487469 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-44a2ade9-5d0a-4acb-8d29-525c7455111e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 15:17:58.487469 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:17:58.487469 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:17:58.487469 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:17:58.487469 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:17:58.487469 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:17:58.487469 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:17:58.487469 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:17:58.487469 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:17:58.487469 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:17:58.487469 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:17:58.487469 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:17:58.487469 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:17:58.487469 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:17:58.487469 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:17:58.487469 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:17:58.488565 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:17:58.488565 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:17:58.488565 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:17:58.488565 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:17:58.488565 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:17:58.488565 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:17:58.488565 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:17:58.488565 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:17:58.488565 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:17:58.488565 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:17:58.488565 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:17:58.488565 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:17:58.488565 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:17:58.488565 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:17:58.488565 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:17:58.488565 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:17:58.489511 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:17:58.489511 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:17:58.489511 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:17:58.489511 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:17:58.489511 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:17:58.489511 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:17:58.489511 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:17:58.489511 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:17:58.489511 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:17:58.489511 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:17:58.489511 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 15:17:58.489511 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:17:58.489511 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 605/1195] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 2 15:17:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:17:58.494721 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e3e31-d07c-4839-8ffe-4a9c56e158a8 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:58.590592 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e3e31-d07c-4839-8ffe-4a9c56e158a8 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:58.615009 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:58.623956 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f163a540-f616-4c6b-bfe0-4a456577c85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:58.624570 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f163a540-f616-4c6b-bfe0-4a456577c85d None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:58.624851 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f163a540-f616-4c6b-bfe0-4a456577c85d None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:58.625128 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f163a540-f616-4c6b-bfe0-4a456577c85d None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:58.625834 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f163a540-f616-4c6b-bfe0-4a456577c85d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:17:58.626140 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f163a540-f616-4c6b-bfe0-4a456577c85d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:58.628086 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f163a540-f616-4c6b-bfe0-4a456577c85d None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:58.635924 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 591/1196] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 2 15:17:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:17:58.643037 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a2ade9-5d0a-4acb-8d29-525c7455111e None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:58.725982 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:58.742241 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a2ade9-5d0a-4acb-8d29-525c7455111e None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:58.774951 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad8250a-d224-4272-8e1b-79b0512350fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:58.775607 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8250a-d224-4272-8e1b-79b0512350fb None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:58.775894 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8250a-d224-4272-8e1b-79b0512350fb None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:58.776173 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8250a-d224-4272-8e1b-79b0512350fb None admin] PATH_INFO: `/v3/users/36b13e8de0544768a78e602ae5bbdf90` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:58.777320 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad8250a-d224-4272-8e1b-79b0512350fb None admin] RBAC: Authorizing `identity:get_user(user_id=36b13e8de0544768a78e602ae5bbdf90)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:58.778761 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad8250a-d224-4272-8e1b-79b0512350fb None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:58.780391 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 606/1197] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 2 15:17:58 2022] GET /identity/v3/users/36b13e8de0544768a78e602ae5bbdf90 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:17:58.786307 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f163a540-f616-4c6b-bfe0-4a456577c85d None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:58.885161 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f163a540-f616-4c6b-bfe0-4a456577c85d None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:58.918689 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aac4e4-7978-4f25-909b-6ccdb6970811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:58.919323 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aac4e4-7978-4f25-909b-6ccdb6970811 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:58.919607 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aac4e4-7978-4f25-909b-6ccdb6970811 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:58.919882 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aac4e4-7978-4f25-909b-6ccdb6970811 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:58.973247 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:58.985635 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aac4e4-7978-4f25-909b-6ccdb6970811 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:58.987062 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aac4e4-7978-4f25-909b-6ccdb6970811 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:59.081759 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 592/1198] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 2 15:17:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 15:17:59.087812 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad8250a-d224-4272-8e1b-79b0512350fb None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:59.186539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad8250a-d224-4272-8e1b-79b0512350fb None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:59.219820 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6421e481-1bcb-4ac6-bb23-4cab7962c7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:59.220550 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421e481-1bcb-4ac6-bb23-4cab7962c7d9 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:59.220836 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421e481-1bcb-4ac6-bb23-4cab7962c7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:59.221116 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421e481-1bcb-4ac6-bb23-4cab7962c7d9 None admin] PATH_INFO: `/v3/projects/a61c7a0145bf41d6812db52b0d1da254` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:59.222264 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6421e481-1bcb-4ac6-bb23-4cab7962c7d9 None admin] RBAC: Authorizing `identity:get_project(project_id=a61c7a0145bf41d6812db52b0d1da254)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:59.223743 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6421e481-1bcb-4ac6-bb23-4cab7962c7d9 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:59.225416 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 607/1199] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 2 15:17:59 2022] GET /identity/v3/projects/a61c7a0145bf41d6812db52b0d1da254 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:17:59.231794 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aac4e4-7978-4f25-909b-6ccdb6970811 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:17:59.316859 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:17:59.328867 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aac4e4-7978-4f25-909b-6ccdb6970811 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:17:59.361774 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c005b9-e227-4f82-81f0-7e6c0a45a3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:17:59.362381 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c005b9-e227-4f82-81f0-7e6c0a45a3ab None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:17:59.362662 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c005b9-e227-4f82-81f0-7e6c0a45a3ab None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:17:59.362939 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c005b9-e227-4f82-81f0-7e6c0a45a3ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:17:59.363739 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c005b9-e227-4f82-81f0-7e6c0a45a3ab None admin] RBAC: Adding query filter params (role.id=d75c9572cb294caeb8eb456521ff6f57, scope.project.id=a61c7a0145bf41d6812db52b0d1da254, user.id=36b13e8de0544768a78e602ae5bbdf90) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:17:59.364051 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c005b9-e227-4f82-81f0-7e6c0a45a3ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:17:59.365488 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c005b9-e227-4f82-81f0-7e6c0a45a3ab None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:17:59.371089 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 593/1200] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 2 15:17:59 2022] GET /identity/v3/role_assignments?user.id=36b13e8de0544768a78e602ae5bbdf90&scope.project.id=a61c7a0145bf41d6812db52b0d1da254&role.id=d75c9572cb294caeb8eb456521ff6f57 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:18:09.215680 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=90 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:18:09.368567 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=24 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:18:54.964657 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf333a5-0bb6-4f3c-8369-9bdca6e76847 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:18:54.965297 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf333a5-0bb6-4f3c-8369-9bdca6e76847 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:18:54.965297 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf333a5-0bb6-4f3c-8369-9bdca6e76847 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:18:54.966704 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 608/1201] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:18:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:18:54.973797 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317a197-4865-4f7a-b288-a7c8127586c8 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:18:54.974283 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317a197-4865-4f7a-b288-a7c8127586c8 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:18:54.974363 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317a197-4865-4f7a-b288-a7c8127586c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:18:54.996025 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-9317a197-4865-4f7a-b288-a7c8127586c8 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:18:54.997261 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-9317a197-4865-4f7a-b288-a7c8127586c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:18:55.110158 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 594/1202] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:18:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 15:18:55.138831 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf333a5-0bb6-4f3c-8369-9bdca6e76847 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:18:55.314084 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf333a5-0bb6-4f3c-8369-9bdca6e76847 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:18:55.360475 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85aa78b-4bfd-4c2b-a40c-95b98130b1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:18:55.361222 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85aa78b-4bfd-4c2b-a40c-95b98130b1e7 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:18:55.361529 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85aa78b-4bfd-4c2b-a40c-95b98130b1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:18:55.361833 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85aa78b-4bfd-4c2b-a40c-95b98130b1e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:18:55.377924 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85aa78b-4bfd-4c2b-a40c-95b98130b1e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:18:55.380049 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85aa78b-4bfd-4c2b-a40c-95b98130b1e7 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:18:55.400575 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-d85aa78b-4bfd-4c2b-a40c-95b98130b1e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:18:55.400575 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:18:55.400575 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:18:55.400575 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:18:55.400575 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:18:55.400575 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:18:55.400575 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:18:55.400575 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:18:55.400575 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:18:55.400575 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:18:55.400575 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:18:55.400575 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:18:55.400575 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:18:55.400575 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:18:55.400575 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:18:55.401718 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:18:55.401718 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:18:55.401718 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:18:55.401718 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:18:55.401718 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:18:55.401718 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:18:55.401718 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:18:55.401718 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:18:55.401718 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:18:55.401718 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:18:55.401718 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:18:55.401718 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:18:55.401718 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:18:55.401718 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:18:55.401718 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:18:55.401718 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:18:55.401718 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:18:55.408318 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:18:55.408318 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:18:55.408318 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:18:55.408318 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:18:55.408318 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 609/1203] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:18:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:18:55.408635 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9317a197-4865-4f7a-b288-a7c8127586c8 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:18:55.549429 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9317a197-4865-4f7a-b288-a7c8127586c8 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:18:55.585676 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:18:55.599175 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593f12b6-59f2-40f5-a3dc-2ae074016bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:18:55.599842 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f12b6-59f2-40f5-a3dc-2ae074016bd1 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:18:55.600129 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f12b6-59f2-40f5-a3dc-2ae074016bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:18:55.600408 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f12b6-59f2-40f5-a3dc-2ae074016bd1 None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:18:55.601115 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593f12b6-59f2-40f5-a3dc-2ae074016bd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:18:55.601426 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593f12b6-59f2-40f5-a3dc-2ae074016bd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:18:55.602802 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593f12b6-59f2-40f5-a3dc-2ae074016bd1 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:18:55.621414 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 595/1204] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:18:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:18:55.627546 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85aa78b-4bfd-4c2b-a40c-95b98130b1e7 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:18:55.698111 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:18:55.761649 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85aa78b-4bfd-4c2b-a40c-95b98130b1e7 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:18:55.806428 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d642631c-2b41-41cf-806f-238925607e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:18:55.807270 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d642631c-2b41-41cf-806f-238925607e13 None admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:18:55.807557 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d642631c-2b41-41cf-806f-238925607e13 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:18:55.807865 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d642631c-2b41-41cf-806f-238925607e13 None admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:18:55.808628 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d642631c-2b41-41cf-806f-238925607e13 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:18:55.810197 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d642631c-2b41-41cf-806f-238925607e13 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:18:55.839409 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 610/1205] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Aug 2 15:18:55 2022] POST /identity/v3/users => generated 251 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:18:58.340809 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477c227-c4c1-433a-85e9-15ff2ec524fa None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:18:58.341399 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477c227-c4c1-433a-85e9-15ff2ec524fa None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:18:58.341399 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477c227-c4c1-433a-85e9-15ff2ec524fa None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:18:58.342884 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 596/1206] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:18:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 15:18:58.350305 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98fccce-f3e8-4e84-8ae8-29372aa8038c None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:18:58.350817 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98fccce-f3e8-4e84-8ae8-29372aa8038c None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:18:58.351085 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98fccce-f3e8-4e84-8ae8-29372aa8038c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:18:58.372552 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-c98fccce-f3e8-4e84-8ae8-29372aa8038c None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:18:58.373909 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-c98fccce-f3e8-4e84-8ae8-29372aa8038c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:18:58.467441 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 611/1207] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:18:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 15:18:58.485753 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477c227-c4c1-433a-85e9-15ff2ec524fa None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:18:58.614002 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477c227-c4c1-433a-85e9-15ff2ec524fa None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:18:58.661440 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc00cd-959b-404f-98f8-5280a06b04cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:18:58.662196 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc00cd-959b-404f-98f8-5280a06b04cb None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:18:58.662464 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc00cd-959b-404f-98f8-5280a06b04cb None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:18:58.662778 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc00cd-959b-404f-98f8-5280a06b04cb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:18:58.680439 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dc00cd-959b-404f-98f8-5280a06b04cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:18:58.685601 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-f4dc00cd-959b-404f-98f8-5280a06b04cb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 15:18:58.685601 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:18:58.685601 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:18:58.685601 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:18:58.685601 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:18:58.685601 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:18:58.685601 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:18:58.685601 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:18:58.685601 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:18:58.685601 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:18:58.685601 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:18:58.685601 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:18:58.685601 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:18:58.685601 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:18:58.685601 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:18:58.685601 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:18:58.686777 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:18:58.686777 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:18:58.686777 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:18:58.686777 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:18:58.686777 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:18:58.686777 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:18:58.686777 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:18:58.686777 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:18:58.686777 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:18:58.686777 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:18:58.686777 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:18:58.686777 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:18:58.686777 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:18:58.686777 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:18:58.686777 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:18:58.686777 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:18:58.687697 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:18:58.687697 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:18:58.687697 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:18:58.687697 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:18:58.687697 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:18:58.687697 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:18:58.687697 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:18:58.687697 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:18:58.687697 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:18:58.687697 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:18:58.687697 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 15:18:58.687697 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:18:58.687697 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 597/1208] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 2 15:18:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:18:58.695114 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98fccce-f3e8-4e84-8ae8-29372aa8038c None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:18:58.744181 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:18:58.831331 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98fccce-f3e8-4e84-8ae8-29372aa8038c None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:18:58.882174 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4bc916-5a3e-481a-ba52-6a00e16afd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:18:58.883180 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4bc916-5a3e-481a-ba52-6a00e16afd59 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:18:58.883537 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4bc916-5a3e-481a-ba52-6a00e16afd59 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:18:58.883853 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4bc916-5a3e-481a-ba52-6a00e16afd59 None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:18:58.884630 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4bc916-5a3e-481a-ba52-6a00e16afd59 None admin] RBAC: Adding query filter params (name=service) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:18:58.885068 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4bc916-5a3e-481a-ba52-6a00e16afd59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:18:58.886772 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4bc916-5a3e-481a-ba52-6a00e16afd59 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:18:58.899161 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 612/1209] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Aug 2 15:18:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:18:58.907144 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc00cd-959b-404f-98f8-5280a06b04cb None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:18:58.972434 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:18:59.037199 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc00cd-959b-404f-98f8-5280a06b04cb None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:18:59.080753 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fa33dc-8fc2-461f-98d1-28e2ef7ce66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:18:59.081578 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa33dc-8fc2-461f-98d1-28e2ef7ce66c None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:18:59.081988 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa33dc-8fc2-461f-98d1-28e2ef7ce66c None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:18:59.082389 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa33dc-8fc2-461f-98d1-28e2ef7ce66c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:18:59.099400 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fa33dc-8fc2-461f-98d1-28e2ef7ce66c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:18:59.100891 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fa33dc-8fc2-461f-98d1-28e2ef7ce66c None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:18:59.119656 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-01fa33dc-8fc2-461f-98d1-28e2ef7ce66c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:18:59.119656 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:18:59.119656 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:18:59.119656 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:18:59.119656 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:18:59.119656 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:18:59.119656 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:18:59.119656 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:18:59.119656 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:18:59.119656 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:18:59.119656 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:18:59.119656 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:18:59.119656 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:18:59.119656 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:18:59.119656 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:18:59.121157 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:18:59.121157 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:18:59.121157 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:18:59.121157 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:18:59.121157 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:18:59.121157 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:18:59.121157 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:18:59.121157 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:18:59.121157 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:18:59.121157 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:18:59.121157 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:18:59.121157 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:18:59.121157 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:18:59.121157 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:18:59.121157 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:18:59.121157 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:18:59.121157 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:18:59.122957 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:18:59.122957 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:18:59.122957 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:18:59.122957 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:18:59.122957 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 598/1210] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:18:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 15:18:59.129879 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4bc916-5a3e-481a-ba52-6a00e16afd59 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:18:59.278571 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:18:59.282738 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4bc916-5a3e-481a-ba52-6a00e16afd59 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:18:59.323174 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55741be7-785e-4f01-9c60-e7c191a875c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:18:59.323753 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55741be7-785e-4f01-9c60-e7c191a875c5 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:18:59.324038 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55741be7-785e-4f01-9c60-e7c191a875c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:18:59.324318 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55741be7-785e-4f01-9c60-e7c191a875c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:18:59.325176 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55741be7-785e-4f01-9c60-e7c191a875c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:18:59.325514 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55741be7-785e-4f01-9c60-e7c191a875c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:18:59.326975 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55741be7-785e-4f01-9c60-e7c191a875c5 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:18:59.346173 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 613/1211] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:18:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:18:59.348577 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fa33dc-8fc2-461f-98d1-28e2ef7ce66c None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:18:59.473821 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fa33dc-8fc2-461f-98d1-28e2ef7ce66c None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:18:59.475904 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:18:59.522206 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558fe81a-73f1-432a-80ef-00e620805009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:18:59.522974 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558fe81a-73f1-432a-80ef-00e620805009 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:18:59.523413 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558fe81a-73f1-432a-80ef-00e620805009 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:18:59.523695 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558fe81a-73f1-432a-80ef-00e620805009 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:18:59.533980 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558fe81a-73f1-432a-80ef-00e620805009 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:18:59.535888 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558fe81a-73f1-432a-80ef-00e620805009 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:18:59.556907 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-558fe81a-73f1-432a-80ef-00e620805009 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 02 15:18:59.556907 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:18:59.556907 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:18:59.556907 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:18:59.556907 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:18:59.556907 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:18:59.556907 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:18:59.556907 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:18:59.556907 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:18:59.556907 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:18:59.556907 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:18:59.556907 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:18:59.556907 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 15:18:59.556907 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 15:18:59.556907 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 15:18:59.556907 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 15:18:59.558172 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:18:59.558172 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:18:59.558172 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 15:18:59.558172 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:18:59.558172 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 15:18:59.558172 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:18:59.558172 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:18:59.558172 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:18:59.558172 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:18:59.558172 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:18:59.558172 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:18:59.558172 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:18:59.558172 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:18:59.558172 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:18:59.558172 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:18:59.558172 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:18:59.558172 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:18:59.558172 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:18:59.559478 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:18:59.559478 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:18:59.559478 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 15:18:59.559478 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 15:18:59.559478 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 15:18:59.559478 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 15:18:59.559478 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 15:18:59.559478 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 15:18:59.559478 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 02 15:18:59.559478 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:18:59.559478 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 599/1212] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:18:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:18:59.567684 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55741be7-785e-4f01-9c60-e7c191a875c5 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:18:59.698704 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55741be7-785e-4f01-9c60-e7c191a875c5 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:18:59.740788 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302f52b1-495a-419a-bf0e-1c9649a31f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:18:59.741920 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f52b1-495a-419a-bf0e-1c9649a31f8b None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:18:59.742313 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f52b1-495a-419a-bf0e-1c9649a31f8b None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:18:59.742818 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f52b1-495a-419a-bf0e-1c9649a31f8b None admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:18:59.744087 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302f52b1-495a-419a-bf0e-1c9649a31f8b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:18:59.744458 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302f52b1-495a-419a-bf0e-1c9649a31f8b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:18:59.746358 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302f52b1-495a-419a-bf0e-1c9649a31f8b None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:18:59.772628 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 614/1213] 10.222.0.42 () {56 vars in 1143 bytes} [Tue Aug 2 15:18:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:18:59.778400 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558fe81a-73f1-432a-80ef-00e620805009 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:18:59.915642 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558fe81a-73f1-432a-80ef-00e620805009 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:18:59.955103 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea9753-071d-4068-aa3f-00a0876aff5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:18:59.955954 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea9753-071d-4068-aa3f-00a0876aff5f None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:18:59.956433 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea9753-071d-4068-aa3f-00a0876aff5f None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:18:59.956867 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea9753-071d-4068-aa3f-00a0876aff5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:18:59.995342 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:19:00.047316 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dea9753-071d-4068-aa3f-00a0876aff5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:00.048813 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dea9753-071d-4068-aa3f-00a0876aff5f None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:00.164388 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 600/1214] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 2 15:18:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 15:19:00.171090 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302f52b1-495a-419a-bf0e-1c9649a31f8b None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:00.192630 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:19:00.306118 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302f52b1-495a-419a-bf0e-1c9649a31f8b None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:00.348182 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279f0a3-0f51-4d46-a505-37ea5caa3504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:00.348182 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279f0a3-0f51-4d46-a505-37ea5caa3504 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:00.348564 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279f0a3-0f51-4d46-a505-37ea5caa3504 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:00.348671 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279f0a3-0f51-4d46-a505-37ea5caa3504 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:00.358820 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6279f0a3-0f51-4d46-a505-37ea5caa3504 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:00.360843 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6279f0a3-0f51-4d46-a505-37ea5caa3504 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:00.376474 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-6279f0a3-0f51-4d46-a505-37ea5caa3504 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:19:00.376474 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:19:00.376474 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:19:00.376474 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:19:00.376474 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:19:00.376474 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:19:00.376474 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:19:00.376474 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:19:00.376474 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:19:00.376474 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:19:00.376474 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:19:00.376474 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:19:00.376474 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:19:00.376474 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:19:00.376474 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:19:00.377607 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:19:00.377607 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:19:00.377607 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:19:00.377607 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:19:00.377607 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:19:00.377607 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:19:00.377607 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:19:00.377607 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:19:00.377607 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:19:00.377607 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:19:00.377607 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:19:00.377607 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:19:00.377607 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:19:00.377607 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:19:00.377607 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:19:00.377607 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:19:00.377607 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:19:00.378690 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:19:00.378690 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:19:00.378690 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:19:00.378690 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:19:00.378690 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 615/1215] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:19:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:19:00.383481 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea9753-071d-4068-aa3f-00a0876aff5f None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:00.447931 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:19:00.491335 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea9753-071d-4068-aa3f-00a0876aff5f None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:00.529016 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e689d66-31d8-4467-9e79-847fec4f6e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:00.529808 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e689d66-31d8-4467-9e79-847fec4f6e57 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:00.530181 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e689d66-31d8-4467-9e79-847fec4f6e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:00.530551 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e689d66-31d8-4467-9e79-847fec4f6e57 None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:00.531852 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e689d66-31d8-4467-9e79-847fec4f6e57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:19:00.532445 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e689d66-31d8-4467-9e79-847fec4f6e57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:00.534443 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e689d66-31d8-4467-9e79-847fec4f6e57 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:00.553729 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 601/1216] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:19:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:19:00.560391 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279f0a3-0f51-4d46-a505-37ea5caa3504 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:00.649988 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:19:00.694765 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279f0a3-0f51-4d46-a505-37ea5caa3504 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:00.737457 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54450ed1-6e39-466d-8edf-331dc16ffcdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:00.738153 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54450ed1-6e39-466d-8edf-331dc16ffcdf None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:00.738398 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54450ed1-6e39-466d-8edf-331dc16ffcdf None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:00.738669 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54450ed1-6e39-466d-8edf-331dc16ffcdf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:00.746412 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54450ed1-6e39-466d-8edf-331dc16ffcdf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:00.747925 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54450ed1-6e39-466d-8edf-331dc16ffcdf None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:00.759521 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-54450ed1-6e39-466d-8edf-331dc16ffcdf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:19:00.759521 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:19:00.759521 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:19:00.759521 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:19:00.759521 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:19:00.759521 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:19:00.759521 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:19:00.759521 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:19:00.759521 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:19:00.759521 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:19:00.759521 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:19:00.759521 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:19:00.759521 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 15:19:00.759521 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 15:19:00.759521 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 15:19:00.760490 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 15:19:00.760490 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:19:00.760490 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:19:00.760490 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:19:00.760490 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:19:00.760490 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:19:00.760490 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:19:00.760490 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:19:00.760490 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:19:00.760490 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:19:00.760490 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:19:00.760490 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:19:00.760490 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:19:00.760490 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:19:00.760490 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:19:00.760490 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:19:00.760490 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:19:00.761409 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 15:19:00.761409 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 15:19:00.761409 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 15:19:00.761409 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 15:19:00.761409 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 15:19:00.761409 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 15:19:00.761409 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:19:00.761409 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:19:00.763593 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 616/1217] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 2 15:19:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:19:00.767057 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e689d66-31d8-4467-9e79-847fec4f6e57 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:00.914576 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e689d66-31d8-4467-9e79-847fec4f6e57 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:00.940784 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:19:00.957748 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af174ebb-249d-4898-9cd6-9ad0b977d787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:00.958448 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af174ebb-249d-4898-9cd6-9ad0b977d787 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:00.958803 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af174ebb-249d-4898-9cd6-9ad0b977d787 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:00.959083 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af174ebb-249d-4898-9cd6-9ad0b977d787 None admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:00.960337 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af174ebb-249d-4898-9cd6-9ad0b977d787 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:19:00.960649 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af174ebb-249d-4898-9cd6-9ad0b977d787 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:00.962092 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af174ebb-249d-4898-9cd6-9ad0b977d787 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:00.976575 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 602/1218] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 2 15:19:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:19:00.982866 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54450ed1-6e39-466d-8edf-331dc16ffcdf None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:01.103759 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54450ed1-6e39-466d-8edf-331dc16ffcdf None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:01.134370 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:19:01.141343 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d2e676-f875-48d9-bc01-be083230a625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:01.141961 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d2e676-f875-48d9-bc01-be083230a625 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:01.142248 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d2e676-f875-48d9-bc01-be083230a625 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:01.142525 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d2e676-f875-48d9-bc01-be083230a625 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:01.143387 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d2e676-f875-48d9-bc01-be083230a625 None admin] RBAC: Adding query filter params (role.id=532162a00de849cea5c27767c8acd018, scope.project.id=cc19d22b4cd64dd1bc89ed78155d2732, user.id=57dfafee636a45ca98fe0e8bb13dd754) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:19:01.146229 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d2e676-f875-48d9-bc01-be083230a625 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:01.147728 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d2e676-f875-48d9-bc01-be083230a625 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:01.154258 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 617/1219] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 2 15:19:00 2022] GET /identity/v3/role_assignments?user.id=57dfafee636a45ca98fe0e8bb13dd754&scope.project.id=cc19d22b4cd64dd1bc89ed78155d2732&role.id=532162a00de849cea5c27767c8acd018 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:19:03.177266 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331139a-a8be-495f-858a-95f99f92e2c8 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:03.177872 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331139a-a8be-495f-858a-95f99f92e2c8 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:03.177872 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331139a-a8be-495f-858a-95f99f92e2c8 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:03.183247 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 603/1220] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:19:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:19:03.185529 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98966951-797d-4f73-ab9f-4f86b9efc1f1 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:03.186022 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98966951-797d-4f73-ab9f-4f86b9efc1f1 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:03.186123 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98966951-797d-4f73-ab9f-4f86b9efc1f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:03.205298 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-98966951-797d-4f73-ab9f-4f86b9efc1f1 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:19:03.206876 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-98966951-797d-4f73-ab9f-4f86b9efc1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:19:03.282231 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 618/1221] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:19:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 15:19:03.308226 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1331139a-a8be-495f-858a-95f99f92e2c8 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:03.417555 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1331139a-a8be-495f-858a-95f99f92e2c8 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:03.454256 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04805e78-04f6-4474-861e-442808ac0a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:03.454888 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04805e78-04f6-4474-861e-442808ac0a5f None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:03.455170 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04805e78-04f6-4474-861e-442808ac0a5f None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:03.455477 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04805e78-04f6-4474-861e-442808ac0a5f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:03.465701 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04805e78-04f6-4474-861e-442808ac0a5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:19:03.471557 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-04805e78-04f6-4474-861e-442808ac0a5f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 15:19:03.471557 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:19:03.471557 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:19:03.471557 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:19:03.471557 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:19:03.471557 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:19:03.471557 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:19:03.471557 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:19:03.471557 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:19:03.471557 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:19:03.471557 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:19:03.471557 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:19:03.471557 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:19:03.471557 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:19:03.471557 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:19:03.471557 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:19:03.472769 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:19:03.472769 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:19:03.472769 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:19:03.472769 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:19:03.472769 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:19:03.472769 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:19:03.472769 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:19:03.472769 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:19:03.472769 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:19:03.472769 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:19:03.472769 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:19:03.472769 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:19:03.472769 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:19:03.472769 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:19:03.472769 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:19:03.472769 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:19:03.473604 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:19:03.473604 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:19:03.473604 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:19:03.473604 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:19:03.473604 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:19:03.473604 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:19:03.473604 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:19:03.473604 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:19:03.473604 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:19:03.473604 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:19:03.473604 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 15:19:03.473604 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:19:03.473604 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 604/1222] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 2 15:19:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:19:03.479375 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98966951-797d-4f73-ab9f-4f86b9efc1f1 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:03.592998 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98966951-797d-4f73-ab9f-4f86b9efc1f1 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:03.619472 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:19:03.632545 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d44464-909e-4b14-a0f3-280d12b6d132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:03.633234 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d44464-909e-4b14-a0f3-280d12b6d132 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:03.633552 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d44464-909e-4b14-a0f3-280d12b6d132 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:03.633857 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d44464-909e-4b14-a0f3-280d12b6d132 None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:03.634681 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d44464-909e-4b14-a0f3-280d12b6d132 None admin] RBAC: Adding query filter params (name=service) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:19:03.635071 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d44464-909e-4b14-a0f3-280d12b6d132 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:03.636674 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d44464-909e-4b14-a0f3-280d12b6d132 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:03.647279 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 619/1223] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Aug 2 15:19:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:19:03.653350 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04805e78-04f6-4474-861e-442808ac0a5f None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:03.703971 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:19:03.771874 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04805e78-04f6-4474-861e-442808ac0a5f None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:03.810597 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc87ce56-153b-4848-a6e8-75239b022f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:03.811432 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87ce56-153b-4848-a6e8-75239b022f32 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:03.811617 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87ce56-153b-4848-a6e8-75239b022f32 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:03.811902 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87ce56-153b-4848-a6e8-75239b022f32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:03.828877 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc87ce56-153b-4848-a6e8-75239b022f32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:03.830653 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc87ce56-153b-4848-a6e8-75239b022f32 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:03.849114 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-fc87ce56-153b-4848-a6e8-75239b022f32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:19:03.849114 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:19:03.849114 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:19:03.849114 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:19:03.849114 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:19:03.849114 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:19:03.849114 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:19:03.849114 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:19:03.849114 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:19:03.849114 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:19:03.849114 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:19:03.849114 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:19:03.849114 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:19:03.849114 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:19:03.849114 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:19:03.850344 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:19:03.850344 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:19:03.850344 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:19:03.850344 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:19:03.850344 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:19:03.850344 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:19:03.850344 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:19:03.850344 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:19:03.850344 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:19:03.850344 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:19:03.850344 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:19:03.850344 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:19:03.850344 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:19:03.850344 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:19:03.850344 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:19:03.850344 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:19:03.850344 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:19:03.851300 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:19:03.851300 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:19:03.851300 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:19:03.851300 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:19:03.851300 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 605/1224] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:19:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:19:03.856648 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d44464-909e-4b14-a0f3-280d12b6d132 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:03.975611 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d44464-909e-4b14-a0f3-280d12b6d132 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:04.014192 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50836352-68b5-41d5-8c45-41f88899baf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:04.014775 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50836352-68b5-41d5-8c45-41f88899baf3 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:04.015801 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50836352-68b5-41d5-8c45-41f88899baf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:04.016012 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50836352-68b5-41d5-8c45-41f88899baf3 None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:04.016740 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50836352-68b5-41d5-8c45-41f88899baf3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:19:04.017056 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50836352-68b5-41d5-8c45-41f88899baf3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:04.018654 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50836352-68b5-41d5-8c45-41f88899baf3 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:04.032364 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 620/1225] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:19:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:19:04.038139 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc87ce56-153b-4848-a6e8-75239b022f32 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:04.148349 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:19:04.156738 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc87ce56-153b-4848-a6e8-75239b022f32 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:04.197672 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aadb2a4-064c-47e8-93d4-4a4a6adcf905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:04.198437 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aadb2a4-064c-47e8-93d4-4a4a6adcf905 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:04.198738 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aadb2a4-064c-47e8-93d4-4a4a6adcf905 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:04.199019 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aadb2a4-064c-47e8-93d4-4a4a6adcf905 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:04.208424 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aadb2a4-064c-47e8-93d4-4a4a6adcf905 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:04.210144 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aadb2a4-064c-47e8-93d4-4a4a6adcf905 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:04.222606 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-5aadb2a4-064c-47e8-93d4-4a4a6adcf905 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 02 15:19:04.222606 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:19:04.222606 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:19:04.222606 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:19:04.222606 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:19:04.222606 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:19:04.222606 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:19:04.222606 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:19:04.222606 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:19:04.222606 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:19:04.222606 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:19:04.222606 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:19:04.222606 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 15:19:04.222606 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 15:19:04.222606 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 15:19:04.222606 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 15:19:04.227332 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:19:04.227332 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:19:04.227332 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 15:19:04.227332 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:19:04.227332 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 15:19:04.227332 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:19:04.227332 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:19:04.227332 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:19:04.227332 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:19:04.227332 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:19:04.227332 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:19:04.227332 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:19:04.227332 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:19:04.227332 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:19:04.227332 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:19:04.227332 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:19:04.227332 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:19:04.227332 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:19:04.228618 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:19:04.228618 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:19:04.228618 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 15:19:04.228618 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 15:19:04.228618 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 15:19:04.228618 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 15:19:04.228618 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 15:19:04.228618 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 15:19:04.228618 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 02 15:19:04.228618 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:19:04.228618 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 606/1226] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:19:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 15:19:04.232129 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50836352-68b5-41d5-8c45-41f88899baf3 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:04.285759 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:19:04.347336 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50836352-68b5-41d5-8c45-41f88899baf3 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:04.384875 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740ef84-58c1-4284-bcfc-69ff1c4bd262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:04.385568 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740ef84-58c1-4284-bcfc-69ff1c4bd262 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:04.385898 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740ef84-58c1-4284-bcfc-69ff1c4bd262 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:04.386207 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740ef84-58c1-4284-bcfc-69ff1c4bd262 None admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:04.387130 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4740ef84-58c1-4284-bcfc-69ff1c4bd262 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:19:04.387517 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4740ef84-58c1-4284-bcfc-69ff1c4bd262 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:04.389089 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4740ef84-58c1-4284-bcfc-69ff1c4bd262 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:04.408964 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 621/1227] 10.222.0.42 () {56 vars in 1143 bytes} [Tue Aug 2 15:19:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:19:04.415042 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aadb2a4-064c-47e8-93d4-4a4a6adcf905 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:04.523149 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aadb2a4-064c-47e8-93d4-4a4a6adcf905 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:04.562695 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f79d46-f552-4761-aefd-a59852b41107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:04.563446 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f79d46-f552-4761-aefd-a59852b41107 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:04.563869 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f79d46-f552-4761-aefd-a59852b41107 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:04.564274 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f79d46-f552-4761-aefd-a59852b41107 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:04.577271 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f79d46-f552-4761-aefd-a59852b41107 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:04.578826 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f79d46-f552-4761-aefd-a59852b41107 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:04.594951 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-60f79d46-f552-4761-aefd-a59852b41107 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:19:04.594951 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:19:04.594951 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:19:04.594951 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:19:04.594951 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:19:04.594951 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:19:04.594951 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:19:04.594951 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:19:04.594951 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:19:04.594951 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:19:04.594951 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:19:04.594951 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:19:04.594951 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:19:04.594951 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:19:04.594951 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:19:04.596623 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:19:04.596623 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:19:04.596623 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:19:04.596623 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:19:04.596623 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:19:04.596623 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:19:04.596623 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:19:04.596623 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:19:04.596623 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:19:04.596623 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:19:04.596623 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:19:04.596623 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:19:04.596623 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:19:04.596623 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:19:04.596623 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:19:04.596623 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:19:04.596623 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:19:04.597717 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:19:04.597717 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:19:04.597717 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:19:04.597717 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:19:04.597717 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 607/1228] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:19:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:19:04.602218 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740ef84-58c1-4284-bcfc-69ff1c4bd262 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:04.713086 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740ef84-58c1-4284-bcfc-69ff1c4bd262 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:04.715507 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:19:04.749743 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f08338-2302-4126-96a0-0e04d648462a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:04.751795 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f08338-2302-4126-96a0-0e04d648462a None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:04.752092 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f08338-2302-4126-96a0-0e04d648462a None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:04.752386 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f08338-2302-4126-96a0-0e04d648462a None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:04.753045 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f08338-2302-4126-96a0-0e04d648462a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:19:04.753351 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f08338-2302-4126-96a0-0e04d648462a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:04.754740 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f08338-2302-4126-96a0-0e04d648462a None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:04.769577 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 622/1229] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:19:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:19:04.775426 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f79d46-f552-4761-aefd-a59852b41107 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:04.785475 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:19:04.888266 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f79d46-f552-4761-aefd-a59852b41107 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:04.931956 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532140f3-0c71-419c-af57-b45f8ce4d10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:04.932622 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532140f3-0c71-419c-af57-b45f8ce4d10b None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:04.932907 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532140f3-0c71-419c-af57-b45f8ce4d10b None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:04.933184 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532140f3-0c71-419c-af57-b45f8ce4d10b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:04.941244 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532140f3-0c71-419c-af57-b45f8ce4d10b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:04.942893 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532140f3-0c71-419c-af57-b45f8ce4d10b None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:04.956911 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-532140f3-0c71-419c-af57-b45f8ce4d10b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:19:04.956911 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:19:04.956911 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:19:04.956911 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:19:04.956911 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:19:04.956911 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:19:04.956911 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:19:04.956911 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:19:04.956911 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:19:04.956911 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:19:04.956911 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:19:04.956911 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:19:04.956911 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 15:19:04.956911 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 15:19:04.956911 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 15:19:04.958078 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 15:19:04.958078 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:19:04.958078 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:19:04.958078 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:19:04.958078 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:19:04.958078 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:19:04.958078 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:19:04.958078 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:19:04.958078 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:19:04.958078 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:19:04.958078 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:19:04.958078 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:19:04.958078 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:19:04.958078 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:19:04.958078 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:19:04.958078 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:19:04.958078 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:19:04.959536 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 15:19:04.959536 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 15:19:04.959536 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 15:19:04.959536 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 15:19:04.959536 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 15:19:04.959536 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 15:19:04.959536 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:19:04.959536 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:19:04.959536 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 608/1230] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 2 15:19:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:19:04.964768 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f08338-2302-4126-96a0-0e04d648462a None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:05.082171 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f08338-2302-4126-96a0-0e04d648462a None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:05.116338 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d15ae9-bc0a-46b8-8eda-9f3bf3e3291a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:05.116958 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d15ae9-bc0a-46b8-8eda-9f3bf3e3291a None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:05.117282 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d15ae9-bc0a-46b8-8eda-9f3bf3e3291a None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:05.117521 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d15ae9-bc0a-46b8-8eda-9f3bf3e3291a None admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:05.118267 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d15ae9-bc0a-46b8-8eda-9f3bf3e3291a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:19:05.118567 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d15ae9-bc0a-46b8-8eda-9f3bf3e3291a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:05.120046 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d15ae9-bc0a-46b8-8eda-9f3bf3e3291a None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:05.134467 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 623/1231] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 2 15:19:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:19:05.141290 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532140f3-0c71-419c-af57-b45f8ce4d10b None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:05.217490 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:19:05.266285 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532140f3-0c71-419c-af57-b45f8ce4d10b None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:05.303596 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aed455f-5ef4-4493-b4b0-6272e31e0595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:05.304279 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed455f-5ef4-4493-b4b0-6272e31e0595 None admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:05.304569 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed455f-5ef4-4493-b4b0-6272e31e0595 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:05.304915 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed455f-5ef4-4493-b4b0-6272e31e0595 None admin] PATH_INFO: `/v3/projects/cc19d22b4cd64dd1bc89ed78155d2732/users/57dfafee636a45ca98fe0e8bb13dd754/roles/532162a00de849cea5c27767c8acd018` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:05.322734 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aed455f-5ef4-4493-b4b0-6272e31e0595 None admin] RBAC: Authorizing `identity:create_grant(project_id=cc19d22b4cd64dd1bc89ed78155d2732, user_id=57dfafee636a45ca98fe0e8bb13dd754, role_id=532162a00de849cea5c27767c8acd018)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:05.324459 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aed455f-5ef4-4493-b4b0-6272e31e0595 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:05.341169 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 609/1232] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 2 15:19:05 2022] PUT /identity/v3/projects/cc19d22b4cd64dd1bc89ed78155d2732/users/57dfafee636a45ca98fe0e8bb13dd754/roles/532162a00de849cea5c27767c8acd018 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:19:07.365164 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088125b7-ef1b-4fea-9032-653aed463d18 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:07.365715 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088125b7-ef1b-4fea-9032-653aed463d18 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:07.365715 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088125b7-ef1b-4fea-9032-653aed463d18 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:07.367077 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 624/1233] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:19:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:19:07.372299 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6361f-d101-4191-b582-95871de10b77 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:07.372764 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6361f-d101-4191-b582-95871de10b77 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:07.372874 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6361f-d101-4191-b582-95871de10b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:07.394204 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-95f6361f-d101-4191-b582-95871de10b77 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:19:07.395702 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-95f6361f-d101-4191-b582-95871de10b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:19:07.467193 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 610/1234] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:19:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 15:19:07.490303 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088125b7-ef1b-4fea-9032-653aed463d18 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:07.517149 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:19:07.606131 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088125b7-ef1b-4fea-9032-653aed463d18 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:07.650403 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a4658f-ad7c-4817-a22b-040344fb718f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:07.651068 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4658f-ad7c-4817-a22b-040344fb718f None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:07.651372 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4658f-ad7c-4817-a22b-040344fb718f None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:07.651653 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4658f-ad7c-4817-a22b-040344fb718f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:07.667489 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a4658f-ad7c-4817-a22b-040344fb718f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:19:07.673469 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-66a4658f-ad7c-4817-a22b-040344fb718f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 15:19:07.673469 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:19:07.673469 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:19:07.673469 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:19:07.673469 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:19:07.673469 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:19:07.673469 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:19:07.673469 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:19:07.673469 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:19:07.673469 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:19:07.673469 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:19:07.673469 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:19:07.673469 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:19:07.673469 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:19:07.673469 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:19:07.673469 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:19:07.675355 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:19:07.675355 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:19:07.675355 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:19:07.675355 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:19:07.675355 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:19:07.675355 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:19:07.675355 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:19:07.675355 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:19:07.675355 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:19:07.675355 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:19:07.675355 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:19:07.675355 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:19:07.675355 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:19:07.675355 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:19:07.675355 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:19:07.675355 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:19:07.676208 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:19:07.676208 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:19:07.676208 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:19:07.676208 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:19:07.676208 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:19:07.676208 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:19:07.676208 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:19:07.676208 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:19:07.676208 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:19:07.676208 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:19:07.676208 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 15:19:07.676208 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:19:07.676208 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 625/1235] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 2 15:19:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 15:19:07.682319 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f6361f-d101-4191-b582-95871de10b77 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:07.735145 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:19:07.795097 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f6361f-d101-4191-b582-95871de10b77 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:07.837085 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b193e1-6577-4938-bf9c-4d91b3c77d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:07.837791 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b193e1-6577-4938-bf9c-4d91b3c77d13 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:07.838122 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b193e1-6577-4938-bf9c-4d91b3c77d13 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:07.838431 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b193e1-6577-4938-bf9c-4d91b3c77d13 None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:07.839170 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b193e1-6577-4938-bf9c-4d91b3c77d13 None admin] RBAC: Adding query filter params (name=service) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:19:07.839509 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b193e1-6577-4938-bf9c-4d91b3c77d13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:07.840895 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b193e1-6577-4938-bf9c-4d91b3c77d13 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:07.852543 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 611/1236] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Aug 2 15:19:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:19:07.859746 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a4658f-ad7c-4817-a22b-040344fb718f None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:07.962102 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:19:07.981129 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a4658f-ad7c-4817-a22b-040344fb718f None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:08.024355 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b2455-a3c2-4ec5-bcfa-98412be48409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:08.024961 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b2455-a3c2-4ec5-bcfa-98412be48409 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:08.025244 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b2455-a3c2-4ec5-bcfa-98412be48409 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:08.025519 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b2455-a3c2-4ec5-bcfa-98412be48409 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:08.037766 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3b2455-a3c2-4ec5-bcfa-98412be48409 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:08.039443 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3b2455-a3c2-4ec5-bcfa-98412be48409 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:08.056569 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-4a3b2455-a3c2-4ec5-bcfa-98412be48409 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:19:08.056569 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:19:08.056569 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:19:08.056569 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:19:08.056569 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:19:08.056569 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:19:08.056569 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:19:08.056569 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:19:08.056569 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:19:08.056569 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:19:08.056569 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:19:08.056569 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:19:08.056569 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:19:08.056569 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:19:08.056569 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:19:08.057655 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:19:08.057655 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:19:08.057655 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:19:08.057655 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:19:08.057655 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:19:08.057655 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:19:08.057655 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:19:08.057655 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:19:08.057655 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:19:08.057655 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:19:08.057655 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:19:08.057655 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:19:08.057655 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:19:08.057655 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:19:08.057655 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:19:08.057655 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:19:08.057655 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:19:08.058876 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:19:08.058876 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:19:08.058876 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:19:08.058876 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:19:08.058876 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 626/1237] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:19:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:19:08.064429 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b193e1-6577-4938-bf9c-4d91b3c77d13 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:08.194950 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b193e1-6577-4938-bf9c-4d91b3c77d13 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:08.205796 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:19:08.236941 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e6692f-dca4-4d2e-a8b5-060cbfea41a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:08.237619 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6692f-dca4-4d2e-a8b5-060cbfea41a0 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:08.237940 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6692f-dca4-4d2e-a8b5-060cbfea41a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:08.238237 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6692f-dca4-4d2e-a8b5-060cbfea41a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:08.238991 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e6692f-dca4-4d2e-a8b5-060cbfea41a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:19:08.239350 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e6692f-dca4-4d2e-a8b5-060cbfea41a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:08.240811 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e6692f-dca4-4d2e-a8b5-060cbfea41a0 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:08.254449 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 612/1238] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:19:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:19:08.260578 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b2455-a3c2-4ec5-bcfa-98412be48409 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:08.380682 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b2455-a3c2-4ec5-bcfa-98412be48409 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:08.417766 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbd7394-179c-42b4-a6fc-b82d0838ca67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:08.418408 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd7394-179c-42b4-a6fc-b82d0838ca67 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:08.418693 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd7394-179c-42b4-a6fc-b82d0838ca67 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:08.418970 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd7394-179c-42b4-a6fc-b82d0838ca67 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:08.422380 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:19:08.427879 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbd7394-179c-42b4-a6fc-b82d0838ca67 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:08.429610 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbd7394-179c-42b4-a6fc-b82d0838ca67 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:08.443146 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-fcbd7394-179c-42b4-a6fc-b82d0838ca67 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 02 15:19:08.443146 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:19:08.443146 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:19:08.443146 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:19:08.443146 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:19:08.443146 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:19:08.443146 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:19:08.443146 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:19:08.443146 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:19:08.443146 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:19:08.443146 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:19:08.443146 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:19:08.443146 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 15:19:08.443146 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 15:19:08.443146 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 15:19:08.443146 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 15:19:08.444313 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:19:08.444313 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:19:08.444313 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 15:19:08.444313 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:19:08.444313 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 15:19:08.444313 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:19:08.444313 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:19:08.444313 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:19:08.444313 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:19:08.444313 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:19:08.444313 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:19:08.444313 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:19:08.444313 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:19:08.444313 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:19:08.444313 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:19:08.444313 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:19:08.444313 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:19:08.444313 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:19:08.445601 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:19:08.445601 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:19:08.445601 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 15:19:08.445601 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 15:19:08.445601 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 15:19:08.445601 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 15:19:08.445601 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 15:19:08.445601 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 15:19:08.445601 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 02 15:19:08.445601 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:19:08.445601 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 627/1239] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:19:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:19:08.450986 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e6692f-dca4-4d2e-a8b5-060cbfea41a0 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:08.564729 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e6692f-dca4-4d2e-a8b5-060cbfea41a0 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:08.607090 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447bc9de-f20d-40c6-b0bf-a72b9c43034b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:08.607779 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447bc9de-f20d-40c6-b0bf-a72b9c43034b None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:08.608049 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447bc9de-f20d-40c6-b0bf-a72b9c43034b None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:08.608336 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447bc9de-f20d-40c6-b0bf-a72b9c43034b None admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:08.609672 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447bc9de-f20d-40c6-b0bf-a72b9c43034b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:19:08.609982 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447bc9de-f20d-40c6-b0bf-a72b9c43034b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:08.611465 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447bc9de-f20d-40c6-b0bf-a72b9c43034b None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:08.637853 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 613/1240] 10.222.0.42 () {56 vars in 1143 bytes} [Tue Aug 2 15:19:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:19:08.638051 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbd7394-179c-42b4-a6fc-b82d0838ca67 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:08.754492 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbd7394-179c-42b4-a6fc-b82d0838ca67 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:08.794150 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0329e419-1324-416a-959e-c7a727805e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:08.794792 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329e419-1324-416a-959e-c7a727805e40 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:08.795101 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329e419-1324-416a-959e-c7a727805e40 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:08.795404 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329e419-1324-416a-959e-c7a727805e40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:08.872708 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:19:08.882178 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0329e419-1324-416a-959e-c7a727805e40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:08.883909 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0329e419-1324-416a-959e-c7a727805e40 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:09.014628 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 628/1241] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 2 15:19:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 15:19:09.020896 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447bc9de-f20d-40c6-b0bf-a72b9c43034b None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:09.051662 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:19:09.133551 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447bc9de-f20d-40c6-b0bf-a72b9c43034b None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:09.173498 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8fb24-04cc-44e2-ba1c-2f8a5c8910f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:09.174229 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8fb24-04cc-44e2-ba1c-2f8a5c8910f8 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:09.175134 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8fb24-04cc-44e2-ba1c-2f8a5c8910f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:09.175134 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8fb24-04cc-44e2-ba1c-2f8a5c8910f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:09.186674 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8fb24-04cc-44e2-ba1c-2f8a5c8910f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:09.188191 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8fb24-04cc-44e2-ba1c-2f8a5c8910f8 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:09.208249 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-b6b8fb24-04cc-44e2-ba1c-2f8a5c8910f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:19:09.208249 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:19:09.208249 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:19:09.208249 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:19:09.208249 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:19:09.208249 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:19:09.208249 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:19:09.208249 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:19:09.208249 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:19:09.208249 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:19:09.208249 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:19:09.208249 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:19:09.208249 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:19:09.208249 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:19:09.208249 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:19:09.209314 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:19:09.209314 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:19:09.209314 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:19:09.209314 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:19:09.209314 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:19:09.209314 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:19:09.209314 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:19:09.209314 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:19:09.209314 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:19:09.209314 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:19:09.209314 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:19:09.209314 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:19:09.209314 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:19:09.209314 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:19:09.209314 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:19:09.209314 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:19:09.209314 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:19:09.210954 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:19:09.210954 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:19:09.210954 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:19:09.210954 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:19:09.210954 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 614/1242] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:19:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:19:09.217429 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0329e419-1324-416a-959e-c7a727805e40 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:09.321552 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:19:09.328865 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0329e419-1324-416a-959e-c7a727805e40 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:09.371380 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22fd05d-b77c-4a69-9fe1-0b9c1ab5f0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:09.372986 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fd05d-b77c-4a69-9fe1-0b9c1ab5f0f7 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:09.372986 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fd05d-b77c-4a69-9fe1-0b9c1ab5f0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:09.372986 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fd05d-b77c-4a69-9fe1-0b9c1ab5f0f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:09.373260 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22fd05d-b77c-4a69-9fe1-0b9c1ab5f0f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:19:09.373476 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22fd05d-b77c-4a69-9fe1-0b9c1ab5f0f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:09.375281 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22fd05d-b77c-4a69-9fe1-0b9c1ab5f0f7 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:09.390650 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 629/1243] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:19:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:19:09.397057 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8fb24-04cc-44e2-ba1c-2f8a5c8910f8 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:09.509756 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:19:09.540445 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8fb24-04cc-44e2-ba1c-2f8a5c8910f8 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:09.584516 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc12d70-de17-41df-9c5e-b07068afc71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:09.585175 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc12d70-de17-41df-9c5e-b07068afc71b None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:09.585461 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc12d70-de17-41df-9c5e-b07068afc71b None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:09.585758 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc12d70-de17-41df-9c5e-b07068afc71b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:09.593414 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc12d70-de17-41df-9c5e-b07068afc71b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:09.595033 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc12d70-de17-41df-9c5e-b07068afc71b None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:09.607061 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-7fc12d70-de17-41df-9c5e-b07068afc71b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:19:09.607061 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:19:09.607061 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:19:09.607061 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:19:09.607061 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:19:09.607061 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:19:09.607061 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:19:09.607061 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:19:09.607061 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:19:09.607061 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:19:09.607061 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:19:09.607061 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:19:09.607061 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 15:19:09.607061 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 15:19:09.607061 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 15:19:09.608300 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 15:19:09.608300 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:19:09.608300 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:19:09.608300 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:19:09.608300 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:19:09.608300 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:19:09.608300 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:19:09.608300 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:19:09.608300 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:19:09.608300 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:19:09.608300 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:19:09.608300 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:19:09.608300 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:19:09.608300 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:19:09.608300 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:19:09.608300 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:19:09.608300 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:19:09.609248 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 15:19:09.609248 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 15:19:09.609248 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 15:19:09.609248 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 15:19:09.609248 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 15:19:09.609248 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 15:19:09.609248 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:19:09.609248 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:19:09.609248 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 615/1244] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 2 15:19:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 15:19:09.614782 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22fd05d-b77c-4a69-9fe1-0b9c1ab5f0f7 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:09.730008 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22fd05d-b77c-4a69-9fe1-0b9c1ab5f0f7 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:09.768429 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094dc87-7b38-4897-a227-d9f701ad3ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:09.769109 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094dc87-7b38-4897-a227-d9f701ad3ffe None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:09.769467 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094dc87-7b38-4897-a227-d9f701ad3ffe None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:09.774442 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094dc87-7b38-4897-a227-d9f701ad3ffe None admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:09.775318 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d094dc87-7b38-4897-a227-d9f701ad3ffe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:19:09.775638 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d094dc87-7b38-4897-a227-d9f701ad3ffe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:09.777093 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d094dc87-7b38-4897-a227-d9f701ad3ffe None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:09.790746 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 630/1245] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 2 15:19:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:19:09.798998 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc12d70-de17-41df-9c5e-b07068afc71b None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:09.923551 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc12d70-de17-41df-9c5e-b07068afc71b None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:09.962028 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ef96d-902e-4f54-a92a-9e149be53fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:09.962648 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ef96d-902e-4f54-a92a-9e149be53fcb None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:09.962925 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ef96d-902e-4f54-a92a-9e149be53fcb None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:09.963202 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ef96d-902e-4f54-a92a-9e149be53fcb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:09.964046 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7ef96d-902e-4f54-a92a-9e149be53fcb None admin] RBAC: Adding query filter params (role.id=532162a00de849cea5c27767c8acd018, scope.project.id=cc19d22b4cd64dd1bc89ed78155d2732, user.id=57dfafee636a45ca98fe0e8bb13dd754) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:19:09.964474 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7ef96d-902e-4f54-a92a-9e149be53fcb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:09.965910 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7ef96d-902e-4f54-a92a-9e149be53fcb None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:09.973091 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 616/1246] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 2 15:19:09 2022] GET /identity/v3/role_assignments?user.id=57dfafee636a45ca98fe0e8bb13dd754&scope.project.id=cc19d22b4cd64dd1bc89ed78155d2732&role.id=532162a00de849cea5c27767c8acd018 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:19:12.280612 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf301a6-e723-4f1e-931a-e8801103321a None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:12.281736 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf301a6-e723-4f1e-931a-e8801103321a None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:12.281736 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf301a6-e723-4f1e-931a-e8801103321a None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:12.283135 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 631/1247] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:19:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:19:12.291254 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ad436-cd53-4abd-b33e-c108be17d231 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:12.291254 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ad436-cd53-4abd-b33e-c108be17d231 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:12.291254 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ad436-cd53-4abd-b33e-c108be17d231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:12.296984 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:19:12.310661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-741ad436-cd53-4abd-b33e-c108be17d231 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:19:12.311920 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-741ad436-cd53-4abd-b33e-c108be17d231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:19:12.400389 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 617/1248] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:19:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 15:19:12.426281 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf301a6-e723-4f1e-931a-e8801103321a None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:12.447449 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:19:12.567458 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf301a6-e723-4f1e-931a-e8801103321a None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:12.606947 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2dc6cf-f86d-411f-9ef7-3c43f96a8df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:12.607652 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2dc6cf-f86d-411f-9ef7-3c43f96a8df3 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:12.607938 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2dc6cf-f86d-411f-9ef7-3c43f96a8df3 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:12.608215 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2dc6cf-f86d-411f-9ef7-3c43f96a8df3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:12.620179 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2dc6cf-f86d-411f-9ef7-3c43f96a8df3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:19:12.625962 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-0f2dc6cf-f86d-411f-9ef7-3c43f96a8df3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 15:19:12.625962 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:19:12.625962 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:19:12.625962 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:19:12.625962 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:19:12.625962 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:19:12.625962 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:19:12.625962 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:19:12.625962 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:19:12.625962 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:19:12.625962 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:19:12.625962 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:19:12.625962 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:19:12.625962 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:19:12.625962 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:19:12.625962 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:19:12.627765 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:19:12.627765 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:19:12.627765 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:19:12.627765 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:19:12.627765 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:19:12.627765 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:19:12.627765 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:19:12.627765 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:19:12.627765 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:19:12.627765 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:19:12.627765 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:19:12.627765 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:19:12.627765 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:19:12.627765 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:19:12.627765 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:19:12.627765 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:19:12.628606 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:19:12.628606 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:19:12.628606 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:19:12.628606 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:19:12.628606 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:19:12.628606 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:19:12.628606 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:19:12.628606 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:19:12.628606 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:19:12.628606 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:19:12.628606 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 15:19:12.628606 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:19:12.628606 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 632/1249] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 2 15:19:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 15:19:12.634179 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ad436-cd53-4abd-b33e-c108be17d231 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:12.752135 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ad436-cd53-4abd-b33e-c108be17d231 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:12.788268 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:19:12.796473 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e8f28-79ef-4ccd-b93d-aee527904112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:12.797425 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e8f28-79ef-4ccd-b93d-aee527904112 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:12.797826 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e8f28-79ef-4ccd-b93d-aee527904112 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:12.798297 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e8f28-79ef-4ccd-b93d-aee527904112 None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:12.799765 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4e8f28-79ef-4ccd-b93d-aee527904112 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:19:12.800341 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4e8f28-79ef-4ccd-b93d-aee527904112 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:12.803324 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4e8f28-79ef-4ccd-b93d-aee527904112 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:12.819468 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 618/1250] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 2 15:19:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:19:12.825993 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2dc6cf-f86d-411f-9ef7-3c43f96a8df3 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:12.936640 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:19:12.964437 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2dc6cf-f86d-411f-9ef7-3c43f96a8df3 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:13.004011 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4645da2-27dc-4b2e-b3f4-75c845ee5fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:13.004786 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4645da2-27dc-4b2e-b3f4-75c845ee5fd2 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:13.005059 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4645da2-27dc-4b2e-b3f4-75c845ee5fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:13.005458 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4645da2-27dc-4b2e-b3f4-75c845ee5fd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:13.017841 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4645da2-27dc-4b2e-b3f4-75c845ee5fd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:13.019447 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4645da2-27dc-4b2e-b3f4-75c845ee5fd2 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:13.036376 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-f4645da2-27dc-4b2e-b3f4-75c845ee5fd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:19:13.036376 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:19:13.036376 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:19:13.036376 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:19:13.036376 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:19:13.036376 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:19:13.036376 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:19:13.036376 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:19:13.036376 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:19:13.036376 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:19:13.036376 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:19:13.036376 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:19:13.036376 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:19:13.036376 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:19:13.036376 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:19:13.037517 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:19:13.037517 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:19:13.037517 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:19:13.037517 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:19:13.037517 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:19:13.037517 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:19:13.037517 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:19:13.037517 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:19:13.037517 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:19:13.037517 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:19:13.037517 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:19:13.037517 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:19:13.037517 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:19:13.037517 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:19:13.037517 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:19:13.037517 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:19:13.037517 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:19:13.038591 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:19:13.038591 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:19:13.038591 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:19:13.038591 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:19:13.038591 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 633/1251] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:19:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 15:19:13.044272 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e8f28-79ef-4ccd-b93d-aee527904112 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:13.161848 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e8f28-79ef-4ccd-b93d-aee527904112 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:13.203116 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05363574-6b07-409e-8a2d-c9ba2cccd458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:13.203773 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05363574-6b07-409e-8a2d-c9ba2cccd458 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:13.204061 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05363574-6b07-409e-8a2d-c9ba2cccd458 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:13.204337 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05363574-6b07-409e-8a2d-c9ba2cccd458 None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:13.205024 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05363574-6b07-409e-8a2d-c9ba2cccd458 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:19:13.205333 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05363574-6b07-409e-8a2d-c9ba2cccd458 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:13.206699 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05363574-6b07-409e-8a2d-c9ba2cccd458 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:13.219884 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 619/1252] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:19:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:19:13.225696 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4645da2-27dc-4b2e-b3f4-75c845ee5fd2 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:13.342178 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4645da2-27dc-4b2e-b3f4-75c845ee5fd2 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:13.377871 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:19:13.387036 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8346228-a97b-4e7f-b86b-dcb141f1408e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:13.388042 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8346228-a97b-4e7f-b86b-dcb141f1408e None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:13.388383 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8346228-a97b-4e7f-b86b-dcb141f1408e None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:13.388765 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8346228-a97b-4e7f-b86b-dcb141f1408e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:13.399796 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8346228-a97b-4e7f-b86b-dcb141f1408e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:13.401469 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8346228-a97b-4e7f-b86b-dcb141f1408e None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:13.416049 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-d8346228-a97b-4e7f-b86b-dcb141f1408e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 02 15:19:13.416049 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:19:13.416049 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:19:13.416049 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:19:13.416049 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:19:13.416049 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:19:13.416049 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:19:13.416049 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:19:13.416049 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:19:13.416049 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:19:13.416049 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:19:13.416049 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:19:13.416049 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 15:19:13.416049 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 15:19:13.416049 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 15:19:13.416049 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 15:19:13.417080 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:19:13.417080 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:19:13.417080 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 15:19:13.417080 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:19:13.417080 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 15:19:13.417080 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:19:13.417080 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:19:13.417080 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:19:13.417080 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:19:13.417080 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:19:13.417080 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:19:13.417080 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:19:13.417080 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:19:13.417080 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:19:13.417080 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:19:13.417080 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:19:13.417080 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:19:13.417080 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:19:13.418034 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:19:13.418034 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:19:13.418034 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 15:19:13.418034 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 15:19:13.418034 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 15:19:13.418034 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 15:19:13.418034 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 15:19:13.418034 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 15:19:13.418034 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 02 15:19:13.418034 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:19:13.422896 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 634/1253] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:19:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:19:13.424316 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05363574-6b07-409e-8a2d-c9ba2cccd458 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:13.492062 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:19:13.543966 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05363574-6b07-409e-8a2d-c9ba2cccd458 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:13.584264 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7495275c-fe13-4b6b-9e73-f18588baceba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:13.584891 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495275c-fe13-4b6b-9e73-f18588baceba None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:13.585174 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495275c-fe13-4b6b-9e73-f18588baceba None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:13.585500 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495275c-fe13-4b6b-9e73-f18588baceba None admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:13.586373 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7495275c-fe13-4b6b-9e73-f18588baceba None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:19:13.586683 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7495275c-fe13-4b6b-9e73-f18588baceba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:13.588152 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7495275c-fe13-4b6b-9e73-f18588baceba None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:13.611738 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 620/1254] 10.222.0.42 () {56 vars in 1143 bytes} [Tue Aug 2 15:19:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:19:13.618520 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8346228-a97b-4e7f-b86b-dcb141f1408e None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:13.728752 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8346228-a97b-4e7f-b86b-dcb141f1408e None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:13.764528 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef886ca-fa57-425f-84e4-2c3b9503aa3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:13.765113 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef886ca-fa57-425f-84e4-2c3b9503aa3d None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:13.765403 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef886ca-fa57-425f-84e4-2c3b9503aa3d None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:13.765689 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef886ca-fa57-425f-84e4-2c3b9503aa3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:13.830837 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:19:13.847871 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef886ca-fa57-425f-84e4-2c3b9503aa3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:13.849707 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef886ca-fa57-425f-84e4-2c3b9503aa3d None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:13.965824 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 635/1255] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 2 15:19:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 15:19:13.972550 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7495275c-fe13-4b6b-9e73-f18588baceba None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:14.082138 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7495275c-fe13-4b6b-9e73-f18588baceba None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:14.096389 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:19:14.118301 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f99e88a-c505-4ad8-a7f5-f324d135e1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:14.118942 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99e88a-c505-4ad8-a7f5-f324d135e1ca None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:14.119246 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99e88a-c505-4ad8-a7f5-f324d135e1ca None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:14.119517 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99e88a-c505-4ad8-a7f5-f324d135e1ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:14.130240 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f99e88a-c505-4ad8-a7f5-f324d135e1ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:14.131692 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f99e88a-c505-4ad8-a7f5-f324d135e1ca None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:14.147227 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-7f99e88a-c505-4ad8-a7f5-f324d135e1ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:19:14.147227 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:19:14.147227 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:19:14.147227 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:19:14.147227 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:19:14.147227 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:19:14.147227 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:19:14.147227 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:19:14.147227 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:19:14.147227 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:19:14.147227 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:19:14.147227 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:19:14.147227 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:19:14.147227 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:19:14.147227 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:19:14.148405 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:19:14.148405 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:19:14.148405 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:19:14.148405 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:19:14.148405 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:19:14.148405 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:19:14.148405 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:19:14.148405 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:19:14.148405 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:19:14.148405 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:19:14.148405 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:19:14.148405 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:19:14.148405 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:19:14.148405 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:19:14.148405 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:19:14.148405 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:19:14.148405 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:19:14.149502 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:19:14.149502 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:19:14.149502 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:19:14.149502 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:19:14.149502 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 621/1256] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:19:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:19:14.154366 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef886ca-fa57-425f-84e4-2c3b9503aa3d None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:14.260870 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:19:14.274154 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef886ca-fa57-425f-84e4-2c3b9503aa3d None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:14.315007 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047e2696-baec-4ce5-b9ce-e8fa2fb72463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:14.315758 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e2696-baec-4ce5-b9ce-e8fa2fb72463 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:14.316077 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e2696-baec-4ce5-b9ce-e8fa2fb72463 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:14.316503 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e2696-baec-4ce5-b9ce-e8fa2fb72463 None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:14.317341 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047e2696-baec-4ce5-b9ce-e8fa2fb72463 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:19:14.317793 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047e2696-baec-4ce5-b9ce-e8fa2fb72463 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:14.319554 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047e2696-baec-4ce5-b9ce-e8fa2fb72463 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:14.333764 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 636/1257] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:19:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:19:14.339898 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f99e88a-c505-4ad8-a7f5-f324d135e1ca None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:14.450813 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f99e88a-c505-4ad8-a7f5-f324d135e1ca None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:14.489431 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff78ded-10a1-4d7c-a969-1c66223179b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:14.490080 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff78ded-10a1-4d7c-a969-1c66223179b3 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:14.490359 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff78ded-10a1-4d7c-a969-1c66223179b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:14.490634 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff78ded-10a1-4d7c-a969-1c66223179b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:14.497729 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff78ded-10a1-4d7c-a969-1c66223179b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:14.499324 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff78ded-10a1-4d7c-a969-1c66223179b3 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:14.511743 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-7ff78ded-10a1-4d7c-a969-1c66223179b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:19:14.511743 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:19:14.511743 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:19:14.511743 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:19:14.511743 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:19:14.511743 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:19:14.511743 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:19:14.511743 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:19:14.511743 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:19:14.511743 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:19:14.511743 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:19:14.511743 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:19:14.511743 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 15:19:14.511743 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 15:19:14.511743 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 15:19:14.512997 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 15:19:14.512997 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:19:14.512997 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:19:14.512997 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:19:14.512997 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:19:14.512997 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:19:14.512997 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:19:14.512997 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:19:14.512997 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:19:14.512997 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:19:14.512997 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:19:14.512997 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:19:14.512997 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:19:14.512997 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:19:14.512997 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:19:14.512997 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:19:14.512997 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:19:14.514369 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 15:19:14.514369 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 15:19:14.514369 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 15:19:14.514369 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 15:19:14.514369 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 15:19:14.514369 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 15:19:14.514369 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:19:14.514369 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:19:14.514369 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 622/1258] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 2 15:19:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:19:14.519689 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047e2696-baec-4ce5-b9ce-e8fa2fb72463 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:14.630657 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047e2696-baec-4ce5-b9ce-e8fa2fb72463 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:14.667651 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3049b1eb-b0e0-4ad0-ab90-7dd4182c9ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:14.668299 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049b1eb-b0e0-4ad0-ab90-7dd4182c9ab6 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:14.668581 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049b1eb-b0e0-4ad0-ab90-7dd4182c9ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:14.668861 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049b1eb-b0e0-4ad0-ab90-7dd4182c9ab6 None admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:14.669644 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3049b1eb-b0e0-4ad0-ab90-7dd4182c9ab6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:19:14.669951 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3049b1eb-b0e0-4ad0-ab90-7dd4182c9ab6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:14.671955 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3049b1eb-b0e0-4ad0-ab90-7dd4182c9ab6 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:14.685403 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 637/1259] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 2 15:19:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:19:14.692284 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff78ded-10a1-4d7c-a969-1c66223179b3 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:14.719609 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:19:14.801179 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff78ded-10a1-4d7c-a969-1c66223179b3 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:14.840038 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca1751-de2f-4a27-80eb-978f3ccf29ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:14.840749 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca1751-de2f-4a27-80eb-978f3ccf29ef None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:14.841282 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca1751-de2f-4a27-80eb-978f3ccf29ef None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:14.841548 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca1751-de2f-4a27-80eb-978f3ccf29ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:14.842406 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cca1751-de2f-4a27-80eb-978f3ccf29ef None admin] RBAC: Adding query filter params (role.id=d75c9572cb294caeb8eb456521ff6f57, scope.project.id=cc19d22b4cd64dd1bc89ed78155d2732, user.id=57dfafee636a45ca98fe0e8bb13dd754) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:19:14.842704 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cca1751-de2f-4a27-80eb-978f3ccf29ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:14.844821 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cca1751-de2f-4a27-80eb-978f3ccf29ef None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:14.851700 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 623/1260] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 2 15:19:14 2022] GET /identity/v3/role_assignments?user.id=57dfafee636a45ca98fe0e8bb13dd754&scope.project.id=cc19d22b4cd64dd1bc89ed78155d2732&role.id=d75c9572cb294caeb8eb456521ff6f57 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:19:16.857623 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabaa37b-418b-4432-bdb8-66c838c9345b None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:16.858311 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabaa37b-418b-4432-bdb8-66c838c9345b None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:16.858311 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabaa37b-418b-4432-bdb8-66c838c9345b None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:16.860394 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 638/1261] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:19:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:19:16.865781 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb76d2d-32da-497b-87e0-6e18d2143d4e None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:16.866243 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb76d2d-32da-497b-87e0-6e18d2143d4e None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:16.866339 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb76d2d-32da-497b-87e0-6e18d2143d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:16.884792 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-cfb76d2d-32da-497b-87e0-6e18d2143d4e None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:19:16.885995 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-cfb76d2d-32da-497b-87e0-6e18d2143d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:19:16.954943 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 624/1262] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:19:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 15:19:16.977635 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabaa37b-418b-4432-bdb8-66c838c9345b None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:16.988459 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:19:17.078299 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabaa37b-418b-4432-bdb8-66c838c9345b None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:17.110972 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f3615b-8a8e-462f-9a92-4764ebad4ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:17.111561 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f3615b-8a8e-462f-9a92-4764ebad4ef2 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:17.111845 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f3615b-8a8e-462f-9a92-4764ebad4ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:17.112123 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f3615b-8a8e-462f-9a92-4764ebad4ef2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:17.121951 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f3615b-8a8e-462f-9a92-4764ebad4ef2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:19:17.127379 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-01f3615b-8a8e-462f-9a92-4764ebad4ef2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 15:19:17.127379 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:19:17.127379 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:19:17.127379 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:19:17.127379 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:19:17.127379 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:19:17.127379 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:19:17.127379 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:19:17.127379 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:19:17.127379 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:19:17.127379 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:19:17.127379 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:19:17.127379 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:19:17.127379 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:19:17.127379 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:19:17.127379 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:19:17.128465 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:19:17.128465 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:19:17.128465 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:19:17.128465 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:19:17.128465 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:19:17.128465 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:19:17.128465 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:19:17.128465 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:19:17.128465 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:19:17.128465 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:19:17.128465 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:19:17.128465 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:19:17.128465 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:19:17.128465 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:19:17.128465 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:19:17.128465 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:19:17.129641 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:19:17.129641 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:19:17.129641 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:19:17.129641 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:19:17.129641 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:19:17.129641 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:19:17.129641 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:19:17.129641 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:19:17.129641 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:19:17.129641 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:19:17.129641 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 15:19:17.129641 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:19:17.129641 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 639/1263] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 2 15:19:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 15:19:17.136029 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb76d2d-32da-497b-87e0-6e18d2143d4e None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:17.153794 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:19:17.233591 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb76d2d-32da-497b-87e0-6e18d2143d4e None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:17.268981 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4699f2eb-96ae-48c5-a424-1913fe7cb574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:17.269597 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4699f2eb-96ae-48c5-a424-1913fe7cb574 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:17.269878 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4699f2eb-96ae-48c5-a424-1913fe7cb574 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:17.270154 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4699f2eb-96ae-48c5-a424-1913fe7cb574 None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:17.270865 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4699f2eb-96ae-48c5-a424-1913fe7cb574 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:19:17.271170 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4699f2eb-96ae-48c5-a424-1913fe7cb574 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:17.272556 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4699f2eb-96ae-48c5-a424-1913fe7cb574 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:17.281175 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 625/1264] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 2 15:19:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:19:17.286701 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f3615b-8a8e-462f-9a92-4764ebad4ef2 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:17.354591 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:19:17.386551 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f3615b-8a8e-462f-9a92-4764ebad4ef2 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:17.419220 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f62e35f-cea3-4cab-8f6c-228bd562ab82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:17.419857 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f62e35f-cea3-4cab-8f6c-228bd562ab82 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:17.420136 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f62e35f-cea3-4cab-8f6c-228bd562ab82 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:17.420403 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f62e35f-cea3-4cab-8f6c-228bd562ab82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:17.430742 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f62e35f-cea3-4cab-8f6c-228bd562ab82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:17.432215 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f62e35f-cea3-4cab-8f6c-228bd562ab82 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:17.446284 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-2f62e35f-cea3-4cab-8f6c-228bd562ab82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:19:17.446284 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:19:17.446284 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:19:17.446284 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:19:17.446284 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:19:17.446284 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:19:17.446284 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:19:17.446284 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:19:17.446284 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:19:17.446284 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:19:17.446284 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:19:17.446284 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:19:17.446284 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:19:17.446284 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:19:17.446284 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:19:17.447339 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:19:17.447339 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:19:17.447339 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:19:17.447339 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:19:17.447339 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:19:17.447339 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:19:17.447339 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:19:17.447339 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:19:17.447339 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:19:17.447339 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:19:17.447339 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:19:17.447339 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:19:17.447339 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:19:17.447339 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:19:17.447339 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:19:17.447339 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:19:17.447339 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:19:17.448690 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:19:17.448690 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:19:17.448690 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:19:17.448690 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:19:17.448690 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 640/1265] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:19:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:19:17.453889 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4699f2eb-96ae-48c5-a424-1913fe7cb574 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:17.534618 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:19:17.553714 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4699f2eb-96ae-48c5-a424-1913fe7cb574 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:17.586348 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4408691e-c4bf-47af-ba72-36fe0c2ac1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:17.586963 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4408691e-c4bf-47af-ba72-36fe0c2ac1bf None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:17.587286 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4408691e-c4bf-47af-ba72-36fe0c2ac1bf None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:17.587536 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4408691e-c4bf-47af-ba72-36fe0c2ac1bf None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:17.588213 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4408691e-c4bf-47af-ba72-36fe0c2ac1bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:19:17.588511 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4408691e-c4bf-47af-ba72-36fe0c2ac1bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:17.589861 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4408691e-c4bf-47af-ba72-36fe0c2ac1bf None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:17.601842 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 626/1266] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:19:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:19:17.607658 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f62e35f-cea3-4cab-8f6c-228bd562ab82 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:17.715716 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f62e35f-cea3-4cab-8f6c-228bd562ab82 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:17.736749 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:19:17.754363 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c78529-1c65-4307-8868-9ead43215f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:17.755006 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c78529-1c65-4307-8868-9ead43215f1a None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:17.755320 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c78529-1c65-4307-8868-9ead43215f1a None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:17.756421 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c78529-1c65-4307-8868-9ead43215f1a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:17.764828 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c78529-1c65-4307-8868-9ead43215f1a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:17.766289 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c78529-1c65-4307-8868-9ead43215f1a None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:17.777610 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-15c78529-1c65-4307-8868-9ead43215f1a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 02 15:19:17.777610 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:19:17.777610 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:19:17.777610 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:19:17.777610 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:19:17.777610 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:19:17.777610 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:19:17.777610 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:19:17.777610 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:19:17.777610 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:19:17.777610 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:19:17.777610 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:19:17.777610 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 15:19:17.777610 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 15:19:17.777610 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 15:19:17.777610 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 15:19:17.778692 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:19:17.778692 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:19:17.778692 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 15:19:17.778692 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:19:17.778692 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 15:19:17.778692 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:19:17.778692 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:19:17.778692 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:19:17.778692 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:19:17.778692 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:19:17.778692 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:19:17.778692 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:19:17.778692 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:19:17.778692 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:19:17.778692 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:19:17.778692 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:19:17.778692 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:19:17.778692 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:19:17.779731 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:19:17.779731 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:19:17.779731 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 15:19:17.779731 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 15:19:17.779731 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 15:19:17.779731 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 15:19:17.779731 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 15:19:17.779731 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 15:19:17.779731 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 02 15:19:17.779731 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:19:17.779731 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 641/1267] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:19:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:19:17.785207 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4408691e-c4bf-47af-ba72-36fe0c2ac1bf None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:17.891337 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4408691e-c4bf-47af-ba72-36fe0c2ac1bf None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:17.925671 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7fe83-6fa3-4585-be6f-52b1a4fe6b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:17.926283 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7fe83-6fa3-4585-be6f-52b1a4fe6b04 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:17.926559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7fe83-6fa3-4585-be6f-52b1a4fe6b04 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:17.926831 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7fe83-6fa3-4585-be6f-52b1a4fe6b04 None admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:17.927641 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe7fe83-6fa3-4585-be6f-52b1a4fe6b04 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:19:17.927945 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe7fe83-6fa3-4585-be6f-52b1a4fe6b04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:17.929348 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe7fe83-6fa3-4585-be6f-52b1a4fe6b04 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:17.937732 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:19:17.947858 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 627/1268] 10.222.0.42 () {56 vars in 1143 bytes} [Tue Aug 2 15:19:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:19:17.953576 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c78529-1c65-4307-8868-9ead43215f1a None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:18.054118 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c78529-1c65-4307-8868-9ead43215f1a None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:18.094104 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e35ca-7761-4d05-bfb8-39481f96b75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:18.094744 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e35ca-7761-4d05-bfb8-39481f96b75e None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:18.095006 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e35ca-7761-4d05-bfb8-39481f96b75e None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:18.095311 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e35ca-7761-4d05-bfb8-39481f96b75e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:18.107234 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713e35ca-7761-4d05-bfb8-39481f96b75e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:18.108682 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713e35ca-7761-4d05-bfb8-39481f96b75e None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:18.122431 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-713e35ca-7761-4d05-bfb8-39481f96b75e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:19:18.122431 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:19:18.122431 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:19:18.122431 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:19:18.122431 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:19:18.122431 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:19:18.122431 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:19:18.122431 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:19:18.122431 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:19:18.122431 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:19:18.122431 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:19:18.122431 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:19:18.122431 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:19:18.122431 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:19:18.122431 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:19:18.123865 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:19:18.123865 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:19:18.123865 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:19:18.123865 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:19:18.123865 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:19:18.123865 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:19:18.123865 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:19:18.123865 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:19:18.123865 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:19:18.123865 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:19:18.123865 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:19:18.123865 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:19:18.123865 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:19:18.123865 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:19:18.123865 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:19:18.123865 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:19:18.123865 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:19:18.125651 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:19:18.125651 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:19:18.125651 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:19:18.125651 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:19:18.125651 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 642/1269] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:19:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:19:18.129839 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7fe83-6fa3-4585-be6f-52b1a4fe6b04 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:18.227942 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7fe83-6fa3-4585-be6f-52b1a4fe6b04 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:18.262591 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a73ee5-b8c5-464a-a344-8f23977f42ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:18.263205 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a73ee5-b8c5-464a-a344-8f23977f42ff None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:18.263520 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a73ee5-b8c5-464a-a344-8f23977f42ff None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:18.263798 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a73ee5-b8c5-464a-a344-8f23977f42ff None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:18.264486 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a73ee5-b8c5-464a-a344-8f23977f42ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:19:18.264794 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a73ee5-b8c5-464a-a344-8f23977f42ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:18.266161 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a73ee5-b8c5-464a-a344-8f23977f42ff None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:18.277163 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 628/1270] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:19:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:19:18.283093 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e35ca-7761-4d05-bfb8-39481f96b75e None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:18.315524 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:19:18.383303 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e35ca-7761-4d05-bfb8-39481f96b75e None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:18.417547 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7418d-5e4b-4917-bab3-585044cd0d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:18.418207 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7418d-5e4b-4917-bab3-585044cd0d5b None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:18.418494 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7418d-5e4b-4917-bab3-585044cd0d5b None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:18.418778 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7418d-5e4b-4917-bab3-585044cd0d5b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:18.426942 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b7418d-5e4b-4917-bab3-585044cd0d5b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:18.428430 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b7418d-5e4b-4917-bab3-585044cd0d5b None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:18.440027 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-32b7418d-5e4b-4917-bab3-585044cd0d5b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:19:18.440027 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:19:18.440027 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:19:18.440027 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:19:18.440027 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:19:18.440027 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:19:18.440027 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:19:18.440027 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:19:18.440027 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:19:18.440027 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:19:18.440027 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:19:18.440027 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:19:18.440027 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 15:19:18.440027 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 15:19:18.440027 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 15:19:18.441114 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 15:19:18.441114 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:19:18.441114 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:19:18.441114 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:19:18.441114 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:19:18.441114 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:19:18.441114 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:19:18.441114 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:19:18.441114 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:19:18.441114 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:19:18.441114 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:19:18.441114 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:19:18.441114 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:19:18.441114 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:19:18.441114 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:19:18.441114 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:19:18.441114 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:19:18.442386 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 15:19:18.442386 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 15:19:18.442386 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 15:19:18.442386 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 15:19:18.442386 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 15:19:18.442386 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 15:19:18.442386 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:19:18.442386 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:19:18.442386 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 643/1271] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 2 15:19:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:19:18.446995 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a73ee5-b8c5-464a-a344-8f23977f42ff None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:18.504541 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:19:18.545504 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a73ee5-b8c5-464a-a344-8f23977f42ff None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:18.577879 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f4f9d-e6d0-47a7-97d6-940486ea6073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:18.578426 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f4f9d-e6d0-47a7-97d6-940486ea6073 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:18.578704 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f4f9d-e6d0-47a7-97d6-940486ea6073 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:18.578976 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f4f9d-e6d0-47a7-97d6-940486ea6073 None admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:18.579730 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0f4f9d-e6d0-47a7-97d6-940486ea6073 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:19:18.580032 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0f4f9d-e6d0-47a7-97d6-940486ea6073 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:18.581444 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0f4f9d-e6d0-47a7-97d6-940486ea6073 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:18.593533 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 629/1272] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 2 15:19:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:19:18.599465 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7418d-5e4b-4917-bab3-585044cd0d5b None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:18.688632 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:19:18.697445 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7418d-5e4b-4917-bab3-585044cd0d5b None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:18.730556 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8156e-1012-4859-aa15-8fde0ef8be1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:18.731229 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8156e-1012-4859-aa15-8fde0ef8be1c None admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:18.731526 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8156e-1012-4859-aa15-8fde0ef8be1c None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:18.731802 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8156e-1012-4859-aa15-8fde0ef8be1c None admin] PATH_INFO: `/v3/projects/cc19d22b4cd64dd1bc89ed78155d2732/users/57dfafee636a45ca98fe0e8bb13dd754/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:18.734230 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a8156e-1012-4859-aa15-8fde0ef8be1c None admin] RBAC: Authorizing `identity:create_grant(project_id=cc19d22b4cd64dd1bc89ed78155d2732, user_id=57dfafee636a45ca98fe0e8bb13dd754, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:18.735695 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a8156e-1012-4859-aa15-8fde0ef8be1c None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:18.748130 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 644/1273] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 2 15:19:18 2022] PUT /identity/v3/projects/cc19d22b4cd64dd1bc89ed78155d2732/users/57dfafee636a45ca98fe0e8bb13dd754/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:19:20.731433 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d65763-b5eb-4559-af28-8887c4be6f01 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:20.732005 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d65763-b5eb-4559-af28-8887c4be6f01 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:20.732005 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d65763-b5eb-4559-af28-8887c4be6f01 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:20.733325 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 630/1274] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:19:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:19:20.738909 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d3309-859c-4f73-8021-3c4e608c3491 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:20.739403 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d3309-859c-4f73-8021-3c4e608c3491 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:20.739495 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d3309-859c-4f73-8021-3c4e608c3491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:20.758433 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-d41d3309-859c-4f73-8021-3c4e608c3491 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:19:20.759649 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-d41d3309-859c-4f73-8021-3c4e608c3491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:19:20.829973 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 645/1275] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:19:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 15:19:20.854624 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d65763-b5eb-4559-af28-8887c4be6f01 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:20.959387 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d65763-b5eb-4559-af28-8887c4be6f01 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:20.977082 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:19:20.995208 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1c613-cfd7-41c6-be22-85092047d415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:20.995797 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1c613-cfd7-41c6-be22-85092047d415 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:20.996082 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1c613-cfd7-41c6-be22-85092047d415 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:20.996361 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1c613-cfd7-41c6-be22-85092047d415 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:21.006589 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d1c613-cfd7-41c6-be22-85092047d415 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 15:19:21.011506 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-d6d1c613-cfd7-41c6-be22-85092047d415 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 15:19:21.011506 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:19:21.011506 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:19:21.011506 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:19:21.011506 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:19:21.011506 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:19:21.011506 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:19:21.011506 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:19:21.011506 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:19:21.011506 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:19:21.011506 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:19:21.011506 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:19:21.011506 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 15:19:21.011506 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 15:19:21.011506 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 15:19:21.011506 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 15:19:21.012675 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 15:19:21.012675 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 15:19:21.012675 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 15:19:21.012675 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 15:19:21.012675 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:19:21.012675 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:19:21.012675 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:19:21.012675 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:19:21.012675 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:19:21.012675 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:19:21.012675 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:19:21.012675 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:19:21.012675 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:19:21.012675 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:19:21.012675 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:19:21.012675 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:19:21.013547 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:19:21.013547 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:19:21.013547 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:19:21.013547 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:19:21.013547 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 15:19:21.013547 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 15:19:21.013547 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 15:19:21.013547 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 15:19:21.013547 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 15:19:21.013547 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 15:19:21.013547 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 15:19:21.013547 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:19:21.013547 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 631/1276] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 2 15:19:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:19:21.018831 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d3309-859c-4f73-8021-3c4e608c3491 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:21.101439 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:19:21.121685 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d3309-859c-4f73-8021-3c4e608c3491 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:21.155876 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e24ac7-63f7-4051-82ab-bc8666f3cd2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:21.156490 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e24ac7-63f7-4051-82ab-bc8666f3cd2d None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:21.156766 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e24ac7-63f7-4051-82ab-bc8666f3cd2d None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:21.157038 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e24ac7-63f7-4051-82ab-bc8666f3cd2d None admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:21.158078 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e24ac7-63f7-4051-82ab-bc8666f3cd2d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:19:21.158078 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e24ac7-63f7-4051-82ab-bc8666f3cd2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:21.159425 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e24ac7-63f7-4051-82ab-bc8666f3cd2d None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:21.167893 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 646/1277] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 2 15:19:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:19:21.174305 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1c613-cfd7-41c6-be22-85092047d415 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:21.272675 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1c613-cfd7-41c6-be22-85092047d415 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:21.307281 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f33148-231b-4ec5-b3b9-b3ed99b1b43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:21.307918 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f33148-231b-4ec5-b3b9-b3ed99b1b43a None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:21.308197 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f33148-231b-4ec5-b3b9-b3ed99b1b43a None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:21.308470 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f33148-231b-4ec5-b3b9-b3ed99b1b43a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:21.318294 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f33148-231b-4ec5-b3b9-b3ed99b1b43a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:21.319762 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f33148-231b-4ec5-b3b9-b3ed99b1b43a None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:21.334457 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-99f33148-231b-4ec5-b3b9-b3ed99b1b43a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:19:21.334457 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:19:21.334457 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:19:21.334457 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:19:21.334457 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:19:21.334457 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:19:21.334457 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:19:21.334457 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:19:21.334457 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:19:21.334457 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:19:21.334457 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:19:21.334457 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:19:21.334457 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:19:21.334457 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:19:21.334457 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:19:21.335407 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:19:21.335407 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:19:21.335407 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:19:21.335407 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:19:21.335407 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:19:21.335407 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:19:21.335407 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:19:21.335407 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:19:21.335407 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:19:21.335407 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:19:21.335407 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:19:21.335407 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:19:21.335407 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:19:21.335407 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:19:21.335407 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:19:21.335407 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:19:21.335407 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:19:21.336411 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:19:21.336411 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:19:21.336411 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:19:21.336411 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:19:21.336411 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 632/1278] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:19:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:19:21.341541 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e24ac7-63f7-4051-82ab-bc8666f3cd2d None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:21.439301 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e24ac7-63f7-4051-82ab-bc8666f3cd2d None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:21.472971 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e69f63-477e-4e44-b434-602004026bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:21.473586 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e69f63-477e-4e44-b434-602004026bd4 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:21.473864 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e69f63-477e-4e44-b434-602004026bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:21.474137 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e69f63-477e-4e44-b434-602004026bd4 None admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:21.474815 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e69f63-477e-4e44-b434-602004026bd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:19:21.475118 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e69f63-477e-4e44-b434-602004026bd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:21.476520 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e69f63-477e-4e44-b434-602004026bd4 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:21.488286 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 647/1279] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:19:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:19:21.493948 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f33148-231b-4ec5-b3b9-b3ed99b1b43a None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:21.525224 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:19:21.593131 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f33148-231b-4ec5-b3b9-b3ed99b1b43a None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:21.625585 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbed96c-3a9b-40da-b59c-757483f54c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:21.626218 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbed96c-3a9b-40da-b59c-757483f54c22 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:21.626493 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbed96c-3a9b-40da-b59c-757483f54c22 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:21.626764 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbed96c-3a9b-40da-b59c-757483f54c22 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:21.634007 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbed96c-3a9b-40da-b59c-757483f54c22 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:21.635468 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbed96c-3a9b-40da-b59c-757483f54c22 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:21.646390 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-4fbed96c-3a9b-40da-b59c-757483f54c22 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 02 15:19:21.646390 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:19:21.646390 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:19:21.646390 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:19:21.646390 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:19:21.646390 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:19:21.646390 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:19:21.646390 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:19:21.646390 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:19:21.646390 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:19:21.646390 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:19:21.646390 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:19:21.646390 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 15:19:21.646390 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 15:19:21.646390 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 15:19:21.646390 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 15:19:21.647583 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:19:21.647583 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:19:21.647583 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 15:19:21.647583 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:19:21.647583 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 15:19:21.647583 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 15:19:21.647583 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:19:21.647583 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:19:21.647583 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:19:21.647583 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:19:21.647583 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:19:21.647583 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:19:21.647583 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:19:21.647583 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:19:21.647583 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:19:21.647583 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:19:21.647583 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:19:21.647583 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:19:21.648553 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:19:21.648553 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:19:21.648553 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 15:19:21.648553 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 15:19:21.648553 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 15:19:21.648553 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 15:19:21.648553 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 15:19:21.648553 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 15:19:21.648553 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 02 15:19:21.648553 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:19:21.648553 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 633/1280] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:19:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:19:21.653352 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e69f63-477e-4e44-b434-602004026bd4 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:21.657614 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:19:21.753385 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e69f63-477e-4e44-b434-602004026bd4 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:21.787294 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea0377-abba-4a64-8351-14a7c8e7b4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:21.787844 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea0377-abba-4a64-8351-14a7c8e7b4d6 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:21.788128 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea0377-abba-4a64-8351-14a7c8e7b4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:21.788403 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea0377-abba-4a64-8351-14a7c8e7b4d6 None admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:21.789180 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dea0377-abba-4a64-8351-14a7c8e7b4d6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:19:21.789482 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dea0377-abba-4a64-8351-14a7c8e7b4d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:21.791265 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dea0377-abba-4a64-8351-14a7c8e7b4d6 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:21.808380 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 648/1281] 10.222.0.42 () {56 vars in 1143 bytes} [Tue Aug 2 15:19:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:19:21.814190 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbed96c-3a9b-40da-b59c-757483f54c22 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:21.911802 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:19:21.922552 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbed96c-3a9b-40da-b59c-757483f54c22 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:21.955807 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa2dcc-3b4f-42d8-8904-2b5748b814b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:21.956436 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa2dcc-3b4f-42d8-8904-2b5748b814b6 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:21.956722 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa2dcc-3b4f-42d8-8904-2b5748b814b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:21.957000 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa2dcc-3b4f-42d8-8904-2b5748b814b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:22.021836 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fa2dcc-3b4f-42d8-8904-2b5748b814b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:22.023310 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fa2dcc-3b4f-42d8-8904-2b5748b814b6 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:22.109140 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:19:22.119640 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 634/1282] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 2 15:19:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 15:19:22.126092 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea0377-abba-4a64-8351-14a7c8e7b4d6 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:22.187986 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:19:22.226551 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea0377-abba-4a64-8351-14a7c8e7b4d6 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:22.259791 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9a819-dcb5-4f23-9f82-580ef045a593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:22.260421 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9a819-dcb5-4f23-9f82-580ef045a593 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:22.260704 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9a819-dcb5-4f23-9f82-580ef045a593 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:22.260982 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9a819-dcb5-4f23-9f82-580ef045a593 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:22.271293 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a9a819-dcb5-4f23-9f82-580ef045a593 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:22.272739 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a9a819-dcb5-4f23-9f82-580ef045a593 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:22.287461 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-c8a9a819-dcb5-4f23-9f82-580ef045a593 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:19:22.287461 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:19:22.287461 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:19:22.287461 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:19:22.287461 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:19:22.287461 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:19:22.287461 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:19:22.287461 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:19:22.287461 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:19:22.287461 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:19:22.287461 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:19:22.287461 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:19:22.287461 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 15:19:22.287461 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 15:19:22.287461 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 15:19:22.288499 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 15:19:22.288499 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:19:22.288499 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:19:22.288499 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:19:22.288499 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:19:22.288499 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:19:22.288499 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:19:22.288499 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:19:22.288499 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:19:22.288499 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:19:22.288499 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:19:22.288499 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:19:22.288499 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:19:22.288499 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:19:22.288499 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:19:22.288499 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:19:22.288499 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:19:22.289412 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 15:19:22.289412 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 15:19:22.289412 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 15:19:22.289412 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:19:22.289412 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 649/1283] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:19:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:19:22.294637 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa2dcc-3b4f-42d8-8904-2b5748b814b6 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:22.390712 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa2dcc-3b4f-42d8-8904-2b5748b814b6 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:22.423231 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3386ad8-3666-4251-b3bb-c4e682eb9004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:22.423858 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3386ad8-3666-4251-b3bb-c4e682eb9004 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:22.424142 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3386ad8-3666-4251-b3bb-c4e682eb9004 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:22.424421 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3386ad8-3666-4251-b3bb-c4e682eb9004 None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:22.425098 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3386ad8-3666-4251-b3bb-c4e682eb9004 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:19:22.425403 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3386ad8-3666-4251-b3bb-c4e682eb9004 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:22.426760 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3386ad8-3666-4251-b3bb-c4e682eb9004 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:22.438184 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 635/1284] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 2 15:19:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:19:22.443792 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9a819-dcb5-4f23-9f82-580ef045a593 None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:22.543713 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9a819-dcb5-4f23-9f82-580ef045a593 None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:22.558556 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:19:22.580263 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f502ac2-cd1d-47b5-abfa-c3967f15bebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:22.580513 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f502ac2-cd1d-47b5-abfa-c3967f15bebe None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:22.580618 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f502ac2-cd1d-47b5-abfa-c3967f15bebe None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:22.580856 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f502ac2-cd1d-47b5-abfa-c3967f15bebe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:22.588822 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f502ac2-cd1d-47b5-abfa-c3967f15bebe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:22.590286 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f502ac2-cd1d-47b5-abfa-c3967f15bebe None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:22.602296 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application [None req-4f502ac2-cd1d-47b5-abfa-c3967f15bebe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:19:22.602296 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:19:22.602296 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:19:22.602296 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:19:22.602296 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:19:22.602296 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:19:22.602296 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:19:22.602296 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:19:22.602296 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:19:22.602296 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:19:22.602296 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:19:22.602296 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:19:22.602296 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 15:19:22.602296 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 15:19:22.602296 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 15:19:22.603360 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 15:19:22.603360 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:19:22.603360 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:19:22.603360 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:19:22.603360 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:19:22.603360 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:19:22.603360 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:19:22.603360 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:19:22.603360 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application with Lock( Aug 02 15:19:22.603360 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:19:22.603360 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:19:22.603360 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:19:22.603360 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:19:22.603360 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:19:22.603360 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:19:22.603360 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:19:22.603360 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:19:22.604292 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 15:19:22.604292 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 15:19:22.604292 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 15:19:22.604292 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 15:19:22.604292 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 15:19:22.604292 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 15:19:22.604292 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 15:19:22.604292 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: ERROR keystone.server.flask.application Aug 02 15:19:22.604292 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 650/1285] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 2 15:19:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:19:22.609588 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3386ad8-3666-4251-b3bb-c4e682eb9004 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:22.661609 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:19:22.712664 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3386ad8-3666-4251-b3bb-c4e682eb9004 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:22.746226 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de936e-628b-4feb-a3d3-f0cb71eb59b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:22.746845 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de936e-628b-4feb-a3d3-f0cb71eb59b4 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:22.747133 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de936e-628b-4feb-a3d3-f0cb71eb59b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:22.747438 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de936e-628b-4feb-a3d3-f0cb71eb59b4 None admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:22.748180 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de936e-628b-4feb-a3d3-f0cb71eb59b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:19:22.748490 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de936e-628b-4feb-a3d3-f0cb71eb59b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:22.750582 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de936e-628b-4feb-a3d3-f0cb71eb59b4 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:22.763169 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 636/1286] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 2 15:19:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:19:22.770018 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f502ac2-cd1d-47b5-abfa-c3967f15bebe None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:22.878479 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f502ac2-cd1d-47b5-abfa-c3967f15bebe None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:22.912548 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b2bd76-1985-423f-a80c-8c1678e9525b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:22.913075 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b2bd76-1985-423f-a80c-8c1678e9525b None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:22.913360 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b2bd76-1985-423f-a80c-8c1678e9525b None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:22.913635 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b2bd76-1985-423f-a80c-8c1678e9525b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:22.914417 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b2bd76-1985-423f-a80c-8c1678e9525b None admin] RBAC: Adding query filter params (role.id=d75c9572cb294caeb8eb456521ff6f57, scope.project.id=cc19d22b4cd64dd1bc89ed78155d2732, user.id=57dfafee636a45ca98fe0e8bb13dd754) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:19:22.914731 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b2bd76-1985-423f-a80c-8c1678e9525b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:22.916478 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b2bd76-1985-423f-a80c-8c1678e9525b None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:22.922933 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 651/1287] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 2 15:19:22 2022] GET /identity/v3/role_assignments?user.id=57dfafee636a45ca98fe0e8bb13dd754&scope.project.id=cc19d22b4cd64dd1bc89ed78155d2732&role.id=d75c9572cb294caeb8eb456521ff6f57 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:19:24.944332 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d0414-3984-4c28-b74e-2c7dcf9696fd None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:24.944900 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d0414-3984-4c28-b74e-2c7dcf9696fd None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:24.944900 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d0414-3984-4c28-b74e-2c7dcf9696fd None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:24.946214 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 637/1288] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:19:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:19:24.951584 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af15515-c1c9-42bc-a8a8-eb1cb20ea3a5 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:24.952015 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af15515-c1c9-42bc-a8a8-eb1cb20ea3a5 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:24.952717 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af15515-c1c9-42bc-a8a8-eb1cb20ea3a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:24.971103 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-3af15515-c1c9-42bc-a8a8-eb1cb20ea3a5 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:19:24.972328 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-3af15515-c1c9-42bc-a8a8-eb1cb20ea3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:19:25.001521 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:19:25.039755 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 652/1289] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:19:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 15:19:25.061972 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d0414-3984-4c28-b74e-2c7dcf9696fd None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:25.161185 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d0414-3984-4c28-b74e-2c7dcf9696fd None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:25.172578 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:19:25.195787 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50c0f99-d2aa-4bc6-a209-72950890a893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:25.196339 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c0f99-d2aa-4bc6-a209-72950890a893 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:25.196614 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c0f99-d2aa-4bc6-a209-72950890a893 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:25.196883 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c0f99-d2aa-4bc6-a209-72950890a893 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:25.197497 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50c0f99-d2aa-4bc6-a209-72950890a893 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:25.198848 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50c0f99-d2aa-4bc6-a209-72950890a893 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:25.208085 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-d50c0f99-d2aa-4bc6-a209-72950890a893 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 15:19:25.208085 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:19:25.208085 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 15:19:25.208085 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 15:19:25.208085 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 15:19:25.208085 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 15:19:25.208085 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 15:19:25.208085 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 15:19:25.208085 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 15:19:25.208085 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:19:25.208085 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 15:19:25.208085 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:19:25.208085 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:19:25.208085 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:19:25.208085 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:19:25.208085 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:19:25.208085 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:19:25.209275 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:19:25.209275 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:19:25.209275 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:19:25.209275 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:19:25.209275 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:19:25.209275 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:19:25.209275 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 15:19:25.209275 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 15:19:25.209275 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 15:19:25.209275 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 15:19:25.209275 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:19:25.209275 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:19:25.209275 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:19:25.209275 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:19:25.209275 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:19:25.209275 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:19:25.210434 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:19:25.210434 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:19:25.210434 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:19:25.210434 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:19:25.210434 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:19:25.210434 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:19:25.210434 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:19:25.210434 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:19:25.210434 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:19:25.210434 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:19:25.210434 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 15:19:25.210434 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 15:19:25.210434 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 15:19:25.210434 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:19:25.210434 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 638/1290] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Aug 2 15:19:25 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:19:25.215433 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af15515-c1c9-42bc-a8a8-eb1cb20ea3a5 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:25.325662 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af15515-c1c9-42bc-a8a8-eb1cb20ea3a5 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:25.360153 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e932386-3367-424f-b822-3517d1426f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:25.360754 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e932386-3367-424f-b822-3517d1426f1a None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:25.361032 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e932386-3367-424f-b822-3517d1426f1a None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:25.361302 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e932386-3367-424f-b822-3517d1426f1a None admin] PATH_INFO: `/v3/services` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:25.361972 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e932386-3367-424f-b822-3517d1426f1a None admin] RBAC: Adding query filter params (name=placement) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:19:25.362274 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e932386-3367-424f-b822-3517d1426f1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:25.363669 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e932386-3367-424f-b822-3517d1426f1a None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:25.368340 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 653/1291] 10.222.0.42 () {56 vars in 1116 bytes} [Tue Aug 2 15:19:25 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:19:25.374580 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50c0f99-d2aa-4bc6-a209-72950890a893 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:25.474859 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50c0f99-d2aa-4bc6-a209-72950890a893 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:25.512199 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1099243-b17c-494e-9bfc-2636f417f042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:25.512815 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1099243-b17c-494e-9bfc-2636f417f042 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:25.513104 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1099243-b17c-494e-9bfc-2636f417f042 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:25.513376 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1099243-b17c-494e-9bfc-2636f417f042 None admin] PATH_INFO: `/v3/services` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:25.514044 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1099243-b17c-494e-9bfc-2636f417f042 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:19:25.514349 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1099243-b17c-494e-9bfc-2636f417f042 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:25.516329 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1099243-b17c-494e-9bfc-2636f417f042 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:25.520877 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 639/1292] 10.222.0.42 () {56 vars in 1116 bytes} [Tue Aug 2 15:19:25 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:19:27.557580 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d58b1-1749-478c-b3a9-b3a515d164c1 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:27.558115 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d58b1-1749-478c-b3a9-b3a515d164c1 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:27.558115 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d58b1-1749-478c-b3a9-b3a515d164c1 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:27.559525 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 654/1293] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:19:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:19:27.566782 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d526e-32c5-4f7b-bba4-df957bf6ec15 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:27.567282 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d526e-32c5-4f7b-bba4-df957bf6ec15 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:27.567427 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d526e-32c5-4f7b-bba4-df957bf6ec15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:27.585756 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-9e4d526e-32c5-4f7b-bba4-df957bf6ec15 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:19:27.586938 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-9e4d526e-32c5-4f7b-bba4-df957bf6ec15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:19:27.615451 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:19:27.653187 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 640/1294] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:19:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 15:19:27.676553 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197d58b1-1749-478c-b3a9-b3a515d164c1 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:27.708448 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:19:27.780841 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197d58b1-1749-478c-b3a9-b3a515d164c1 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:27.815628 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c12a623-1767-4ff7-9ddd-91396fc69de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:27.816196 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c12a623-1767-4ff7-9ddd-91396fc69de8 None admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:27.816513 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c12a623-1767-4ff7-9ddd-91396fc69de8 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:27.816852 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c12a623-1767-4ff7-9ddd-91396fc69de8 None admin] PATH_INFO: `/v3/services` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:27.817574 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c12a623-1767-4ff7-9ddd-91396fc69de8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:27.819033 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c12a623-1767-4ff7-9ddd-91396fc69de8 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:27.835404 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 655/1295] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Aug 2 15:19:27 2022] POST /identity/v3/services => generated 246 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 15:19:29.885406 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a8530-3294-4993-9061-2be5fd2010af None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:29.885979 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a8530-3294-4993-9061-2be5fd2010af None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:29.885979 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a8530-3294-4993-9061-2be5fd2010af None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:29.887425 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 641/1296] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:19:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:19:29.893587 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1ed84-87e9-41b7-9d6c-56802cfcc552 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:29.894279 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1ed84-87e9-41b7-9d6c-56802cfcc552 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:29.894521 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1ed84-87e9-41b7-9d6c-56802cfcc552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:29.913044 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-61b1ed84-87e9-41b7-9d6c-56802cfcc552 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:19:29.914233 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-61b1ed84-87e9-41b7-9d6c-56802cfcc552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:19:29.986935 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 656/1297] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:19:29 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 15:19:30.010207 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a8530-3294-4993-9061-2be5fd2010af None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:30.112566 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a8530-3294-4993-9061-2be5fd2010af None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:30.148222 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb5e923-3c29-4fcf-b4e0-e3af00fff601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:30.148751 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb5e923-3c29-4fcf-b4e0-e3af00fff601 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:30.149035 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb5e923-3c29-4fcf-b4e0-e3af00fff601 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:30.149312 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb5e923-3c29-4fcf-b4e0-e3af00fff601 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:30.149939 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb5e923-3c29-4fcf-b4e0-e3af00fff601 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:30.151340 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb5e923-3c29-4fcf-b4e0-e3af00fff601 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:30.160422 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-bbb5e923-3c29-4fcf-b4e0-e3af00fff601 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 15:19:30.160422 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:19:30.160422 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 15:19:30.160422 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 15:19:30.160422 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 15:19:30.160422 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 15:19:30.160422 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 15:19:30.160422 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 15:19:30.160422 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 15:19:30.160422 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:19:30.160422 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 15:19:30.160422 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:19:30.160422 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:19:30.160422 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:19:30.160422 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:19:30.160422 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:19:30.160422 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:19:30.161590 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:19:30.161590 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:19:30.161590 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:19:30.161590 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:19:30.161590 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:19:30.161590 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:19:30.161590 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 15:19:30.161590 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 15:19:30.161590 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 15:19:30.161590 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 15:19:30.161590 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:19:30.161590 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:19:30.161590 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:19:30.161590 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:19:30.161590 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:19:30.161590 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:19:30.162659 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:19:30.162659 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:19:30.162659 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:19:30.162659 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:19:30.162659 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:19:30.162659 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:19:30.162659 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:19:30.162659 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:19:30.162659 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:19:30.162659 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:19:30.162659 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 15:19:30.162659 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 15:19:30.162659 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 15:19:30.162659 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:19:30.167027 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 642/1298] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Aug 2 15:19:30 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:19:30.168513 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b1ed84-87e9-41b7-9d6c-56802cfcc552 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:30.189976 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:19:30.272539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b1ed84-87e9-41b7-9d6c-56802cfcc552 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:30.307785 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc72d1e4-a058-411c-a222-f61305e924bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:30.308396 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72d1e4-a058-411c-a222-f61305e924bb None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:30.308676 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72d1e4-a058-411c-a222-f61305e924bb None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:30.308946 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72d1e4-a058-411c-a222-f61305e924bb None admin] PATH_INFO: `/v3/services` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:30.309616 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc72d1e4-a058-411c-a222-f61305e924bb None admin] RBAC: Adding query filter params (name=placement) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:19:30.309915 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc72d1e4-a058-411c-a222-f61305e924bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:30.311305 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc72d1e4-a058-411c-a222-f61305e924bb None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:30.317193 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 657/1299] 10.222.0.42 () {56 vars in 1116 bytes} [Tue Aug 2 15:19:30 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:19:30.323944 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb5e923-3c29-4fcf-b4e0-e3af00fff601 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:30.359406 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:19:30.432221 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb5e923-3c29-4fcf-b4e0-e3af00fff601 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:30.467477 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928030cc-477c-428d-b276-c682357fd9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:30.468124 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928030cc-477c-428d-b276-c682357fd9b2 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:30.468402 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928030cc-477c-428d-b276-c682357fd9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:30.468681 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928030cc-477c-428d-b276-c682357fd9b2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:30.469426 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928030cc-477c-428d-b276-c682357fd9b2 None admin] RBAC: Adding query filter params (interface=public, service_id=493a4ff080db43878651212d4739f9a9, region_id=RegionOne) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:19:30.469740 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928030cc-477c-428d-b276-c682357fd9b2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:30.471108 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928030cc-477c-428d-b276-c682357fd9b2 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:30.476142 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 643/1300] 10.222.0.42 () {56 vars in 1251 bytes} [Tue Aug 2 15:19:30 2022] GET /identity/v3/endpoints?service_id=493a4ff080db43878651212d4739f9a9&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:19:30.482015 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc72d1e4-a058-411c-a222-f61305e924bb None admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:30.573988 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:19:30.592320 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc72d1e4-a058-411c-a222-f61305e924bb None admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:30.626579 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e54ba-a7e6-4c78-b805-9142342ea1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:30.627185 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e54ba-a7e6-4c78-b805-9142342ea1c8 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:30.627498 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e54ba-a7e6-4c78-b805-9142342ea1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:30.627773 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e54ba-a7e6-4c78-b805-9142342ea1c8 None admin] PATH_INFO: `/v3/services` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:30.628418 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97e54ba-a7e6-4c78-b805-9142342ea1c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:30.629784 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97e54ba-a7e6-4c78-b805-9142342ea1c8 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:30.636447 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 658/1301] 10.222.0.42 () {56 vars in 1087 bytes} [Tue Aug 2 15:19:30 2022] GET /identity/v3/services => generated 2191 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 15:19:32.841426 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2794c5b-43ff-4b17-b932-9b8dce97f185 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:32.841997 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2794c5b-43ff-4b17-b932-9b8dce97f185 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:32.841997 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2794c5b-43ff-4b17-b932-9b8dce97f185 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:32.843868 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 644/1302] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:19:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:19:32.849044 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951875f2-a23d-494c-b96f-0c8971c40b94 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:32.849461 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951875f2-a23d-494c-b96f-0c8971c40b94 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:32.849599 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951875f2-a23d-494c-b96f-0c8971c40b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:32.867848 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-951875f2-a23d-494c-b96f-0c8971c40b94 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:19:32.869016 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-951875f2-a23d-494c-b96f-0c8971c40b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:19:32.936122 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 659/1303] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:19:32 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 15:19:32.958490 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2794c5b-43ff-4b17-b932-9b8dce97f185 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:33.054492 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:19:33.062008 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2794c5b-43ff-4b17-b932-9b8dce97f185 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:33.097067 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b9b739-d084-4ebc-96a0-bd8be5839543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:33.097615 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9b739-d084-4ebc-96a0-bd8be5839543 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:33.097894 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9b739-d084-4ebc-96a0-bd8be5839543 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:33.098164 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9b739-d084-4ebc-96a0-bd8be5839543 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:33.098826 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b9b739-d084-4ebc-96a0-bd8be5839543 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:33.100238 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b9b739-d084-4ebc-96a0-bd8be5839543 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:33.109307 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-48b9b739-d084-4ebc-96a0-bd8be5839543 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 15:19:33.109307 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:19:33.109307 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 15:19:33.109307 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 15:19:33.109307 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 15:19:33.109307 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 15:19:33.109307 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 15:19:33.109307 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 15:19:33.109307 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 15:19:33.109307 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:19:33.109307 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 15:19:33.109307 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:19:33.109307 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 15:19:33.109307 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 15:19:33.109307 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 15:19:33.109307 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 15:19:33.109307 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 15:19:33.111291 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 15:19:33.111291 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 15:19:33.111291 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 15:19:33.111291 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 15:19:33.111291 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 15:19:33.111291 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 15:19:33.111291 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 15:19:33.111291 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 15:19:33.111291 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 15:19:33.111291 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 15:19:33.111291 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 15:19:33.111291 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 15:19:33.111291 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 15:19:33.111291 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 15:19:33.111291 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 15:19:33.111291 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 15:19:33.112421 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 15:19:33.112421 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Aug 02 15:19:33.112421 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 15:19:33.112421 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Aug 02 15:19:33.112421 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 15:19:33.112421 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 15:19:33.112421 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 15:19:33.112421 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Aug 02 15:19:33.112421 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 15:19:33.112421 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Aug 02 15:19:33.112421 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 15:19:33.112421 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 15:19:33.112421 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 15:19:33.112421 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Aug 02 15:19:33.112421 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 645/1304] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Aug 2 15:19:32 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 15:19:33.117096 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951875f2-a23d-494c-b96f-0c8971c40b94 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:33.192776 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:19:33.217409 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951875f2-a23d-494c-b96f-0c8971c40b94 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:33.258169 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9366fd-8f10-475a-b9f3-3aa4349b4360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:33.258883 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9366fd-8f10-475a-b9f3-3aa4349b4360 None admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:33.259197 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9366fd-8f10-475a-b9f3-3aa4349b4360 None admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:33.259485 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9366fd-8f10-475a-b9f3-3aa4349b4360 None admin] PATH_INFO: `/v3/services` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:33.260184 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9366fd-8f10-475a-b9f3-3aa4349b4360 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:19:33.260494 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9366fd-8f10-475a-b9f3-3aa4349b4360 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:33.261885 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9366fd-8f10-475a-b9f3-3aa4349b4360 None admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:33.268607 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 660/1305] 10.222.0.42 () {56 vars in 1116 bytes} [Tue Aug 2 15:19:33 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:19:33.275476 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b9b739-d084-4ebc-96a0-bd8be5839543 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:19:33.399686 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b9b739-d084-4ebc-96a0-bd8be5839543 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:19:33.437591 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a10532-a62c-43c7-8ed9-23eec0be2324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:19:33.438205 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a10532-a62c-43c7-8ed9-23eec0be2324 None admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:19:33.438484 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a10532-a62c-43c7-8ed9-23eec0be2324 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:19:33.438758 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a10532-a62c-43c7-8ed9-23eec0be2324 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:19:33.439506 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a10532-a62c-43c7-8ed9-23eec0be2324 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:19:33.440880 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a10532-a62c-43c7-8ed9-23eec0be2324 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:19:33.462388 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 646/1306] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:19:33 2022] POST /identity/v3/endpoints => generated 331 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:19:43.265542 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=30 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:19:43.457510 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:20:41.864370 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d8c7fa-8a9f-418f-ab12-e4cf2411d11d None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:20:41.865187 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d8c7fa-8a9f-418f-ab12-e4cf2411d11d None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:20:41.865187 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d8c7fa-8a9f-418f-ab12-e4cf2411d11d None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:20:41.871576 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 661/1307] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:20:41 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:20:41.874070 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71705b95-833e-4e16-be8c-e1560447390d None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:20:41.874631 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71705b95-833e-4e16-be8c-e1560447390d None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:20:41.875000 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71705b95-833e-4e16-be8c-e1560447390d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:20:42.070145 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-71705b95-833e-4e16-be8c-e1560447390d None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:20:42.070145 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-71705b95-833e-4e16-be8c-e1560447390d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:20:42.296536 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 647/1308] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:20:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:20:42.348412 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bbec5a-b50f-404a-80f7-fb447e2e618c None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:20:42.348911 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bbec5a-b50f-404a-80f7-fb447e2e618c None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:20:42.349412 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bbec5a-b50f-404a-80f7-fb447e2e618c None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:20:42.353262 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 662/1309] 10.222.0.42 () {54 vars in 965 bytes} [Tue Aug 2 15:20:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 15:20:42.363900 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa94e8-f72e-4a7c-8ea9-2d1dc830cba7 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:20:42.364678 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa94e8-f72e-4a7c-8ea9-2d1dc830cba7 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:20:42.365289 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa94e8-f72e-4a7c-8ea9-2d1dc830cba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:20:42.523723 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-08aa94e8-f72e-4a7c-8ea9-2d1dc830cba7 None None] MFA Rules not processed for user `f6d1caa34f2b41bfbcc95fa58d85f004`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:20:42.526248 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-08aa94e8-f72e-4a7c-8ea9-2d1dc830cba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:20:42.573061 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:20:42.697589 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 648/1310] 10.222.0.42 () {58 vars in 1062 bytes} [Tue Aug 2 15:20:42 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:20:42.714204 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bbec5a-b50f-404a-80f7-fb447e2e618c None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:20:42.718327 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-84bbec5a-b50f-404a-80f7-fb447e2e618c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:20:42.968933 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bbec5a-b50f-404a-80f7-fb447e2e618c None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:20:43.152401 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4224a-e1b6-4dfc-bfb1-7a6a5086554c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:20:43.154252 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4224a-e1b6-4dfc-bfb1-7a6a5086554c service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:20:43.154749 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4224a-e1b6-4dfc-bfb1-7a6a5086554c service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:20:43.155305 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4224a-e1b6-4dfc-bfb1-7a6a5086554c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:20:43.159136 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-38b4224a-e1b6-4dfc-bfb1-7a6a5086554c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:20:43.310691 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:20:43.428842 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4224a-e1b6-4dfc-bfb1-7a6a5086554c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:20:43.431594 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4224a-e1b6-4dfc-bfb1-7a6a5086554c service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:20:43.470297 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 663/1311] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:20:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 757 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:20:47.311428 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a67c83-b051-4ca9-a54e-bf61e8a9c317 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:20:47.312188 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a67c83-b051-4ca9-a54e-bf61e8a9c317 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:20:47.312188 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a67c83-b051-4ca9-a54e-bf61e8a9c317 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:20:47.313690 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 649/1312] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:20:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 15:20:47.323552 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d7826-6b53-4471-9723-915331e3a5a4 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:20:47.324159 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d7826-6b53-4471-9723-915331e3a5a4 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:20:47.324741 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d7826-6b53-4471-9723-915331e3a5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:20:47.422528 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-e78d7826-6b53-4471-9723-915331e3a5a4 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:20:47.423714 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-e78d7826-6b53-4471-9723-915331e3a5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:20:47.597413 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 664/1313] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:20:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:20:47.663362 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a67c83-b051-4ca9-a54e-bf61e8a9c317 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:20:47.664975 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-85a67c83-b051-4ca9-a54e-bf61e8a9c317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:20:47.854916 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a67c83-b051-4ca9-a54e-bf61e8a9c317 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:20:47.954924 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:20:47.958751 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d9aee-d2db-4acb-8e43-e910b14d28c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:20:47.959635 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d9aee-d2db-4acb-8e43-e910b14d28c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:20:47.960357 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d9aee-d2db-4acb-8e43-e910b14d28c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:20:47.960773 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d9aee-d2db-4acb-8e43-e910b14d28c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:20:47.963566 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-ec3d9aee-d2db-4acb-8e43-e910b14d28c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:20:48.137954 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3d9aee-d2db-4acb-8e43-e910b14d28c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:20:48.140853 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3d9aee-d2db-4acb-8e43-e910b14d28c4 service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:20:48.177133 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 650/1314] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:20:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 15:20:50.750181 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15fd2d-ba60-4956-84f6-c34cfeadc878 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:20:50.750845 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15fd2d-ba60-4956-84f6-c34cfeadc878 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:20:50.750845 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15fd2d-ba60-4956-84f6-c34cfeadc878 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:20:50.752254 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 665/1315] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:20:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:20:50.758226 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e5540-5e4d-4e24-ae10-486780d7a7b9 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:20:50.758874 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e5540-5e4d-4e24-ae10-486780d7a7b9 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:20:50.758874 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e5540-5e4d-4e24-ae10-486780d7a7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:20:50.839576 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-3a6e5540-5e4d-4e24-ae10-486780d7a7b9 None None] MFA Rules not processed for user `c6226fdf121845309b74b8c58d113534`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:20:50.841353 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-3a6e5540-5e4d-4e24-ae10-486780d7a7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:20:50.903814 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:20:50.963732 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 651/1316] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:20:50 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:20:51.012646 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15fd2d-ba60-4956-84f6-c34cfeadc878 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:20:51.014237 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-cd15fd2d-ba60-4956-84f6-c34cfeadc878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:20:51.025114 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:20:51.140537 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15fd2d-ba60-4956-84f6-c34cfeadc878 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:20:51.237176 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e10ba-9d28-4a75-b8fa-6858bdc98794 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:20:51.237895 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e10ba-9d28-4a75-b8fa-6858bdc98794 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:20:51.238219 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e10ba-9d28-4a75-b8fa-6858bdc98794 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:20:51.238536 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e10ba-9d28-4a75-b8fa-6858bdc98794 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:20:51.240690 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-6f6e10ba-9d28-4a75-b8fa-6858bdc98794 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:20:51.320519 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:20:51.377954 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6e10ba-9d28-4a75-b8fa-6858bdc98794 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:20:51.379907 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6e10ba-9d28-4a75-b8fa-6858bdc98794 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:20:51.403002 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 666/1317] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:20:51 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:20:54.305111 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf88a7b-c9ae-499e-9c4c-943dd4001729 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:20:54.305716 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf88a7b-c9ae-499e-9c4c-943dd4001729 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:20:54.305896 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf88a7b-c9ae-499e-9c4c-943dd4001729 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:20:54.307710 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 652/1318] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:20:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:20:54.313860 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9f898-82ea-48bf-8dad-db9b0774cccd None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:20:54.314421 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9f898-82ea-48bf-8dad-db9b0774cccd None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:20:54.314552 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9f898-82ea-48bf-8dad-db9b0774cccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:20:54.400487 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-18f9f898-82ea-48bf-8dad-db9b0774cccd None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:20:54.401770 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-18f9f898-82ea-48bf-8dad-db9b0774cccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:20:54.524589 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 667/1319] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:20:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:20:54.566504 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf88a7b-c9ae-499e-9c4c-943dd4001729 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:20:54.568187 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-ecf88a7b-c9ae-499e-9c4c-943dd4001729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:20:54.692005 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf88a7b-c9ae-499e-9c4c-943dd4001729 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:20:54.788191 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b87235-1c65-49c5-af47-6950e09a185b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:20:54.788830 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b87235-1c65-49c5-af47-6950e09a185b service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:20:54.789167 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b87235-1c65-49c5-af47-6950e09a185b service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:20:54.789497 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b87235-1c65-49c5-af47-6950e09a185b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:20:54.791603 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-d4b87235-1c65-49c5-af47-6950e09a185b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:20:54.800657 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:20:54.938401 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b87235-1c65-49c5-af47-6950e09a185b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:20:54.940174 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b87235-1c65-49c5-af47-6950e09a185b service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:20:54.962263 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 653/1320] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:20:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 15:20:57.948971 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238f274-73b9-40c7-9791-8a44aa3cfd59 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:20:57.949758 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238f274-73b9-40c7-9791-8a44aa3cfd59 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:20:57.949758 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238f274-73b9-40c7-9791-8a44aa3cfd59 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:20:57.951653 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 668/1321] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:20:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:20:57.957859 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0fbf65-0909-4260-b213-64e4250d720b None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:20:57.958419 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0fbf65-0909-4260-b213-64e4250d720b None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:20:57.958517 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0fbf65-0909-4260-b213-64e4250d720b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:20:58.036861 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-3c0fbf65-0909-4260-b213-64e4250d720b None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:20:58.038133 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-3c0fbf65-0909-4260-b213-64e4250d720b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:20:58.111475 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:20:58.167252 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 654/1322] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:20:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:20:58.237560 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c7529-8e89-4b97-b271-cfdabd30405c None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:20:58.238168 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c7529-8e89-4b97-b271-cfdabd30405c None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:20:58.238744 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c7529-8e89-4b97-b271-cfdabd30405c None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:20:58.241127 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 669/1323] 10.222.0.42 () {54 vars in 965 bytes} [Tue Aug 2 15:20:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:20:58.249184 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252b5b5-4aa4-4f0d-b44e-183aaffd7733 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:20:58.249470 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252b5b5-4aa4-4f0d-b44e-183aaffd7733 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:20:58.249806 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252b5b5-4aa4-4f0d-b44e-183aaffd7733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:20:58.361685 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-1252b5b5-4aa4-4f0d-b44e-183aaffd7733 None None] MFA Rules not processed for user `f6d1caa34f2b41bfbcc95fa58d85f004`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:20:58.363196 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-1252b5b5-4aa4-4f0d-b44e-183aaffd7733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:20:58.488393 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 655/1324] 10.222.0.42 () {58 vars in 1062 bytes} [Tue Aug 2 15:20:58 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:20:58.499709 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c7529-8e89-4b97-b271-cfdabd30405c None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:20:58.501658 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-b46c7529-8e89-4b97-b271-cfdabd30405c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:20:58.527572 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:20:58.636014 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c7529-8e89-4b97-b271-cfdabd30405c None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:20:58.725863 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28998d0f-c487-4cd7-9f4c-ee27d1799b27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:20:58.726541 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28998d0f-c487-4cd7-9f4c-ee27d1799b27 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:20:58.726881 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28998d0f-c487-4cd7-9f4c-ee27d1799b27 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:20:58.727359 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28998d0f-c487-4cd7-9f4c-ee27d1799b27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:20:58.729190 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-28998d0f-c487-4cd7-9f4c-ee27d1799b27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:20:58.814404 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:20:58.864646 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28998d0f-c487-4cd7-9f4c-ee27d1799b27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:20:58.866313 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28998d0f-c487-4cd7-9f4c-ee27d1799b27 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:20:58.889451 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 670/1325] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:20:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 15:21:01.845708 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0b474-fef0-466f-8f3f-efcda4bf478a None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:21:01.846342 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0b474-fef0-466f-8f3f-efcda4bf478a None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:21:01.846342 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0b474-fef0-466f-8f3f-efcda4bf478a None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:21:01.847766 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 656/1326] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:21:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:21:01.853705 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec7299-059f-4375-8be2-857dbad1000a None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:21:01.854264 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec7299-059f-4375-8be2-857dbad1000a None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:21:01.854264 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec7299-059f-4375-8be2-857dbad1000a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:21:01.950418 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-42ec7299-059f-4375-8be2-857dbad1000a None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:21:01.951830 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-42ec7299-059f-4375-8be2-857dbad1000a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:21:02.079792 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 671/1327] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:21:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:21:02.119967 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0b474-fef0-466f-8f3f-efcda4bf478a None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:21:02.122300 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-41e0b474-fef0-466f-8f3f-efcda4bf478a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:21:02.200864 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:21:02.285910 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0b474-fef0-466f-8f3f-efcda4bf478a None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:21:02.392618 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20948c1e-fb86-4cf5-82d7-c087ff0ab98c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:21:02.393259 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20948c1e-fb86-4cf5-82d7-c087ff0ab98c service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:21:02.393542 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20948c1e-fb86-4cf5-82d7-c087ff0ab98c service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:21:02.393819 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20948c1e-fb86-4cf5-82d7-c087ff0ab98c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:21:02.395622 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-20948c1e-fb86-4cf5-82d7-c087ff0ab98c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:21:02.529952 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:21:02.535319 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20948c1e-fb86-4cf5-82d7-c087ff0ab98c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:21:02.538661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20948c1e-fb86-4cf5-82d7-c087ff0ab98c service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:21:02.575353 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 657/1328] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:21:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:21:05.164508 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd8c35-248c-49a9-86d2-91af8faf4d1b None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:21:05.165032 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd8c35-248c-49a9-86d2-91af8faf4d1b None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:21:05.165517 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd8c35-248c-49a9-86d2-91af8faf4d1b None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:21:05.168325 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 672/1329] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:21:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:21:05.175179 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40daefb-9561-4be2-afa0-f3cf4633e719 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:21:05.175740 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40daefb-9561-4be2-afa0-f3cf4633e719 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:21:05.176207 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40daefb-9561-4be2-afa0-f3cf4633e719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:21:05.273236 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-a40daefb-9561-4be2-afa0-f3cf4633e719 None None] MFA Rules not processed for user `c6226fdf121845309b74b8c58d113534`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:21:05.274513 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-a40daefb-9561-4be2-afa0-f3cf4633e719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:21:05.388273 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 658/1330] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:21:05 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:21:05.429456 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd8c35-248c-49a9-86d2-91af8faf4d1b None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:21:05.431321 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-b1dd8c35-248c-49a9-86d2-91af8faf4d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:21:05.469822 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:21:05.582183 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd8c35-248c-49a9-86d2-91af8faf4d1b None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:21:05.680891 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde29432-82e6-4643-884f-1052f813646d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:21:05.682266 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde29432-82e6-4643-884f-1052f813646d service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:21:05.682556 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde29432-82e6-4643-884f-1052f813646d service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:21:05.683128 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde29432-82e6-4643-884f-1052f813646d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:21:05.687048 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-dde29432-82e6-4643-884f-1052f813646d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:21:05.797785 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:21:05.854911 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde29432-82e6-4643-884f-1052f813646d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:21:05.857199 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde29432-82e6-4643-884f-1052f813646d service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:21:05.879668 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 673/1331] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:21:05 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:21:08.340894 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041e025-ca01-4b73-a5c0-1f0bd7b1d0b6 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:21:08.341555 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041e025-ca01-4b73-a5c0-1f0bd7b1d0b6 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:21:08.341555 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041e025-ca01-4b73-a5c0-1f0bd7b1d0b6 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:21:08.343489 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 659/1332] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:21:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:21:08.349455 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253d128-b328-4880-b712-7d383123397c None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:21:08.350175 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253d128-b328-4880-b712-7d383123397c None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:21:08.350175 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253d128-b328-4880-b712-7d383123397c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:21:08.482483 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-b253d128-b328-4880-b712-7d383123397c None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:21:08.484740 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-b253d128-b328-4880-b712-7d383123397c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:21:08.632738 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 674/1333] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:21:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:21:08.686359 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f041e025-ca01-4b73-a5c0-1f0bd7b1d0b6 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:21:08.689196 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-f041e025-ca01-4b73-a5c0-1f0bd7b1d0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:21:08.815854 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:21:08.868696 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f041e025-ca01-4b73-a5c0-1f0bd7b1d0b6 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:21:08.963549 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8523de-ce6b-4d16-aeea-4218222d4ab1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:21:08.964202 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8523de-ce6b-4d16-aeea-4218222d4ab1 service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:21:08.964480 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8523de-ce6b-4d16-aeea-4218222d4ab1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:21:08.964761 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8523de-ce6b-4d16-aeea-4218222d4ab1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:21:08.967062 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-8e8523de-ce6b-4d16-aeea-4218222d4ab1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:21:09.094109 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8523de-ce6b-4d16-aeea-4218222d4ab1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:21:09.095623 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8523de-ce6b-4d16-aeea-4218222d4ab1 service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:21:09.107955 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:21:09.122909 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 660/1334] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:21:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:21:11.316164 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dbb344-d4d1-40a7-bdb4-76c9304eedf4 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:21:11.317030 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dbb344-d4d1-40a7-bdb4-76c9304eedf4 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:21:11.317030 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dbb344-d4d1-40a7-bdb4-76c9304eedf4 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:21:11.318154 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 675/1335] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:21:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:21:11.324141 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d72e6-a384-4d65-9373-3a656c5d06b1 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:21:11.325216 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d72e6-a384-4d65-9373-3a656c5d06b1 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:21:11.325216 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d72e6-a384-4d65-9373-3a656c5d06b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:21:11.400447 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-5c9d72e6-a384-4d65-9373-3a656c5d06b1 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:21:11.401660 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-5c9d72e6-a384-4d65-9373-3a656c5d06b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:21:11.506748 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 661/1336] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:21:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:21:11.549133 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dbb344-d4d1-40a7-bdb4-76c9304eedf4 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:21:11.551011 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-b9dbb344-d4d1-40a7-bdb4-76c9304eedf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:21:11.600450 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:21:11.682093 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dbb344-d4d1-40a7-bdb4-76c9304eedf4 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:21:11.767692 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5dae55-1b07-4c30-8044-a1512ff1e423 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:21:11.768233 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5dae55-1b07-4c30-8044-a1512ff1e423 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:21:11.768517 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5dae55-1b07-4c30-8044-a1512ff1e423 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:21:11.768799 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5dae55-1b07-4c30-8044-a1512ff1e423 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:21:11.770488 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-8f5dae55-1b07-4c30-8044-a1512ff1e423 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:21:11.871713 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:21:11.900488 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5dae55-1b07-4c30-8044-a1512ff1e423 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:21:11.901977 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5dae55-1b07-4c30-8044-a1512ff1e423 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:21:11.924121 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 676/1337] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:21:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:21:14.491736 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711cf71-a28d-4cc1-815a-9f8151483bc8 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:21:14.492442 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711cf71-a28d-4cc1-815a-9f8151483bc8 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:21:14.492442 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711cf71-a28d-4cc1-815a-9f8151483bc8 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:21:14.493671 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 662/1338] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:21:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:21:14.500081 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e758e-3bfd-482a-b889-11d827c7b29a None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:21:14.500611 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e758e-3bfd-482a-b889-11d827c7b29a None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:21:14.500759 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e758e-3bfd-482a-b889-11d827c7b29a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:21:14.579025 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-890e758e-3bfd-482a-b889-11d827c7b29a None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:21:14.580429 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-890e758e-3bfd-482a-b889-11d827c7b29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:21:14.711742 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 677/1339] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:21:14 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:21:14.748919 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1711cf71-a28d-4cc1-815a-9f8151483bc8 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:21:14.750484 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-1711cf71-a28d-4cc1-815a-9f8151483bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:21:14.841011 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:21:14.873065 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1711cf71-a28d-4cc1-815a-9f8151483bc8 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:21:14.962486 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6139ba1a-3593-4938-adfc-331182d87154 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:21:14.963253 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6139ba1a-3593-4938-adfc-331182d87154 service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:21:14.963519 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6139ba1a-3593-4938-adfc-331182d87154 service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:21:14.963796 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6139ba1a-3593-4938-adfc-331182d87154 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:21:14.966080 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-6139ba1a-3593-4938-adfc-331182d87154 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:21:15.110581 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6139ba1a-3593-4938-adfc-331182d87154 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:21:15.112154 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6139ba1a-3593-4938-adfc-331182d87154 service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:21:15.132676 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 663/1340] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:21:14 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 15:21:20.048073 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbceb06e-febe-4a7b-b31c-dcbaa11a8164 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:21:20.048719 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbceb06e-febe-4a7b-b31c-dcbaa11a8164 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:21:20.049086 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbceb06e-febe-4a7b-b31c-dcbaa11a8164 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:21:20.051057 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 678/1341] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:21:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:21:20.057498 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e0543-9b18-4357-8271-ef88ed3107a4 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:21:20.058725 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e0543-9b18-4357-8271-ef88ed3107a4 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:21:20.058725 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e0543-9b18-4357-8271-ef88ed3107a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:21:20.064197 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:21:20.140574 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-be9e0543-9b18-4357-8271-ef88ed3107a4 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:21:20.142265 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-be9e0543-9b18-4357-8271-ef88ed3107a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:21:20.257923 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 664/1342] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:21:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:21:20.298648 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbceb06e-febe-4a7b-b31c-dcbaa11a8164 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:21:20.301495 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-bbceb06e-febe-4a7b-b31c-dcbaa11a8164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:21:20.357332 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:21:20.418646 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbceb06e-febe-4a7b-b31c-dcbaa11a8164 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:21:20.500260 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e977585-94db-4e4b-a9d6-ad0a3b8c9c72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:21:20.500895 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e977585-94db-4e4b-a9d6-ad0a3b8c9c72 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:21:20.501172 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e977585-94db-4e4b-a9d6-ad0a3b8c9c72 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:21:20.501446 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e977585-94db-4e4b-a9d6-ad0a3b8c9c72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:21:20.503342 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-0e977585-94db-4e4b-a9d6-ad0a3b8c9c72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:21:20.608794 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:21:20.626439 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e977585-94db-4e4b-a9d6-ad0a3b8c9c72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:21:20.628128 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e977585-94db-4e4b-a9d6-ad0a3b8c9c72 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:21:20.647805 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 679/1343] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:21:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:21:23.806232 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779be689-f33d-4e34-a6ab-0e5e524fc5f0 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:21:23.806949 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779be689-f33d-4e34-a6ab-0e5e524fc5f0 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:21:23.806949 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779be689-f33d-4e34-a6ab-0e5e524fc5f0 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:21:23.808206 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 665/1344] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:21:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:21:23.814247 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0b821-6a70-4654-9d5d-ef06fc0a104d None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:21:23.814847 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0b821-6a70-4654-9d5d-ef06fc0a104d None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:21:23.814982 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0b821-6a70-4654-9d5d-ef06fc0a104d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:21:23.904332 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-f2f0b821-6a70-4654-9d5d-ef06fc0a104d None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:21:23.905573 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-f2f0b821-6a70-4654-9d5d-ef06fc0a104d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:21:24.057401 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 680/1345] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:21:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:21:24.099187 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779be689-f33d-4e34-a6ab-0e5e524fc5f0 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:21:24.102149 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-779be689-f33d-4e34-a6ab-0e5e524fc5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:21:24.249396 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:21:24.282160 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779be689-f33d-4e34-a6ab-0e5e524fc5f0 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:21:24.412292 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f955f075-e20b-4e6f-b8c9-a10e92e7df10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:21:24.412920 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f955f075-e20b-4e6f-b8c9-a10e92e7df10 service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:21:24.413205 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f955f075-e20b-4e6f-b8c9-a10e92e7df10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:21:24.413480 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f955f075-e20b-4e6f-b8c9-a10e92e7df10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:21:24.415182 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-f955f075-e20b-4e6f-b8c9-a10e92e7df10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:21:24.551394 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f955f075-e20b-4e6f-b8c9-a10e92e7df10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:21:24.552902 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f955f075-e20b-4e6f-b8c9-a10e92e7df10 service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:21:24.573452 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 666/1346] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:21:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 15:21:29.238952 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d1708-8df2-4c2e-90bc-d444c28c9be4 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:21:29.239548 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d1708-8df2-4c2e-90bc-d444c28c9be4 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:21:29.239682 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d1708-8df2-4c2e-90bc-d444c28c9be4 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:21:29.241111 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 681/1347] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:21:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:21:29.246965 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781c51a-4fc1-44bc-9a51-6bc4c9a49de2 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:21:29.249106 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781c51a-4fc1-44bc-9a51-6bc4c9a49de2 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:21:29.249106 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781c51a-4fc1-44bc-9a51-6bc4c9a49de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:21:29.265694 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:21:29.347692 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-0781c51a-4fc1-44bc-9a51-6bc4c9a49de2 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:21:29.348948 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-0781c51a-4fc1-44bc-9a51-6bc4c9a49de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:21:29.481697 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 667/1348] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:21:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:21:29.520946 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203d1708-8df2-4c2e-90bc-d444c28c9be4 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:21:29.522499 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-203d1708-8df2-4c2e-90bc-d444c28c9be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:21:29.594410 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:21:29.674612 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203d1708-8df2-4c2e-90bc-d444c28c9be4 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:21:29.772282 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f0dc9-2f4a-44aa-9a4a-256fe2527830 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:21:29.772810 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f0dc9-2f4a-44aa-9a4a-256fe2527830 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:21:29.773092 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f0dc9-2f4a-44aa-9a4a-256fe2527830 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:21:29.773368 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f0dc9-2f4a-44aa-9a4a-256fe2527830 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:21:29.775119 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-e13f0dc9-2f4a-44aa-9a4a-256fe2527830 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:21:29.934308 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:21:29.941998 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13f0dc9-2f4a-44aa-9a4a-256fe2527830 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:21:29.944828 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13f0dc9-2f4a-44aa-9a4a-256fe2527830 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:21:29.978989 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 682/1349] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:21:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:21:35.466106 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056bcfa9-1842-44ab-b39d-ea4e2985970a None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:21:35.466620 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056bcfa9-1842-44ab-b39d-ea4e2985970a None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:21:35.466735 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056bcfa9-1842-44ab-b39d-ea4e2985970a None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:21:35.468203 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 668/1350] 10.222.0.42 () {54 vars in 921 bytes} [Tue Aug 2 15:21:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:21:35.474553 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e20f04-b993-4b99-9e8a-bb5f1c0ba869 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:21:35.475095 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e20f04-b993-4b99-9e8a-bb5f1c0ba869 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:21:35.475709 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e20f04-b993-4b99-9e8a-bb5f1c0ba869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:21:35.612598 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-e1e20f04-b993-4b99-9e8a-bb5f1c0ba869 None None] MFA Rules not processed for user `57dfafee636a45ca98fe0e8bb13dd754`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:21:35.612598 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-e1e20f04-b993-4b99-9e8a-bb5f1c0ba869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:21:35.831863 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 683/1351] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Aug 2 15:21:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:21:39.478864 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=59 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:21:41.041423 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2885ff1f-72de-4fb4-a4c2-e2599ad56155 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:21:41.042222 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2885ff1f-72de-4fb4-a4c2-e2599ad56155 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:21:41.042781 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2885ff1f-72de-4fb4-a4c2-e2599ad56155 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:21:41.045290 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 669/1352] 10.222.0.42 () {54 vars in 921 bytes} [Tue Aug 2 15:21:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:21:41.051668 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0c41e-e461-4575-adbb-552adf01176c None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:21:41.052236 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0c41e-e461-4575-adbb-552adf01176c None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:21:41.052319 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0c41e-e461-4575-adbb-552adf01176c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:21:41.121693 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:21:41.161935 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-21d0c41e-e461-4575-adbb-552adf01176c None None] MFA Rules not processed for user `57dfafee636a45ca98fe0e8bb13dd754`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:21:41.163435 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-21d0c41e-e461-4575-adbb-552adf01176c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:21:41.393069 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 684/1353] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Aug 2 15:21:41 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:21:42.642946 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08b431-fd62-4db0-af30-99eef2ee9036 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:21:42.643820 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08b431-fd62-4db0-af30-99eef2ee9036 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:21:42.643820 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08b431-fd62-4db0-af30-99eef2ee9036 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:21:42.645256 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 670/1354] 10.222.0.42 () {54 vars in 921 bytes} [Tue Aug 2 15:21:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 15:21:42.650534 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62066da-9b09-4de7-beee-328e9b3ce366 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:21:42.652333 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62066da-9b09-4de7-beee-328e9b3ce366 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:21:42.652333 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62066da-9b09-4de7-beee-328e9b3ce366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:21:42.757070 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-a62066da-9b09-4de7-beee-328e9b3ce366 None None] MFA Rules not processed for user `57dfafee636a45ca98fe0e8bb13dd754`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:21:42.758899 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-a62066da-9b09-4de7-beee-328e9b3ce366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:21:42.829804 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:21:42.916460 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 685/1355] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Aug 2 15:21:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:21:46.594817 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4f15d-6720-4277-80d1-0dba974b2363 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:21:46.595538 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4f15d-6720-4277-80d1-0dba974b2363 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:21:46.595719 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4f15d-6720-4277-80d1-0dba974b2363 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:21:46.598409 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 671/1356] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:21:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:21:46.608440 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ee601-e3e6-4044-b388-0911a17f114c None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:21:46.608964 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ee601-e3e6-4044-b388-0911a17f114c None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:21:46.609195 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ee601-e3e6-4044-b388-0911a17f114c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:21:46.747448 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-264ee601-e3e6-4044-b388-0911a17f114c None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:21:46.749574 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-264ee601-e3e6-4044-b388-0911a17f114c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:21:47.003250 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 686/1357] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:21:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:21:47.069407 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4de4d1-dc52-4b16-878d-36ef17ceaa44 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:21:47.070077 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4de4d1-dc52-4b16-878d-36ef17ceaa44 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:21:47.070526 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4de4d1-dc52-4b16-878d-36ef17ceaa44 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:21:47.074381 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 672/1358] 10.222.0.42 () {54 vars in 962 bytes} [Tue Aug 2 15:21:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:21:47.084779 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb41900-fbbf-4152-9606-9e45a9a2a35b None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:21:47.085172 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb41900-fbbf-4152-9606-9e45a9a2a35b None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:21:47.085561 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb41900-fbbf-4152-9606-9e45a9a2a35b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:21:47.112760 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:21:47.203116 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-8eb41900-fbbf-4152-9606-9e45a9a2a35b None None] MFA Rules not processed for user `4c0865af59bf43dfa4c84213d7db53c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:21:47.204389 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-8eb41900-fbbf-4152-9606-9e45a9a2a35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:21:47.353901 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 687/1359] 10.222.0.42 () {58 vars in 1059 bytes} [Tue Aug 2 15:21:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:21:47.361700 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4de4d1-dc52-4b16-878d-36ef17ceaa44 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:21:47.363239 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-3d4de4d1-dc52-4b16-878d-36ef17ceaa44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:21:47.521236 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4de4d1-dc52-4b16-878d-36ef17ceaa44 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:21:47.600854 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:21:47.645565 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e818ae9-955a-4328-9f03-706e1c2395b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0865af59bf43dfa4c84213d7db53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:21:47.646094 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e818ae9-955a-4328-9f03-706e1c2395b8 service nova] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:21:47.646375 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e818ae9-955a-4328-9f03-706e1c2395b8 service nova] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:21:47.646652 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e818ae9-955a-4328-9f03-706e1c2395b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:21:47.648308 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-3e818ae9-955a-4328-9f03-706e1c2395b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:21:47.749524 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e818ae9-955a-4328-9f03-706e1c2395b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:21:47.751635 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e818ae9-955a-4328-9f03-706e1c2395b8 service nova] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:21:47.772727 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 673/1360] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:21:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:21:50.112229 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2e233-5e09-4604-b22e-1d5ebfc6a20b None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:21:50.113009 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2e233-5e09-4604-b22e-1d5ebfc6a20b None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:21:50.113009 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2e233-5e09-4604-b22e-1d5ebfc6a20b None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:21:50.114324 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 688/1361] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:21:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 15:21:50.119814 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3cb31d-abdb-429e-b7fa-60e1d4c6f19f None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:21:50.121143 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3cb31d-abdb-429e-b7fa-60e1d4c6f19f None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:21:50.121143 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3cb31d-abdb-429e-b7fa-60e1d4c6f19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:21:50.216701 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-ee3cb31d-abdb-429e-b7fa-60e1d4c6f19f None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:21:50.217566 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-ee3cb31d-abdb-429e-b7fa-60e1d4c6f19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:21:50.270820 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:21:50.353403 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 674/1362] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:21:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:21:50.399380 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c2e233-5e09-4604-b22e-1d5ebfc6a20b None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:21:50.400782 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-d4c2e233-5e09-4604-b22e-1d5ebfc6a20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:21:50.489044 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:21:50.618392 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c2e233-5e09-4604-b22e-1d5ebfc6a20b None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:21:50.774966 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f4e73d-3083-4458-a7db-3e42d33da410 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0865af59bf43dfa4c84213d7db53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:21:50.775698 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f4e73d-3083-4458-a7db-3e42d33da410 service nova] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:21:50.775698 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f4e73d-3083-4458-a7db-3e42d33da410 service nova] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:21:50.777127 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f4e73d-3083-4458-a7db-3e42d33da410 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:21:50.778575 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-f0f4e73d-3083-4458-a7db-3e42d33da410 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:21:50.810445 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:21:50.914925 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f4e73d-3083-4458-a7db-3e42d33da410 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:21:50.917048 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f4e73d-3083-4458-a7db-3e42d33da410 service nova] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:21:50.944614 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 689/1363] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:21:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:21:53.635694 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd52db-bf13-4e33-99e5-7bdeecd56952 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:21:53.636636 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd52db-bf13-4e33-99e5-7bdeecd56952 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:21:53.637120 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd52db-bf13-4e33-99e5-7bdeecd56952 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:21:53.638847 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 675/1364] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:21:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 15:21:53.645007 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa50eadc-4133-4216-9ecd-a157c16bd5a2 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:21:53.645902 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa50eadc-4133-4216-9ecd-a157c16bd5a2 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:21:53.646185 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa50eadc-4133-4216-9ecd-a157c16bd5a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:21:53.734747 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-fa50eadc-4133-4216-9ecd-a157c16bd5a2 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:21:53.736246 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-fa50eadc-4133-4216-9ecd-a157c16bd5a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:21:53.907035 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:21:53.919912 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 690/1365] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:21:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:21:53.989849 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b34443b-f540-4478-9efc-6ec304d37e35 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:21:53.990314 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b34443b-f540-4478-9efc-6ec304d37e35 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:21:53.990746 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b34443b-f540-4478-9efc-6ec304d37e35 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:21:53.992661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 676/1366] 10.222.0.42 () {54 vars in 962 bytes} [Tue Aug 2 15:21:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:21:53.999098 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658aa88e-0048-47be-9ebf-96c97e042169 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:21:53.999642 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658aa88e-0048-47be-9ebf-96c97e042169 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:21:53.999953 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658aa88e-0048-47be-9ebf-96c97e042169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:21:54.106881 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-658aa88e-0048-47be-9ebf-96c97e042169 None None] MFA Rules not processed for user `4c0865af59bf43dfa4c84213d7db53c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:21:54.108142 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-658aa88e-0048-47be-9ebf-96c97e042169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:21:54.288334 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 691/1367] 10.222.0.42 () {58 vars in 1059 bytes} [Tue Aug 2 15:21:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:21:54.297230 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b34443b-f540-4478-9efc-6ec304d37e35 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:21:54.298754 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-8b34443b-f540-4478-9efc-6ec304d37e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:21:54.512962 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b34443b-f540-4478-9efc-6ec304d37e35 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:21:54.545228 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:21:54.752053 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b82664-14d3-4e13-a289-bd38850a000a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0865af59bf43dfa4c84213d7db53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:21:54.753402 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b82664-14d3-4e13-a289-bd38850a000a service nova] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:21:54.754219 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b82664-14d3-4e13-a289-bd38850a000a service nova] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:21:54.754938 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b82664-14d3-4e13-a289-bd38850a000a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:21:54.758949 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-41b82664-14d3-4e13-a289-bd38850a000a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:21:54.924457 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b82664-14d3-4e13-a289-bd38850a000a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:21:54.925994 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b82664-14d3-4e13-a289-bd38850a000a service nova] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:21:54.957904 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 677/1368] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:21:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 661 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:21:55.908945 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5719bf-c5fb-438b-ab19-fdf1c9722cb4 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:21:55.909524 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5719bf-c5fb-438b-ab19-fdf1c9722cb4 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:21:55.909524 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5719bf-c5fb-438b-ab19-fdf1c9722cb4 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:21:55.911115 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 692/1369] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:21:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:21:55.917151 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ed5a1-2ba5-4a30-8914-fbbafa48ae76 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:21:55.917748 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ed5a1-2ba5-4a30-8914-fbbafa48ae76 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:21:55.917748 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ed5a1-2ba5-4a30-8914-fbbafa48ae76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:21:55.956585 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:21:56.010985 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-5e4ed5a1-2ba5-4a30-8914-fbbafa48ae76 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:21:56.012545 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-5e4ed5a1-2ba5-4a30-8914-fbbafa48ae76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:21:56.203293 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 678/1370] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:21:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:21:56.638214 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b373056-8f13-42fc-9b16-a1b5125d6d9c None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:21:56.638214 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b373056-8f13-42fc-9b16-a1b5125d6d9c None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:21:56.638214 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b373056-8f13-42fc-9b16-a1b5125d6d9c None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:21:56.638214 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 693/1371] 10.222.0.42 () {54 vars in 964 bytes} [Tue Aug 2 15:21:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 15:21:56.646540 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ed601-982d-4d5f-88c6-b158936649b9 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:21:56.646540 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ed601-982d-4d5f-88c6-b158936649b9 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:21:56.646540 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ed601-982d-4d5f-88c6-b158936649b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:21:56.775131 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-da9ed601-982d-4d5f-88c6-b158936649b9 None None] MFA Rules not processed for user `8d09126f1821420bb4218b611c89402a`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:21:56.777767 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-da9ed601-982d-4d5f-88c6-b158936649b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:21:56.869027 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:21:56.937093 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 679/1372] 10.222.0.42 () {58 vars in 1061 bytes} [Tue Aug 2 15:21:56 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:21:56.951992 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b373056-8f13-42fc-9b16-a1b5125d6d9c None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:21:56.954912 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-0b373056-8f13-42fc-9b16-a1b5125d6d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:21:57.058034 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:21:57.185991 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b373056-8f13-42fc-9b16-a1b5125d6d9c None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:21:57.356543 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594a9a9-ea39-4bf3-b85d-82aa8d6423aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:21:57.358736 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594a9a9-ea39-4bf3-b85d-82aa8d6423aa service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:21:57.359448 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594a9a9-ea39-4bf3-b85d-82aa8d6423aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:21:57.360093 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594a9a9-ea39-4bf3-b85d-82aa8d6423aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:21:57.363953 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-3594a9a9-ea39-4bf3-b85d-82aa8d6423aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:21:57.449330 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157e03a-6451-4d9b-b52c-6d3f3b3f2d57 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:21:57.449702 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157e03a-6451-4d9b-b52c-6d3f3b3f2d57 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:21:57.449875 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157e03a-6451-4d9b-b52c-6d3f3b3f2d57 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:21:57.451241 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 680/1373] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:21:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 15:21:57.457192 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb7157-2fdc-4af6-93b4-088bf05974bb None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:21:57.457811 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb7157-2fdc-4af6-93b4-088bf05974bb None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:21:57.457994 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb7157-2fdc-4af6-93b4-088bf05974bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:21:57.561541 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-5cdb7157-2fdc-4af6-93b4-088bf05974bb None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:21:57.562841 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-5cdb7157-2fdc-4af6-93b4-088bf05974bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:21:57.602646 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:21:57.635444 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3594a9a9-ea39-4bf3-b85d-82aa8d6423aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:21:57.637658 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3594a9a9-ea39-4bf3-b85d-82aa8d6423aa service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:21:57.676446 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 694/1374] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:21:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 725 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:21:57.736326 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 681/1375] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:21:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:21:57.773945 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594a9a9-ea39-4bf3-b85d-82aa8d6423aa service cinder] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:21:57.775187 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-3594a9a9-ea39-4bf3-b85d-82aa8d6423aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:21:57.902632 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594a9a9-ea39-4bf3-b85d-82aa8d6423aa service cinder] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:21:58.051469 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:21:58.067634 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7f032-571b-424f-9612-19668390a0cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0865af59bf43dfa4c84213d7db53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:21:58.068424 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7f032-571b-424f-9612-19668390a0cd service nova] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:21:58.068792 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7f032-571b-424f-9612-19668390a0cd service nova] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:21:58.069154 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7f032-571b-424f-9612-19668390a0cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:21:58.071046 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-09f7f032-571b-424f-9612-19668390a0cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:21:58.186028 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f7f032-571b-424f-9612-19668390a0cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:21:58.187969 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f7f032-571b-424f-9612-19668390a0cd service nova] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:21:58.210551 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 695/1376] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:21:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 15:22:00.375662 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5df25b-6ab7-4faa-b960-132560784937 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:22:00.376174 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5df25b-6ab7-4faa-b960-132560784937 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:22:00.376271 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5df25b-6ab7-4faa-b960-132560784937 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:22:00.377546 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 682/1377] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:22:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:22:00.382928 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b8cc0f-4216-4235-9c3a-b2d14b1f26d1 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:22:00.383435 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b8cc0f-4216-4235-9c3a-b2d14b1f26d1 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:22:00.384010 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b8cc0f-4216-4235-9c3a-b2d14b1f26d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:22:00.473148 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-42b8cc0f-4216-4235-9c3a-b2d14b1f26d1 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:22:00.474482 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-42b8cc0f-4216-4235-9c3a-b2d14b1f26d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:22:00.556789 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:22:00.605599 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 696/1378] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:22:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:22:00.653041 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5df25b-6ab7-4faa-b960-132560784937 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:22:00.654690 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-af5df25b-6ab7-4faa-b960-132560784937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:22:00.715101 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:22:00.821451 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5df25b-6ab7-4faa-b960-132560784937 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:22:00.991656 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fabebea-c20f-4cd0-820e-1beea1d772c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0865af59bf43dfa4c84213d7db53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:22:00.992584 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fabebea-c20f-4cd0-820e-1beea1d772c5 service nova] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:22:00.993027 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fabebea-c20f-4cd0-820e-1beea1d772c5 service nova] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:22:00.993488 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fabebea-c20f-4cd0-820e-1beea1d772c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:22:00.996582 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-0fabebea-c20f-4cd0-820e-1beea1d772c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:22:01.015919 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:22:01.154371 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fabebea-c20f-4cd0-820e-1beea1d772c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:22:01.156717 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fabebea-c20f-4cd0-820e-1beea1d772c5 service nova] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:22:01.186489 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 683/1379] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:22:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:22:03.405234 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3c44f-8b03-455f-8ef8-cdcbc2b6feca None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:22:03.405842 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3c44f-8b03-455f-8ef8-cdcbc2b6feca None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:22:03.405842 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3c44f-8b03-455f-8ef8-cdcbc2b6feca None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:22:03.407308 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 697/1380] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:22:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:22:03.413056 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae324db-c5f0-439a-9b22-5aa387096538 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:22:03.413569 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae324db-c5f0-439a-9b22-5aa387096538 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:22:03.413569 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae324db-c5f0-439a-9b22-5aa387096538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:22:03.500579 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-cae324db-c5f0-439a-9b22-5aa387096538 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:22:03.502200 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-cae324db-c5f0-439a-9b22-5aa387096538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:22:03.621450 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:22:03.644374 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 684/1381] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:22:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:22:03.691535 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b3c44f-8b03-455f-8ef8-cdcbc2b6feca None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:22:03.693184 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-39b3c44f-8b03-455f-8ef8-cdcbc2b6feca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:22:03.921744 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b3c44f-8b03-455f-8ef8-cdcbc2b6feca None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:22:04.009034 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:22:04.090505 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a23a43b-4738-43f3-a57f-4d0e5e7bf0eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0865af59bf43dfa4c84213d7db53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:22:04.091318 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23a43b-4738-43f3-a57f-4d0e5e7bf0eb service nova] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:22:04.091702 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23a43b-4738-43f3-a57f-4d0e5e7bf0eb service nova] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:22:04.092111 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23a43b-4738-43f3-a57f-4d0e5e7bf0eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:22:04.093894 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-7a23a43b-4738-43f3-a57f-4d0e5e7bf0eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:22:04.232501 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a23a43b-4738-43f3-a57f-4d0e5e7bf0eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:22:04.234095 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a23a43b-4738-43f3-a57f-4d0e5e7bf0eb service nova] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:22:04.256452 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 698/1382] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:22:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:22:06.689977 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d62d61-c0ef-4b63-af90-d19598278a3f None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:22:06.690523 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d62d61-c0ef-4b63-af90-d19598278a3f None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:22:06.690687 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d62d61-c0ef-4b63-af90-d19598278a3f None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:22:06.692542 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 685/1383] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:22:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:22:06.699716 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ec4d3-721e-48d7-af70-431de9a31f1d None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:22:06.700203 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ec4d3-721e-48d7-af70-431de9a31f1d None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:22:06.700295 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ec4d3-721e-48d7-af70-431de9a31f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:22:06.771799 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-305ec4d3-721e-48d7-af70-431de9a31f1d None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:22:06.773295 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-305ec4d3-721e-48d7-af70-431de9a31f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:22:06.775115 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:22:06.895640 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 699/1384] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:22:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:22:06.950468 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d62d61-c0ef-4b63-af90-d19598278a3f None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:22:06.951908 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-10d62d61-c0ef-4b63-af90-d19598278a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:22:07.142786 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d62d61-c0ef-4b63-af90-d19598278a3f None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:22:07.240118 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:22:07.317198 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741c7ea9-60bb-4168-b1f1-09eba29ae24f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0865af59bf43dfa4c84213d7db53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:22:07.318254 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c7ea9-60bb-4168-b1f1-09eba29ae24f service nova] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:22:07.318755 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c7ea9-60bb-4168-b1f1-09eba29ae24f service nova] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:22:07.319315 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c7ea9-60bb-4168-b1f1-09eba29ae24f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:22:07.322339 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-741c7ea9-60bb-4168-b1f1-09eba29ae24f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:22:07.467093 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741c7ea9-60bb-4168-b1f1-09eba29ae24f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:22:07.469216 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741c7ea9-60bb-4168-b1f1-09eba29ae24f service nova] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:22:07.500512 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 686/1385] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:22:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:22:09.755599 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c193c-4b49-4bb4-9ecc-d24b5e39fb28 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:22:09.756166 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c193c-4b49-4bb4-9ecc-d24b5e39fb28 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:22:09.756166 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c193c-4b49-4bb4-9ecc-d24b5e39fb28 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:22:09.757542 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 700/1386] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:22:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:22:09.764311 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d534d5-9d57-4db4-a621-674bec68375d None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:22:09.764964 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d534d5-9d57-4db4-a621-674bec68375d None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:22:09.765131 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d534d5-9d57-4db4-a621-674bec68375d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:22:09.855564 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-33d534d5-9d57-4db4-a621-674bec68375d None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:22:09.857084 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-33d534d5-9d57-4db4-a621-674bec68375d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:22:09.887952 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:22:09.967836 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 687/1387] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:22:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:22:10.016643 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c193c-4b49-4bb4-9ecc-d24b5e39fb28 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:22:10.018529 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-5e5c193c-4b49-4bb4-9ecc-d24b5e39fb28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:22:10.193139 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:22:10.220469 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c193c-4b49-4bb4-9ecc-d24b5e39fb28 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:22:10.374245 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3185d734-1346-4fa4-bafa-c9ee9b40c757 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0865af59bf43dfa4c84213d7db53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:22:10.374943 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3185d734-1346-4fa4-bafa-c9ee9b40c757 service nova] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:22:10.375344 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3185d734-1346-4fa4-bafa-c9ee9b40c757 service nova] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:22:10.375762 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3185d734-1346-4fa4-bafa-c9ee9b40c757 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:22:10.377939 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-3185d734-1346-4fa4-bafa-c9ee9b40c757 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:22:10.501078 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3185d734-1346-4fa4-bafa-c9ee9b40c757 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:22:10.502699 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3185d734-1346-4fa4-bafa-c9ee9b40c757 service nova] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:22:10.508151 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:22:10.523499 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 701/1388] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:22:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 15:22:12.662214 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42475f8-7cd0-4743-a131-ccfe9352e72b None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:22:12.662955 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42475f8-7cd0-4743-a131-ccfe9352e72b None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:22:12.662955 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42475f8-7cd0-4743-a131-ccfe9352e72b None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:22:12.664123 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 688/1389] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:22:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:22:12.670598 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd67fa43-87a6-4da4-94f6-b987c8c4f51c None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:22:12.671118 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd67fa43-87a6-4da4-94f6-b987c8c4f51c None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:22:12.671118 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd67fa43-87a6-4da4-94f6-b987c8c4f51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:22:12.767526 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-bd67fa43-87a6-4da4-94f6-b987c8c4f51c None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:22:12.768787 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-bd67fa43-87a6-4da4-94f6-b987c8c4f51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:22:12.897296 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 702/1390] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:22:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:22:12.948086 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42475f8-7cd0-4743-a131-ccfe9352e72b None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:22:12.949633 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-b42475f8-7cd0-4743-a131-ccfe9352e72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:22:13.117160 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42475f8-7cd0-4743-a131-ccfe9352e72b None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:22:13.127314 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:22:13.268784 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7a1a44-cc75-4fe5-9458-a19357e39b6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0865af59bf43dfa4c84213d7db53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:22:13.269425 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a1a44-cc75-4fe5-9458-a19357e39b6d service nova] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:22:13.269714 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a1a44-cc75-4fe5-9458-a19357e39b6d service nova] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:22:13.269977 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a1a44-cc75-4fe5-9458-a19357e39b6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:22:13.271647 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-7f7a1a44-cc75-4fe5-9458-a19357e39b6d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:22:13.382734 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7a1a44-cc75-4fe5-9458-a19357e39b6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:22:13.384383 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7a1a44-cc75-4fe5-9458-a19357e39b6d service nova] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:22:13.404847 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 689/1391] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:22:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:22:13.708591 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9a5f6-a1c7-42d7-a617-205b5d1c471f None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:22:13.709473 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9a5f6-a1c7-42d7-a617-205b5d1c471f None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:22:13.709637 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9a5f6-a1c7-42d7-a617-205b5d1c471f None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:22:13.711051 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 703/1392] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:22:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:22:13.717032 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e79b6f-b0b5-4f16-bc28-f7cc6d401968 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:22:13.717604 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e79b6f-b0b5-4f16-bc28-f7cc6d401968 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:22:13.717711 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e79b6f-b0b5-4f16-bc28-f7cc6d401968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:22:13.736955 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:22:13.822769 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-f9e79b6f-b0b5-4f16-bc28-f7cc6d401968 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:22:13.824860 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-f9e79b6f-b0b5-4f16-bc28-f7cc6d401968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:22:13.977118 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 690/1393] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:22:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:22:14.063096 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee91e464-8fbf-47d3-a305-1c3065221e26 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:22:14.063478 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee91e464-8fbf-47d3-a305-1c3065221e26 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:22:14.063718 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee91e464-8fbf-47d3-a305-1c3065221e26 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:22:14.065149 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 704/1394] 10.222.0.42 () {54 vars in 966 bytes} [Tue Aug 2 15:22:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:22:14.070932 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58223c-2040-46b0-b8d9-00d7d9162ea7 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:22:14.071239 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58223c-2040-46b0-b8d9-00d7d9162ea7 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:22:14.071537 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58223c-2040-46b0-b8d9-00d7d9162ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:22:14.187742 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-fa58223c-2040-46b0-b8d9-00d7d9162ea7 None None] MFA Rules not processed for user `946af31d75ca41a2a4301e0294cf98f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:22:14.189072 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-fa58223c-2040-46b0-b8d9-00d7d9162ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:22:14.232792 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:22:14.285896 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 691/1395] 10.222.0.42 () {58 vars in 1063 bytes} [Tue Aug 2 15:22:14 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:22:14.294371 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee91e464-8fbf-47d3-a305-1c3065221e26 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:22:14.296432 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-ee91e464-8fbf-47d3-a305-1c3065221e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:22:14.382973 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:22:14.419797 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee91e464-8fbf-47d3-a305-1c3065221e26 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:22:14.508580 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e416b9e7-670c-4b45-969c-6a6148219c3d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946af31d75ca41a2a4301e0294cf98f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:22:14.509114 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e416b9e7-670c-4b45-969c-6a6148219c3d service glance] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:22:14.509392 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e416b9e7-670c-4b45-969c-6a6148219c3d service glance] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:22:14.509696 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e416b9e7-670c-4b45-969c-6a6148219c3d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:22:14.511341 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-e416b9e7-670c-4b45-969c-6a6148219c3d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:22:14.646801 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e416b9e7-670c-4b45-969c-6a6148219c3d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:22:14.648338 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e416b9e7-670c-4b45-969c-6a6148219c3d service glance] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:22:14.667381 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:22:14.673580 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 705/1396] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:22:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:22:15.467281 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344598c-c0ff-4bc8-a084-e3af70282d5c None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:22:15.468133 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344598c-c0ff-4bc8-a084-e3af70282d5c None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:22:15.468133 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344598c-c0ff-4bc8-a084-e3af70282d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:22:15.550751 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-f344598c-c0ff-4bc8-a084-e3af70282d5c None None] MFA Rules not processed for user `dfe8c00c0c3d4c4b8b6f36e39a3a2e71`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:22:15.552063 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-f344598c-c0ff-4bc8-a084-e3af70282d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:22:15.585288 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451f317-fc50-4cfa-8f11-3decb2a39754 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:22:15.585885 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451f317-fc50-4cfa-8f11-3decb2a39754 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:22:15.585885 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451f317-fc50-4cfa-8f11-3decb2a39754 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:22:15.587191 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 706/1397] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:22:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 15:22:15.592736 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f674d-5a8f-4059-abcf-7078974c7bf0 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:22:15.593019 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f674d-5a8f-4059-abcf-7078974c7bf0 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:22:15.593295 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f674d-5a8f-4059-abcf-7078974c7bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:22:15.655522 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 692/1398] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Aug 2 15:22:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:22:15.670173 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-d41f674d-5a8f-4059-abcf-7078974c7bf0 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:22:15.671524 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-d41f674d-5a8f-4059-abcf-7078974c7bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:22:15.710569 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a620564f-ac13-4719-b63c-00356a754989 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:22:15.710781 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a620564f-ac13-4719-b63c-00356a754989 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:22:15.711074 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a620564f-ac13-4719-b63c-00356a754989 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:22:15.712616 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 693/1399] 10.222.0.42 () {54 vars in 943 bytes} [Tue Aug 2 15:22:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:22:15.719249 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4fa983-830f-452c-a01b-bb7adde00cbf None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:22:15.719526 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4fa983-830f-452c-a01b-bb7adde00cbf None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:22:15.719815 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4fa983-830f-452c-a01b-bb7adde00cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:22:15.797153 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:22:15.810768 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 707/1400] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:22:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:22:15.838991 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-6b4fa983-830f-452c-a01b-bb7adde00cbf None None] MFA Rules not processed for user `6f4de590df474c8b95f2b1193f7dbcb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:22:15.841190 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-6b4fa983-830f-452c-a01b-bb7adde00cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:22:15.858613 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f674d-5a8f-4059-abcf-7078974c7bf0 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:22:15.860357 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-d41f674d-5a8f-4059-abcf-7078974c7bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:22:15.991759 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 694/1401] 10.222.0.42 () {58 vars in 1040 bytes} [Tue Aug 2 15:22:15 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:22:15.992561 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:22:16.002889 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4fa983-830f-452c-a01b-bb7adde00cbf None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:22:16.014934 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4fa983-830f-452c-a01b-bb7adde00cbf None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:22:16.054906 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f674d-5a8f-4059-abcf-7078974c7bf0 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:22:16.161432 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:22:16.168497 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65950e4c-a701-4de6-9c5d-bacb629e4850 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4de590df474c8b95f2b1193f7dbcb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:22:16.169129 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65950e4c-a701-4de6-9c5d-bacb629e4850 service swift] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:22:16.169413 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65950e4c-a701-4de6-9c5d-bacb629e4850 service swift] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:22:16.169687 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65950e4c-a701-4de6-9c5d-bacb629e4850 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:22:16.171553 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-65950e4c-a701-4de6-9c5d-bacb629e4850 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:22:16.232876 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6340a-2993-4538-ac14-bacbf8df1449 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0865af59bf43dfa4c84213d7db53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:22:16.233511 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6340a-2993-4538-ac14-bacbf8df1449 service nova] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:22:16.233805 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6340a-2993-4538-ac14-bacbf8df1449 service nova] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:22:16.234097 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6340a-2993-4538-ac14-bacbf8df1449 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:22:16.235884 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-dbf6340a-2993-4538-ac14-bacbf8df1449 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:22:16.280054 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65950e4c-a701-4de6-9c5d-bacb629e4850 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:22:16.282481 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65950e4c-a701-4de6-9c5d-bacb629e4850 service swift] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:22:16.294254 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 695/1402] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Aug 2 15:22:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 02 15:22:16.346863 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:22:16.371173 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf6340a-2993-4538-ac14-bacbf8df1449 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:22:16.372866 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf6340a-2993-4538-ac14-bacbf8df1449 service nova] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:22:16.397526 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 708/1403] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:22:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 15:22:18.679357 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc1336-78f2-472d-b0a7-a7061c99c54a None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:22:18.679921 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc1336-78f2-472d-b0a7-a7061c99c54a None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:22:18.679921 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc1336-78f2-472d-b0a7-a7061c99c54a None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:22:18.681305 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 696/1404] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:22:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:22:18.687622 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e6024-d7e7-4e03-83da-ecf3f40fb5fa None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:22:18.688210 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e6024-d7e7-4e03-83da-ecf3f40fb5fa None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:22:18.688210 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e6024-d7e7-4e03-83da-ecf3f40fb5fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:22:18.809796 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-663e6024-d7e7-4e03-83da-ecf3f40fb5fa None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:22:18.811247 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-663e6024-d7e7-4e03-83da-ecf3f40fb5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:22:18.953469 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 709/1405] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:22:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:22:18.997485 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc1336-78f2-472d-b0a7-a7061c99c54a None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:22:18.999044 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-a4dc1336-78f2-472d-b0a7-a7061c99c54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:22:19.172720 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:22:19.187637 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc1336-78f2-472d-b0a7-a7061c99c54a None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:22:19.328502 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15288373-1f85-47ec-b4e4-a9458fc59b47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0865af59bf43dfa4c84213d7db53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:22:19.329400 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15288373-1f85-47ec-b4e4-a9458fc59b47 service nova] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:22:19.329941 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15288373-1f85-47ec-b4e4-a9458fc59b47 service nova] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:22:19.330367 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15288373-1f85-47ec-b4e4-a9458fc59b47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:22:19.332304 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-15288373-1f85-47ec-b4e4-a9458fc59b47 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:22:19.448256 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15288373-1f85-47ec-b4e4-a9458fc59b47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:22:19.449898 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15288373-1f85-47ec-b4e4-a9458fc59b47 service nova] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:22:19.461332 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:22:19.477320 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 697/1406] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:22:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:22:21.646002 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf52aa7-ea83-4f48-8156-6ad92ccf650f None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:22:21.646540 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf52aa7-ea83-4f48-8156-6ad92ccf650f None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:22:21.646540 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf52aa7-ea83-4f48-8156-6ad92ccf650f None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:22:21.648083 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 710/1407] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:22:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:22:21.653419 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2db03-697e-4159-afbd-9289608ce7e7 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:22:21.653950 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2db03-697e-4159-afbd-9289608ce7e7 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:22:21.654070 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2db03-697e-4159-afbd-9289608ce7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:22:21.865145 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-46b2db03-697e-4159-afbd-9289608ce7e7 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:22:21.866640 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-46b2db03-697e-4159-afbd-9289608ce7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:22:22.047512 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 698/1408] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:22:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:22:22.095758 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf52aa7-ea83-4f48-8156-6ad92ccf650f None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:22:22.097766 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-dcf52aa7-ea83-4f48-8156-6ad92ccf650f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:22:22.192177 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:22:22.311031 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf52aa7-ea83-4f48-8156-6ad92ccf650f None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:22:22.468177 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea2722-9bf5-41fc-8819-098904f07f64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0865af59bf43dfa4c84213d7db53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:22:22.468814 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea2722-9bf5-41fc-8819-098904f07f64 service nova] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:22:22.469096 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea2722-9bf5-41fc-8819-098904f07f64 service nova] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:22:22.469369 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea2722-9bf5-41fc-8819-098904f07f64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:22:22.471031 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-fdea2722-9bf5-41fc-8819-098904f07f64 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:22:22.485423 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:22:22.594109 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdea2722-9bf5-41fc-8819-098904f07f64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:22:22.595681 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdea2722-9bf5-41fc-8819-098904f07f64 service nova] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:22:22.620135 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 711/1409] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:22:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:22:32.045018 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=67 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:22:32.616545 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=39 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:22:39.597356 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd901c8d-ca4a-4724-9293-da632b676419 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:22:39.597991 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd901c8d-ca4a-4724-9293-da632b676419 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:22:39.597991 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd901c8d-ca4a-4724-9293-da632b676419 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:22:39.599308 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 699/1410] 10.222.0.42 () {54 vars in 918 bytes} [Tue Aug 2 15:22:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:22:39.605692 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f9885-ec45-4eff-861b-74f1b593e383 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:22:39.606285 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f9885-ec45-4eff-861b-74f1b593e383 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:22:39.606620 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f9885-ec45-4eff-861b-74f1b593e383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:22:39.690234 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-171f9885-ec45-4eff-861b-74f1b593e383 None None] MFA Rules not processed for user `57dfafee636a45ca98fe0e8bb13dd754`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:22:39.691490 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-171f9885-ec45-4eff-861b-74f1b593e383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:22:39.826816 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 712/1411] 10.222.0.42 () {58 vars in 1015 bytes} [Tue Aug 2 15:22:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:22:39.843386 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee1dfc3-ce60-467c-b22e-7109fdc6f4c5 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:22:39.843695 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee1dfc3-ce60-467c-b22e-7109fdc6f4c5 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:22:39.843967 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee1dfc3-ce60-467c-b22e-7109fdc6f4c5 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:22:39.845361 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 700/1412] 10.222.0.42 () {54 vars in 918 bytes} [Tue Aug 2 15:22:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:22:39.850831 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b415e79d-7e0e-4259-ba06-3afa89199526 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:22:39.852026 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b415e79d-7e0e-4259-ba06-3afa89199526 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:22:39.852315 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b415e79d-7e0e-4259-ba06-3afa89199526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:22:39.936377 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:22:39.939925 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-b415e79d-7e0e-4259-ba06-3afa89199526 None None] MFA Rules not processed for user `4c0865af59bf43dfa4c84213d7db53c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:22:39.942096 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-b415e79d-7e0e-4259-ba06-3afa89199526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:22:40.086768 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 713/1413] 10.222.0.42 () {58 vars in 1015 bytes} [Tue Aug 2 15:22:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:22:42.820892 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf4c00-866a-4076-9a3f-fb6b779f2634 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:22:42.821531 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf4c00-866a-4076-9a3f-fb6b779f2634 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:22:42.821701 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf4c00-866a-4076-9a3f-fb6b779f2634 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:22:42.823354 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 701/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 15:22:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:22:42.829985 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04cffe3-d2b3-46b0-9cc9-e8754aec5909 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:22:42.830817 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04cffe3-d2b3-46b0-9cc9-e8754aec5909 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:22:42.830993 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04cffe3-d2b3-46b0-9cc9-e8754aec5909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:22:42.908235 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-b04cffe3-d2b3-46b0-9cc9-e8754aec5909 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:22:42.909642 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-b04cffe3-d2b3-46b0-9cc9-e8754aec5909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:22:42.977286 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:22:43.033418 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 714/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 15:22:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:22:43.089713 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf4c00-866a-4076-9a3f-fb6b779f2634 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:22:43.091169 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-55bf4c00-866a-4076-9a3f-fb6b779f2634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:22:43.268583 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf4c00-866a-4076-9a3f-fb6b779f2634 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:22:43.352284 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:22:43.396992 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975193f3-5dc3-41bc-b8a4-afc06da65b11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0865af59bf43dfa4c84213d7db53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:22:43.397622 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975193f3-5dc3-41bc-b8a4-afc06da65b11 service nova] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:22:43.397900 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975193f3-5dc3-41bc-b8a4-afc06da65b11 service nova] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:22:43.398169 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975193f3-5dc3-41bc-b8a4-afc06da65b11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:22:43.400257 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-975193f3-5dc3-41bc-b8a4-afc06da65b11 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:22:43.508804 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975193f3-5dc3-41bc-b8a4-afc06da65b11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:22:43.511403 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975193f3-5dc3-41bc-b8a4-afc06da65b11 service nova] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:22:43.534843 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 702/1416] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:22:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:22:44.509885 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1add3b9-0238-4ffc-b69d-232f0d36aaed None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:22:44.510577 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1add3b9-0238-4ffc-b69d-232f0d36aaed None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:22:44.510577 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1add3b9-0238-4ffc-b69d-232f0d36aaed None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:22:44.511853 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 715/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 15:22:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 15:22:44.517353 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d09c63-36ab-4b5c-8253-90db46300bcd None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:22:44.517912 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d09c63-36ab-4b5c-8253-90db46300bcd None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:22:44.517912 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d09c63-36ab-4b5c-8253-90db46300bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:22:44.607058 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-49d09c63-36ab-4b5c-8253-90db46300bcd None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:22:44.608697 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-49d09c63-36ab-4b5c-8253-90db46300bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:22:44.636435 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:22:44.707785 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 703/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 15:22:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:22:44.860436 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1add3b9-0238-4ffc-b69d-232f0d36aaed None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:22:44.862218 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-a1add3b9-0238-4ffc-b69d-232f0d36aaed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:22:45.035187 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1add3b9-0238-4ffc-b69d-232f0d36aaed None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:22:45.081589 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:22:45.168700 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b48eb9-6467-4c06-9691-52079f5d6ad2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0865af59bf43dfa4c84213d7db53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:22:45.169425 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b48eb9-6467-4c06-9691-52079f5d6ad2 service nova] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:22:45.169760 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b48eb9-6467-4c06-9691-52079f5d6ad2 service nova] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:22:45.170031 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b48eb9-6467-4c06-9691-52079f5d6ad2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:22:45.172298 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-c3b48eb9-6467-4c06-9691-52079f5d6ad2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:22:45.283731 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b48eb9-6467-4c06-9691-52079f5d6ad2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:22:45.285300 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b48eb9-6467-4c06-9691-52079f5d6ad2 service nova] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:22:45.311724 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 716/1419] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:22:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:22:46.322174 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba288e3-313c-413e-8587-bc4a9bc27743 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:22:46.322806 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba288e3-313c-413e-8587-bc4a9bc27743 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:22:46.322806 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba288e3-313c-413e-8587-bc4a9bc27743 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:22:46.324389 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 704/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 15:22:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:22:46.331136 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b8a1c-32ee-4adb-b5e9-8bf2f56afbac None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:22:46.331704 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b8a1c-32ee-4adb-b5e9-8bf2f56afbac None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:22:46.331801 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b8a1c-32ee-4adb-b5e9-8bf2f56afbac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:22:46.398362 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:22:46.442230 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-465b8a1c-32ee-4adb-b5e9-8bf2f56afbac None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:22:46.444900 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-465b8a1c-32ee-4adb-b5e9-8bf2f56afbac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:22:46.568156 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 717/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 15:22:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:22:46.732102 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba288e3-313c-413e-8587-bc4a9bc27743 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:22:46.733663 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-bba288e3-313c-413e-8587-bc4a9bc27743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:22:46.904911 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba288e3-313c-413e-8587-bc4a9bc27743 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:22:46.919422 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:22:47.062576 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdbc322-b42c-421d-9799-bfe500136dc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0865af59bf43dfa4c84213d7db53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:22:47.063637 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbc322-b42c-421d-9799-bfe500136dc8 service nova] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:22:47.064204 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbc322-b42c-421d-9799-bfe500136dc8 service nova] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:22:47.064485 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbc322-b42c-421d-9799-bfe500136dc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:22:47.067420 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-7fdbc322-b42c-421d-9799-bfe500136dc8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:22:47.213721 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdbc322-b42c-421d-9799-bfe500136dc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:22:47.216918 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdbc322-b42c-421d-9799-bfe500136dc8 service nova] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:22:47.259944 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 705/1422] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:22:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:22:48.197456 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2122ea-bff2-4ca4-82b1-0bc6ab3c8ec2 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:22:48.198166 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2122ea-bff2-4ca4-82b1-0bc6ab3c8ec2 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:22:48.198427 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2122ea-bff2-4ca4-82b1-0bc6ab3c8ec2 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:22:48.201157 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 718/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 15:22:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:22:48.207524 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f6786-070c-480a-b683-86adc504b3c8 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:22:48.208365 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f6786-070c-480a-b683-86adc504b3c8 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:22:48.208365 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f6786-070c-480a-b683-86adc504b3c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:22:48.231375 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:22:48.322310 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-1f6f6786-070c-480a-b683-86adc504b3c8 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:22:48.323764 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-1f6f6786-070c-480a-b683-86adc504b3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:22:48.467528 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 706/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 15:22:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:22:48.633573 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2122ea-bff2-4ca4-82b1-0bc6ab3c8ec2 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:22:48.635749 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-3e2122ea-bff2-4ca4-82b1-0bc6ab3c8ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:22:48.769233 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:22:48.815784 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2122ea-bff2-4ca4-82b1-0bc6ab3c8ec2 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:22:48.961890 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4244f5-eb49-4958-9db2-07af4d84ed49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0865af59bf43dfa4c84213d7db53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:22:48.962553 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4244f5-eb49-4958-9db2-07af4d84ed49 service nova] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:22:48.962836 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4244f5-eb49-4958-9db2-07af4d84ed49 service nova] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:22:48.963128 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4244f5-eb49-4958-9db2-07af4d84ed49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:22:48.964899 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-9c4244f5-eb49-4958-9db2-07af4d84ed49 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:22:49.067398 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:22:49.088873 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4244f5-eb49-4958-9db2-07af4d84ed49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:22:49.090712 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4244f5-eb49-4958-9db2-07af4d84ed49 service nova] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:22:49.114825 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 719/1425] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:22:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:22:50.102622 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfa23e-3829-4425-9044-4bb8dca6f155 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:22:50.103265 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfa23e-3829-4425-9044-4bb8dca6f155 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:22:50.103265 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfa23e-3829-4425-9044-4bb8dca6f155 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:22:50.104563 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 707/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 15:22:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 15:22:50.110314 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b881768-c018-461e-a2a6-bf4b0db62592 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:22:50.110908 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b881768-c018-461e-a2a6-bf4b0db62592 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:22:50.110908 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b881768-c018-461e-a2a6-bf4b0db62592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:22:50.226759 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-4b881768-c018-461e-a2a6-bf4b0db62592 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:22:50.228176 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-4b881768-c018-461e-a2a6-bf4b0db62592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:22:50.352034 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 720/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 15:22:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:22:50.523112 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebfa23e-3829-4425-9044-4bb8dca6f155 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:22:50.525374 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-bebfa23e-3829-4425-9044-4bb8dca6f155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:22:50.628065 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:22:50.709379 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebfa23e-3829-4425-9044-4bb8dca6f155 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:22:50.854815 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a36f85-63c8-420c-8ef1-e1f6d9e256fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0865af59bf43dfa4c84213d7db53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:22:50.855491 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a36f85-63c8-420c-8ef1-e1f6d9e256fd service nova] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:22:50.855780 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a36f85-63c8-420c-8ef1-e1f6d9e256fd service nova] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:22:50.856059 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a36f85-63c8-420c-8ef1-e1f6d9e256fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:22:50.857816 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-04a36f85-63c8-420c-8ef1-e1f6d9e256fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:22:50.920116 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:22:50.974142 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a36f85-63c8-420c-8ef1-e1f6d9e256fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:22:50.976026 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a36f85-63c8-420c-8ef1-e1f6d9e256fd service nova] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:22:51.000556 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 708/1428] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:22:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 15:22:51.894268 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14faf57-3a23-4491-b710-e10d2946e18c None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:22:51.895097 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14faf57-3a23-4491-b710-e10d2946e18c None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:22:51.895097 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14faf57-3a23-4491-b710-e10d2946e18c None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:22:51.896350 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 721/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 15:22:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:22:51.903051 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538bf9c-d907-46da-8994-162c5d1058d2 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:22:51.903674 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538bf9c-d907-46da-8994-162c5d1058d2 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:22:51.904104 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538bf9c-d907-46da-8994-162c5d1058d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:22:52.026450 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-7538bf9c-d907-46da-8994-162c5d1058d2 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:22:52.028501 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-7538bf9c-d907-46da-8994-162c5d1058d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:22:52.190881 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 709/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 15:22:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:22:52.346882 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14faf57-3a23-4491-b710-e10d2946e18c None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:22:52.348532 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-c14faf57-3a23-4491-b710-e10d2946e18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:22:52.419698 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:22:52.543704 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14faf57-3a23-4491-b710-e10d2946e18c None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:22:52.678663 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78319a0e-b8ca-46b7-9151-a9926b4db625 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0865af59bf43dfa4c84213d7db53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:22:52.679323 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78319a0e-b8ca-46b7-9151-a9926b4db625 service nova] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:22:52.679686 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78319a0e-b8ca-46b7-9151-a9926b4db625 service nova] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:22:52.680007 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78319a0e-b8ca-46b7-9151-a9926b4db625 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:22:52.682337 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-78319a0e-b8ca-46b7-9151-a9926b4db625 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:22:52.691410 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:22:52.792943 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78319a0e-b8ca-46b7-9151-a9926b4db625 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:22:52.794688 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78319a0e-b8ca-46b7-9151-a9926b4db625 service nova] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:22:52.816959 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 722/1431] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:22:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:22:53.680742 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e00ae3-b0c1-41af-845c-04fdd3dbd144 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:22:53.681325 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e00ae3-b0c1-41af-845c-04fdd3dbd144 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:22:53.681325 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e00ae3-b0c1-41af-845c-04fdd3dbd144 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:22:53.682701 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 710/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 15:22:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:22:53.688652 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd870ca-9df7-447b-b77a-f71b703d1792 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:22:53.689226 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd870ca-9df7-447b-b77a-f71b703d1792 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:22:53.689226 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd870ca-9df7-447b-b77a-f71b703d1792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:22:53.804495 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-cbd870ca-9df7-447b-b77a-f71b703d1792 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:22:53.807168 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-cbd870ca-9df7-447b-b77a-f71b703d1792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:22:53.942436 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:22:53.975149 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 723/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 15:22:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:22:54.127531 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e00ae3-b0c1-41af-845c-04fdd3dbd144 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:22:54.129170 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-14e00ae3-b0c1-41af-845c-04fdd3dbd144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:22:54.151657 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:22:54.334806 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e00ae3-b0c1-41af-845c-04fdd3dbd144 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:22:54.439815 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:22:54.471597 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eae15bb-f510-4457-ada7-3a83a80178ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0865af59bf43dfa4c84213d7db53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:22:54.472293 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae15bb-f510-4457-ada7-3a83a80178ce service nova] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:22:54.472626 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae15bb-f510-4457-ada7-3a83a80178ce service nova] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:22:54.472958 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae15bb-f510-4457-ada7-3a83a80178ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:22:54.474780 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-8eae15bb-f510-4457-ada7-3a83a80178ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:22:54.583084 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eae15bb-f510-4457-ada7-3a83a80178ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:22:54.584999 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eae15bb-f510-4457-ada7-3a83a80178ce service nova] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:22:54.608144 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 711/1434] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:22:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:22:55.476980 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820bd07-726e-474d-988c-4d71f3ea359c None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:22:55.478185 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820bd07-726e-474d-988c-4d71f3ea359c None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:22:55.478185 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820bd07-726e-474d-988c-4d71f3ea359c None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:22:55.479733 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 724/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 15:22:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 15:22:55.485685 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431a501-b601-4ad6-98f2-23b7ec3639c9 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:22:55.486277 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431a501-b601-4ad6-98f2-23b7ec3639c9 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:22:55.486277 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431a501-b601-4ad6-98f2-23b7ec3639c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:22:55.592044 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-c431a501-b601-4ad6-98f2-23b7ec3639c9 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:22:55.593367 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-c431a501-b601-4ad6-98f2-23b7ec3639c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:22:55.651347 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:22:55.757665 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 712/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 15:22:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:22:55.935869 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820bd07-726e-474d-988c-4d71f3ea359c None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:22:55.937437 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-3820bd07-726e-474d-988c-4d71f3ea359c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:22:56.152312 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820bd07-726e-474d-988c-4d71f3ea359c None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:22:56.230930 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:22:56.302498 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd932610-714f-4716-8b46-6efab3ca55c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0865af59bf43dfa4c84213d7db53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:22:56.303142 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd932610-714f-4716-8b46-6efab3ca55c1 service nova] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:22:56.303552 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd932610-714f-4716-8b46-6efab3ca55c1 service nova] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:22:56.303979 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd932610-714f-4716-8b46-6efab3ca55c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:22:56.306232 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-fd932610-714f-4716-8b46-6efab3ca55c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:22:56.419043 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd932610-714f-4716-8b46-6efab3ca55c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:22:56.420721 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd932610-714f-4716-8b46-6efab3ca55c1 service nova] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:22:56.445386 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 725/1437] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:22:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:22:57.401155 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f2a99-673f-4489-b024-f5f85469e47c None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:22:57.401963 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f2a99-673f-4489-b024-f5f85469e47c None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:22:57.401963 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f2a99-673f-4489-b024-f5f85469e47c None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:22:57.403598 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 713/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 15:22:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 15:22:57.410670 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e804c-d82f-45fb-928f-22db97d20673 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:22:57.411334 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e804c-d82f-45fb-928f-22db97d20673 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:22:57.411543 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e804c-d82f-45fb-928f-22db97d20673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:22:57.516984 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-6b2e804c-d82f-45fb-928f-22db97d20673 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:22:57.518272 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-6b2e804c-d82f-45fb-928f-22db97d20673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:22:57.520761 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:22:57.637534 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 726/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 15:22:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:22:57.797881 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315f2a99-673f-4489-b024-f5f85469e47c None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:22:57.799636 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-315f2a99-673f-4489-b024-f5f85469e47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:22:57.977407 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315f2a99-673f-4489-b024-f5f85469e47c None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:22:58.009539 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:22:58.105849 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a4253-2f95-44f7-85bb-88d6d0751268 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0865af59bf43dfa4c84213d7db53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:22:58.106388 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a4253-2f95-44f7-85bb-88d6d0751268 service nova] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:22:58.106670 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a4253-2f95-44f7-85bb-88d6d0751268 service nova] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:22:58.106948 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a4253-2f95-44f7-85bb-88d6d0751268 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:22:58.108708 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-251a4253-2f95-44f7-85bb-88d6d0751268 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:22:58.244210 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251a4253-2f95-44f7-85bb-88d6d0751268 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:22:58.247039 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251a4253-2f95-44f7-85bb-88d6d0751268 service nova] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:22:58.281662 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 714/1440] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:22:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 15:23:00.326159 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a9fd6-9760-45ab-810f-1cda465a9ec5 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:23:00.326851 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a9fd6-9760-45ab-810f-1cda465a9ec5 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:23:00.326851 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a9fd6-9760-45ab-810f-1cda465a9ec5 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:23:00.328220 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 727/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 15:23:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 15:23:00.334732 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9d36f-8bef-40a0-88e3-3c90599d87c6 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:23:00.335519 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9d36f-8bef-40a0-88e3-3c90599d87c6 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:23:00.335519 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9d36f-8bef-40a0-88e3-3c90599d87c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:23:00.383228 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:23:00.415025 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-e3d9d36f-8bef-40a0-88e3-3c90599d87c6 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:23:00.416229 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-e3d9d36f-8bef-40a0-88e3-3c90599d87c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:23:00.533613 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 715/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 15:23:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:23:00.579403 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a9fd6-9760-45ab-810f-1cda465a9ec5 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:23:00.582216 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-cd8a9fd6-9760-45ab-810f-1cda465a9ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:23:00.723188 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a9fd6-9760-45ab-810f-1cda465a9ec5 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:23:00.759189 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:23:00.805164 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817cf083-f816-4bcc-b124-4ff0711b8562 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:23:00.805837 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817cf083-f816-4bcc-b124-4ff0711b8562 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:23:00.806117 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817cf083-f816-4bcc-b124-4ff0711b8562 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:23:00.806390 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817cf083-f816-4bcc-b124-4ff0711b8562 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:23:00.808131 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-817cf083-f816-4bcc-b124-4ff0711b8562 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:23:00.969671 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817cf083-f816-4bcc-b124-4ff0711b8562 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:23:00.971261 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817cf083-f816-4bcc-b124-4ff0711b8562 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:23:00.996301 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 728/1443] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:23:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:23:03.341392 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196da14b-a4ad-4594-acfb-d7ff7100305a None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:23:03.342085 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196da14b-a4ad-4594-acfb-d7ff7100305a None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:23:03.342085 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196da14b-a4ad-4594-acfb-d7ff7100305a None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:23:03.343378 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 716/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 15:23:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:23:03.349730 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919be5b8-b6a8-4d0e-84b0-0bbe8020dbcd None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:23:03.350337 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919be5b8-b6a8-4d0e-84b0-0bbe8020dbcd None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:23:03.350337 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919be5b8-b6a8-4d0e-84b0-0bbe8020dbcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:23:03.429770 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-919be5b8-b6a8-4d0e-84b0-0bbe8020dbcd None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:23:03.430974 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-919be5b8-b6a8-4d0e-84b0-0bbe8020dbcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:23:03.447632 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:23:03.610247 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 729/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 15:23:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:23:03.655128 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196da14b-a4ad-4594-acfb-d7ff7100305a None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:23:03.656751 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-196da14b-a4ad-4594-acfb-d7ff7100305a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:23:03.785281 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196da14b-a4ad-4594-acfb-d7ff7100305a None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:23:03.800461 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:23:03.880464 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f18a250-19e3-49fa-8f56-6816e055f1dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:23:03.881100 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18a250-19e3-49fa-8f56-6816e055f1dc service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:23:03.881382 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18a250-19e3-49fa-8f56-6816e055f1dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:23:03.881658 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18a250-19e3-49fa-8f56-6816e055f1dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:23:03.883998 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-5f18a250-19e3-49fa-8f56-6816e055f1dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:23:04.034874 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f18a250-19e3-49fa-8f56-6816e055f1dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:23:04.036771 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f18a250-19e3-49fa-8f56-6816e055f1dc service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:23:04.059379 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 717/1446] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:23:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:23:06.741478 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ecaa9-0cf4-484a-af1f-663682c52078 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:23:06.742047 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ecaa9-0cf4-484a-af1f-663682c52078 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:23:06.742047 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ecaa9-0cf4-484a-af1f-663682c52078 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:23:06.743907 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 730/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 15:23:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 15:23:06.750099 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd107e-35d6-4e00-b5b4-656317a192fb None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:23:06.750681 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd107e-35d6-4e00-b5b4-656317a192fb None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:23:06.750681 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd107e-35d6-4e00-b5b4-656317a192fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:23:06.828993 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:23:06.853424 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-69cd107e-35d6-4e00-b5b4-656317a192fb None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:23:06.854925 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-69cd107e-35d6-4e00-b5b4-656317a192fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:23:06.983895 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 718/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 15:23:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:23:07.027847 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73ecaa9-0cf4-484a-af1f-663682c52078 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:23:07.029606 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-a73ecaa9-0cf4-484a-af1f-663682c52078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:23:07.171874 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73ecaa9-0cf4-484a-af1f-663682c52078 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:23:07.222484 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:23:07.266698 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf78951-94f1-4407-90a1-4ac8dcc93d19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:23:07.267364 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf78951-94f1-4407-90a1-4ac8dcc93d19 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:23:07.267685 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf78951-94f1-4407-90a1-4ac8dcc93d19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:23:07.267985 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf78951-94f1-4407-90a1-4ac8dcc93d19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:23:07.269782 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-dcf78951-94f1-4407-90a1-4ac8dcc93d19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:23:07.429163 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf78951-94f1-4407-90a1-4ac8dcc93d19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:23:07.432456 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf78951-94f1-4407-90a1-4ac8dcc93d19 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:23:07.458031 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 731/1449] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:23:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:23:09.866718 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784a881-cdd1-45fa-a555-83f8eb5571a6 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:23:09.867337 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784a881-cdd1-45fa-a555-83f8eb5571a6 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:23:09.867337 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784a881-cdd1-45fa-a555-83f8eb5571a6 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:23:09.869311 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 719/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 15:23:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:23:09.875542 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936a5df-95aa-4b8b-84d6-f9347d93f364 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:23:09.876135 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936a5df-95aa-4b8b-84d6-f9347d93f364 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:23:09.876135 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936a5df-95aa-4b8b-84d6-f9347d93f364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:23:09.956530 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-b936a5df-95aa-4b8b-84d6-f9347d93f364 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:23:09.957923 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-b936a5df-95aa-4b8b-84d6-f9347d93f364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:23:09.983340 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:23:10.075679 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 732/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 15:23:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:23:10.116482 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6784a881-cdd1-45fa-a555-83f8eb5571a6 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:23:10.118132 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-6784a881-cdd1-45fa-a555-83f8eb5571a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:23:10.269319 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6784a881-cdd1-45fa-a555-83f8eb5571a6 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:23:10.310616 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:23:10.409090 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5381f9d-596d-4416-ac82-91f84a21b87d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:23:10.409709 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5381f9d-596d-4416-ac82-91f84a21b87d service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:23:10.410043 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5381f9d-596d-4416-ac82-91f84a21b87d service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:23:10.410374 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5381f9d-596d-4416-ac82-91f84a21b87d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:23:10.412315 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-c5381f9d-596d-4416-ac82-91f84a21b87d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:23:10.550619 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5381f9d-596d-4416-ac82-91f84a21b87d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:23:10.552122 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5381f9d-596d-4416-ac82-91f84a21b87d service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:23:10.574203 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 720/1452] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:23:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:23:12.841211 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b4c12e-b58a-421d-a357-06017e4a5a02 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:23:12.842497 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b4c12e-b58a-421d-a357-06017e4a5a02 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:23:12.842497 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b4c12e-b58a-421d-a357-06017e4a5a02 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:23:12.844649 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 733/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 15:23:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:23:12.852827 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a567e-12d5-4ab1-a15f-808385f639b7 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:23:12.853420 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a567e-12d5-4ab1-a15f-808385f639b7 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:23:12.853809 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a567e-12d5-4ab1-a15f-808385f639b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:23:12.956151 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:23:12.960511 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-a50a567e-12d5-4ab1-a15f-808385f639b7 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:23:12.962110 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-a50a567e-12d5-4ab1-a15f-808385f639b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:23:13.080497 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 721/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 15:23:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:23:13.121707 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b4c12e-b58a-421d-a357-06017e4a5a02 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:23:13.123469 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-48b4c12e-b58a-421d-a357-06017e4a5a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:23:13.282604 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b4c12e-b58a-421d-a357-06017e4a5a02 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:23:13.369314 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:23:13.404717 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef2804f-0969-40bb-a41b-264190e57a2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:23:13.405354 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2804f-0969-40bb-a41b-264190e57a2f service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:23:13.405642 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2804f-0969-40bb-a41b-264190e57a2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:23:13.405916 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2804f-0969-40bb-a41b-264190e57a2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:23:13.407698 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-5ef2804f-0969-40bb-a41b-264190e57a2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:23:13.578363 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef2804f-0969-40bb-a41b-264190e57a2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:23:13.580077 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef2804f-0969-40bb-a41b-264190e57a2f service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:23:13.603208 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 734/1455] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:23:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:23:15.967359 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55571101-dda8-4eae-a123-cf560eafd71c None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:23:15.967956 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55571101-dda8-4eae-a123-cf560eafd71c None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:23:15.967956 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55571101-dda8-4eae-a123-cf560eafd71c None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:23:15.969300 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 722/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 15:23:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:23:15.975491 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20a59f-9ac4-4d56-8fa5-d3b196963e0b None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:23:15.976302 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20a59f-9ac4-4d56-8fa5-d3b196963e0b None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:23:15.976496 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20a59f-9ac4-4d56-8fa5-d3b196963e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:23:16.067092 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-4f20a59f-9ac4-4d56-8fa5-d3b196963e0b None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:23:16.068450 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-4f20a59f-9ac4-4d56-8fa5-d3b196963e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:23:16.106731 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:23:16.200026 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 735/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 15:23:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:23:16.241977 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55571101-dda8-4eae-a123-cf560eafd71c None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:23:16.243752 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-55571101-dda8-4eae-a123-cf560eafd71c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:23:16.397728 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55571101-dda8-4eae-a123-cf560eafd71c None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:23:16.444693 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:23:16.513460 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bba68a-6bf7-4c8b-b3d1-5389de819fcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:23:16.514088 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bba68a-6bf7-4c8b-b3d1-5389de819fcc service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:23:16.514368 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bba68a-6bf7-4c8b-b3d1-5389de819fcc service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:23:16.514639 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bba68a-6bf7-4c8b-b3d1-5389de819fcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:23:16.516576 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-06bba68a-6bf7-4c8b-b3d1-5389de819fcc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:23:16.650855 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bba68a-6bf7-4c8b-b3d1-5389de819fcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:23:16.652392 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bba68a-6bf7-4c8b-b3d1-5389de819fcc service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:23:16.683821 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 723/1458] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:23:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:23:19.028890 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99edfa5-325c-4e65-b473-9c95b81fb2ca None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:23:19.029568 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99edfa5-325c-4e65-b473-9c95b81fb2ca None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:23:19.029568 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99edfa5-325c-4e65-b473-9c95b81fb2ca None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:23:19.030823 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 736/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 15:23:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:23:19.038476 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3204f-6beb-4bfb-b5a4-b88a73d85b7c None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:23:19.039695 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3204f-6beb-4bfb-b5a4-b88a73d85b7c None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:23:19.039695 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3204f-6beb-4bfb-b5a4-b88a73d85b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:23:19.121550 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-91f3204f-6beb-4bfb-b5a4-b88a73d85b7c None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:23:19.122878 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-91f3204f-6beb-4bfb-b5a4-b88a73d85b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:23:19.132921 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:23:19.268747 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 724/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 15:23:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:23:19.311783 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99edfa5-325c-4e65-b473-9c95b81fb2ca None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:23:19.313639 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-a99edfa5-325c-4e65-b473-9c95b81fb2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:23:19.440868 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99edfa5-325c-4e65-b473-9c95b81fb2ca None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:23:19.525839 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:23:19.556255 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082feb37-41d8-4fcb-95d0-feca573079b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:23:19.556852 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082feb37-41d8-4fcb-95d0-feca573079b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:23:19.557183 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082feb37-41d8-4fcb-95d0-feca573079b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:23:19.557547 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082feb37-41d8-4fcb-95d0-feca573079b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:23:19.559369 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-082feb37-41d8-4fcb-95d0-feca573079b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:23:19.697268 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082feb37-41d8-4fcb-95d0-feca573079b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:23:19.698913 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082feb37-41d8-4fcb-95d0-feca573079b5 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:23:19.718931 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 737/1461] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:23:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:23:21.953888 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf87b9-12e8-4613-bc04-5b943e1f9a9f None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:23:21.954556 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf87b9-12e8-4613-bc04-5b943e1f9a9f None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:23:21.954556 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf87b9-12e8-4613-bc04-5b943e1f9a9f None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:23:21.956057 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 725/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 15:23:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:23:21.962213 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aad6c7-988e-4666-bccb-cb93e23848d4 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:23:21.962800 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aad6c7-988e-4666-bccb-cb93e23848d4 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:23:21.962800 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aad6c7-988e-4666-bccb-cb93e23848d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:23:22.043548 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-d8aad6c7-988e-4666-bccb-cb93e23848d4 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:23:22.044821 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-d8aad6c7-988e-4666-bccb-cb93e23848d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:23:22.089373 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:23:22.160080 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 738/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 15:23:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:23:22.201333 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf87b9-12e8-4613-bc04-5b943e1f9a9f None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:23:22.204388 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-4adf87b9-12e8-4613-bc04-5b943e1f9a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:23:22.435072 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf87b9-12e8-4613-bc04-5b943e1f9a9f None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:23:22.489927 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:23:22.534920 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bfa632-5511-4ae4-8b46-06b4f363b108 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:23:22.535586 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bfa632-5511-4ae4-8b46-06b4f363b108 service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:23:22.535870 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bfa632-5511-4ae4-8b46-06b4f363b108 service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:23:22.536143 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bfa632-5511-4ae4-8b46-06b4f363b108 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:23:22.537899 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-e1bfa632-5511-4ae4-8b46-06b4f363b108 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:23:22.674335 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bfa632-5511-4ae4-8b46-06b4f363b108 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:23:22.676054 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bfa632-5511-4ae4-8b46-06b4f363b108 service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:23:22.699731 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 726/1464] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:23:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:23:24.948215 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a5fb8-275f-4f88-8dca-16ba59e2c40e None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:23:24.949096 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a5fb8-275f-4f88-8dca-16ba59e2c40e None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:23:24.949274 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a5fb8-275f-4f88-8dca-16ba59e2c40e None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:23:24.951059 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 739/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 15:23:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:23:24.960896 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92f4f0-fbae-4324-91d1-15054b05b319 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:23:24.962244 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92f4f0-fbae-4324-91d1-15054b05b319 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:23:24.962413 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92f4f0-fbae-4324-91d1-15054b05b319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:23:25.090164 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-af92f4f0-fbae-4324-91d1-15054b05b319 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:23:25.092347 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-af92f4f0-fbae-4324-91d1-15054b05b319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:23:25.116364 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:23:25.223422 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 727/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 15:23:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:23:25.280850 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a5fb8-275f-4f88-8dca-16ba59e2c40e None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:23:25.282569 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-922a5fb8-275f-4f88-8dca-16ba59e2c40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:23:25.409102 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a5fb8-275f-4f88-8dca-16ba59e2c40e None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:23:25.487155 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:23:25.495823 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af786feb-49e6-47ba-9895-bb7d8f5f510a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:23:25.496451 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af786feb-49e6-47ba-9895-bb7d8f5f510a service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:23:25.496728 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af786feb-49e6-47ba-9895-bb7d8f5f510a service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:23:25.497004 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af786feb-49e6-47ba-9895-bb7d8f5f510a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:23:25.498680 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-af786feb-49e6-47ba-9895-bb7d8f5f510a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:23:25.632401 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af786feb-49e6-47ba-9895-bb7d8f5f510a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:23:25.635735 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af786feb-49e6-47ba-9895-bb7d8f5f510a service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:23:25.668423 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 740/1467] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:23:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:23:27.782304 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7502187-186f-4bc6-a5e7-5aa74a656e10 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:23:27.782880 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7502187-186f-4bc6-a5e7-5aa74a656e10 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:23:27.782880 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7502187-186f-4bc6-a5e7-5aa74a656e10 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:23:27.784269 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 728/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 15:23:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:23:27.790247 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a404f6e-dad5-4b83-aabd-ee5e62e5f6fd None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:23:27.790800 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a404f6e-dad5-4b83-aabd-ee5e62e5f6fd None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:23:27.791042 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a404f6e-dad5-4b83-aabd-ee5e62e5f6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:23:27.866286 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-6a404f6e-dad5-4b83-aabd-ee5e62e5f6fd None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:23:27.868273 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-6a404f6e-dad5-4b83-aabd-ee5e62e5f6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:23:27.924778 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:23:27.983429 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 741/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 15:23:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:23:28.035209 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7502187-186f-4bc6-a5e7-5aa74a656e10 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:23:28.036708 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-d7502187-186f-4bc6-a5e7-5aa74a656e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:23:28.165560 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7502187-186f-4bc6-a5e7-5aa74a656e10 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:23:28.242561 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:23:28.271439 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8658c2c2-14ae-4ffc-88d8-28292c2b216e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:23:28.272076 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8658c2c2-14ae-4ffc-88d8-28292c2b216e service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:23:28.272360 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8658c2c2-14ae-4ffc-88d8-28292c2b216e service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:23:28.272642 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8658c2c2-14ae-4ffc-88d8-28292c2b216e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:23:28.274872 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-8658c2c2-14ae-4ffc-88d8-28292c2b216e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:23:28.392124 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8658c2c2-14ae-4ffc-88d8-28292c2b216e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:23:28.393531 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8658c2c2-14ae-4ffc-88d8-28292c2b216e service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:23:28.412791 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 729/1470] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:23:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:23:37.981176 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=22 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:23:38.410134 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=66 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:23:48.713213 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63cd2a9-261d-4436-b8ed-fa579e2f1cd2 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:23:48.713771 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63cd2a9-261d-4436-b8ed-fa579e2f1cd2 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:23:48.713771 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63cd2a9-261d-4436-b8ed-fa579e2f1cd2 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:23:48.715129 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 742/1471] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:23:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:23:48.720281 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce289b4-7cfd-4403-b63b-dd1fcd0c5e6d None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:23:48.720699 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce289b4-7cfd-4403-b63b-dd1fcd0c5e6d None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:23:48.720900 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce289b4-7cfd-4403-b63b-dd1fcd0c5e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:23:48.786008 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-4ce289b4-7cfd-4403-b63b-dd1fcd0c5e6d None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:23:48.787251 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-4ce289b4-7cfd-4403-b63b-dd1fcd0c5e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:23:48.884482 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 730/1472] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:23:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:23:48.969007 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c296c60-c017-4d9c-b89f-36ae382ad9c1 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:23:48.969290 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c296c60-c017-4d9c-b89f-36ae382ad9c1 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:23:48.969566 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c296c60-c017-4d9c-b89f-36ae382ad9c1 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:23:48.970898 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 743/1473] 10.222.0.42 () {54 vars in 966 bytes} [Tue Aug 2 15:23:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:23:48.976535 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22db39-fe28-4690-ae77-6f31548c5ac0 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:23:48.976825 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22db39-fe28-4690-ae77-6f31548c5ac0 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:23:48.977101 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22db39-fe28-4690-ae77-6f31548c5ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:23:49.059489 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-1f22db39-fe28-4690-ae77-6f31548c5ac0 None None] MFA Rules not processed for user `946af31d75ca41a2a4301e0294cf98f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:23:49.060734 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-1f22db39-fe28-4690-ae77-6f31548c5ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:23:49.083475 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:23:49.141910 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 731/1474] 10.222.0.42 () {58 vars in 1063 bytes} [Tue Aug 2 15:23:48 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:23:49.149930 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c296c60-c017-4d9c-b89f-36ae382ad9c1 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:23:49.151503 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-4c296c60-c017-4d9c-b89f-36ae382ad9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:23:49.268514 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c296c60-c017-4d9c-b89f-36ae382ad9c1 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:23:49.362772 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268a8086-e260-4e9d-8dfb-7a86fb9fb96f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946af31d75ca41a2a4301e0294cf98f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:23:49.363497 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a8086-e260-4e9d-8dfb-7a86fb9fb96f service glance] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:23:49.363781 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a8086-e260-4e9d-8dfb-7a86fb9fb96f service glance] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:23:49.364057 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a8086-e260-4e9d-8dfb-7a86fb9fb96f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:23:49.365707 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-268a8086-e260-4e9d-8dfb-7a86fb9fb96f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:23:49.430101 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:23:49.489614 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268a8086-e260-4e9d-8dfb-7a86fb9fb96f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:23:49.491071 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268a8086-e260-4e9d-8dfb-7a86fb9fb96f service glance] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:23:49.511049 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 744/1475] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:23:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:23:51.625991 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66765d60-c36b-4075-8264-a84ddcb351b7 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:23:51.626559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66765d60-c36b-4075-8264-a84ddcb351b7 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:23:51.626559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66765d60-c36b-4075-8264-a84ddcb351b7 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:23:51.627967 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 732/1476] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:23:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:23:51.633807 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8ef33-514e-4502-8c9e-2695df374ed5 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:23:51.634348 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8ef33-514e-4502-8c9e-2695df374ed5 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:23:51.634348 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8ef33-514e-4502-8c9e-2695df374ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:23:51.708561 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-88e8ef33-514e-4502-8c9e-2695df374ed5 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:23:51.709787 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-88e8ef33-514e-4502-8c9e-2695df374ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:23:51.813742 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 745/1477] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:23:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:23:51.836637 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66765d60-c36b-4075-8264-a84ddcb351b7 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:23:51.838188 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-66765d60-c36b-4075-8264-a84ddcb351b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:23:51.979089 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66765d60-c36b-4075-8264-a84ddcb351b7 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:23:52.028294 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:23:52.073188 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9fecb0-0916-4c9f-b01e-f6ddbad02657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:23:52.073720 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9fecb0-0916-4c9f-b01e-f6ddbad02657 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:23:52.073994 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9fecb0-0916-4c9f-b01e-f6ddbad02657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:23:52.074263 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9fecb0-0916-4c9f-b01e-f6ddbad02657 admin admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:23:52.074943 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9fecb0-0916-4c9f-b01e-f6ddbad02657 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:23:52.076704 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: WARNING py.warnings [None req-ae9fecb0-0916-4c9f-b01e-f6ddbad02657 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 15:23:52.076704 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: warnings.warn(msg) Aug 02 15:23:52.076704 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: Aug 02 15:23:52.077824 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9fecb0-0916-4c9f-b01e-f6ddbad02657 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:23:52.096498 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 733/1478] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 2 15:23:51 2022] GET /identity/v3/projects => generated 2553 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:23:54.170648 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d218e5a-4a8a-4d2d-9bbe-0daa6359ca57 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:23:54.171370 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d218e5a-4a8a-4d2d-9bbe-0daa6359ca57 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:23:54.171370 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d218e5a-4a8a-4d2d-9bbe-0daa6359ca57 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:23:54.172924 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 746/1479] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:23:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:23:54.179949 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00065541-5900-49ad-9db8-304edfbfa6e6 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:23:54.180670 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00065541-5900-49ad-9db8-304edfbfa6e6 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:23:54.180670 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00065541-5900-49ad-9db8-304edfbfa6e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:23:54.266812 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-00065541-5900-49ad-9db8-304edfbfa6e6 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:23:54.268886 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-00065541-5900-49ad-9db8-304edfbfa6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:23:54.394104 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 734/1480] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:23:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:23:54.439666 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d218e5a-4a8a-4d2d-9bbe-0daa6359ca57 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:23:54.441290 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-2d218e5a-4a8a-4d2d-9bbe-0daa6359ca57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:23:54.452397 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:23:54.599841 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d218e5a-4a8a-4d2d-9bbe-0daa6359ca57 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:23:54.690937 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:23:54.850164 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b18dff2-a480-4ead-8f82-00632fc9cb58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0865af59bf43dfa4c84213d7db53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:23:54.851354 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b18dff2-a480-4ead-8f82-00632fc9cb58 service nova] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:23:54.851626 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b18dff2-a480-4ead-8f82-00632fc9cb58 service nova] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:23:54.851894 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b18dff2-a480-4ead-8f82-00632fc9cb58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:23:54.853561 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-2b18dff2-a480-4ead-8f82-00632fc9cb58 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:23:54.969399 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b18dff2-a480-4ead-8f82-00632fc9cb58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:23:54.970915 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b18dff2-a480-4ead-8f82-00632fc9cb58 service nova] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:23:54.993065 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 747/1481] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:23:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:23:57.252391 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4fcbb8-00d5-47da-8b37-d8a2b88b49da None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:23:57.252969 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4fcbb8-00d5-47da-8b37-d8a2b88b49da None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:23:57.252969 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4fcbb8-00d5-47da-8b37-d8a2b88b49da None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:23:57.254319 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 735/1482] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:23:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:23:57.260133 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dcc9e6-2572-4b48-8b04-39c27cf75052 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:23:57.260723 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dcc9e6-2572-4b48-8b04-39c27cf75052 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:23:57.260723 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dcc9e6-2572-4b48-8b04-39c27cf75052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:23:57.331281 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-f6dcc9e6-2572-4b48-8b04-39c27cf75052 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:23:57.332429 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-f6dcc9e6-2572-4b48-8b04-39c27cf75052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:23:57.380973 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:23:57.432202 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 748/1483] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:23:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:23:57.467910 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4fcbb8-00d5-47da-8b37-d8a2b88b49da None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:23:57.469447 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-1d4fcbb8-00d5-47da-8b37-d8a2b88b49da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:23:57.493764 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:23:57.576219 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4fcbb8-00d5-47da-8b37-d8a2b88b49da None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:23:57.654721 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919268d3-181a-46db-b13d-3f8a56861a78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:23:57.655340 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919268d3-181a-46db-b13d-3f8a56861a78 service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:23:57.655660 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919268d3-181a-46db-b13d-3f8a56861a78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:23:57.655972 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919268d3-181a-46db-b13d-3f8a56861a78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:23:57.657677 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-919268d3-181a-46db-b13d-3f8a56861a78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:23:57.738337 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:23:57.776641 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919268d3-181a-46db-b13d-3f8a56861a78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:23:57.778089 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919268d3-181a-46db-b13d-3f8a56861a78 service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:23:57.797749 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 736/1484] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:23:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:23:59.913992 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb587d-1500-4dca-bc04-268b0b30a76f None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:23:59.914508 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb587d-1500-4dca-bc04-268b0b30a76f None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:23:59.914508 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb587d-1500-4dca-bc04-268b0b30a76f None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:23:59.915857 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 749/1485] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:23:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:23:59.921664 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3a901-84cd-4de7-8d5d-7a8dd11a9bf6 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:23:59.922095 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3a901-84cd-4de7-8d5d-7a8dd11a9bf6 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:23:59.922241 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3a901-84cd-4de7-8d5d-7a8dd11a9bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:23:59.995237 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-9de3a901-84cd-4de7-8d5d-7a8dd11a9bf6 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:23:59.996461 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-9de3a901-84cd-4de7-8d5d-7a8dd11a9bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:24:00.093224 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 737/1486] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:23:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:24:00.132446 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb587d-1500-4dca-bc04-268b0b30a76f None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:24:00.134002 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-2ceb587d-1500-4dca-bc04-268b0b30a76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:24:00.258716 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb587d-1500-4dca-bc04-268b0b30a76f None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:24:00.353521 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:24:00.355711 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f3482-b90d-40a7-870f-f9b333ef73eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:24:00.356384 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f3482-b90d-40a7-870f-f9b333ef73eb service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:24:00.356856 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f3482-b90d-40a7-870f-f9b333ef73eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:24:00.357305 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f3482-b90d-40a7-870f-f9b333ef73eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:24:00.359195 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-fa7f3482-b90d-40a7-870f-f9b333ef73eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:24:00.484277 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7f3482-b90d-40a7-870f-f9b333ef73eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:24:00.487482 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7f3482-b90d-40a7-870f-f9b333ef73eb service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:24:00.508242 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 750/1487] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:24:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:24:02.734047 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33871a-58b4-4db3-aaeb-81aef8da6408 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:24:02.734608 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33871a-58b4-4db3-aaeb-81aef8da6408 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:24:02.734608 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33871a-58b4-4db3-aaeb-81aef8da6408 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:24:02.735918 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 738/1488] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:24:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:24:02.741990 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7b9e5-d22c-4d30-92dc-c5b8c4ae45d2 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:24:02.742434 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7b9e5-d22c-4d30-92dc-c5b8c4ae45d2 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:24:02.742547 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7b9e5-d22c-4d30-92dc-c5b8c4ae45d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:24:02.808181 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-cce7b9e5-d22c-4d30-92dc-c5b8c4ae45d2 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:24:02.809391 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-cce7b9e5-d22c-4d30-92dc-c5b8c4ae45d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:24:02.861861 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:24:02.906955 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 751/1489] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:24:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:24:02.948560 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e33871a-58b4-4db3-aaeb-81aef8da6408 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:24:02.950093 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-4e33871a-58b4-4db3-aaeb-81aef8da6408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:24:02.988376 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:24:03.059604 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e33871a-58b4-4db3-aaeb-81aef8da6408 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:24:03.132247 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d58ae3-fea8-49cd-9ee2-f9f2414c98ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:24:03.132882 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d58ae3-fea8-49cd-9ee2-f9f2414c98ed service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:24:03.133149 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d58ae3-fea8-49cd-9ee2-f9f2414c98ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:24:03.133424 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d58ae3-fea8-49cd-9ee2-f9f2414c98ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:24:03.135063 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-23d58ae3-fea8-49cd-9ee2-f9f2414c98ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:24:03.215929 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:24:03.245779 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d58ae3-fea8-49cd-9ee2-f9f2414c98ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:24:03.247145 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d58ae3-fea8-49cd-9ee2-f9f2414c98ed service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:24:03.266134 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 739/1490] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:24:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:24:05.466184 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b36792-a111-435f-b9e9-c8c663e32bce None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:24:05.466753 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b36792-a111-435f-b9e9-c8c663e32bce None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:24:05.466753 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b36792-a111-435f-b9e9-c8c663e32bce None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:24:05.468131 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 752/1491] 10.222.0.42 () {54 vars in 926 bytes} [Tue Aug 2 15:24:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:24:05.473605 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d6c5f-0075-497e-a279-22fb001c3e61 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:24:05.474065 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d6c5f-0075-497e-a279-22fb001c3e61 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:24:05.474172 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d6c5f-0075-497e-a279-22fb001c3e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:24:05.545582 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-893d6c5f-0075-497e-a279-22fb001c3e61 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:24:05.546789 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-893d6c5f-0075-497e-a279-22fb001c3e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:24:05.647700 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 740/1492] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Aug 2 15:24:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:24:05.686514 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b36792-a111-435f-b9e9-c8c663e32bce None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:24:05.688061 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-77b36792-a111-435f-b9e9-c8c663e32bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:24:05.792407 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b36792-a111-435f-b9e9-c8c663e32bce None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:24:05.867674 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670169d8-3c04-45e9-93b1-6863718ac6c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:24:05.868301 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670169d8-3c04-45e9-93b1-6863718ac6c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:24:05.868609 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670169d8-3c04-45e9-93b1-6863718ac6c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:24:05.869012 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670169d8-3c04-45e9-93b1-6863718ac6c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:24:05.870884 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-670169d8-3c04-45e9-93b1-6863718ac6c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:24:05.885012 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:24:05.991187 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670169d8-3c04-45e9-93b1-6863718ac6c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:24:05.992640 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670169d8-3c04-45e9-93b1-6863718ac6c7 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:24:06.011312 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 753/1493] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:24:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:24:15.645838 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=82 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:24:16.009092 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=50 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:25:47.465398 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500740d0-20b2-4882-a69e-1722cee01739 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:25:47.466068 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500740d0-20b2-4882-a69e-1722cee01739 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:25:47.466068 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500740d0-20b2-4882-a69e-1722cee01739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:25:47.546467 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-500740d0-20b2-4882-a69e-1722cee01739 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:25:47.547692 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-500740d0-20b2-4882-a69e-1722cee01739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:25:47.648034 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 741/1494] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:25:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:25:47.656228 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168788f5-6cbd-4154-97d5-500b168b0daa None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:25:47.656769 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168788f5-6cbd-4154-97d5-500b168b0daa None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:25:47.656769 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168788f5-6cbd-4154-97d5-500b168b0daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:25:47.678085 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-168788f5-6cbd-4154-97d5-500b168b0daa None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:25:47.679328 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-168788f5-6cbd-4154-97d5-500b168b0daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:25:47.687960 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 754/1495] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:25:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:25:47.693186 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500740d0-20b2-4882-a69e-1722cee01739 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:25:47.702746 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500740d0-20b2-4882-a69e-1722cee01739 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:25:47.707372 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75086ff1-d72e-4852-8e69-90e647baa410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:25:47.707977 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75086ff1-d72e-4852-8e69-90e647baa410 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:25:47.708258 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75086ff1-d72e-4852-8e69-90e647baa410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:25:47.708540 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75086ff1-d72e-4852-8e69-90e647baa410 admin admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:25:47.709222 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75086ff1-d72e-4852-8e69-90e647baa410 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:25:47.710025 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75086ff1-d72e-4852-8e69-90e647baa410 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:25:47.711033 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: WARNING py.warnings [None req-75086ff1-d72e-4852-8e69-90e647baa410 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 15:25:47.711033 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: warnings.warn(msg) Aug 02 15:25:47.711033 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: Aug 02 15:25:47.711959 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75086ff1-d72e-4852-8e69-90e647baa410 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:25:47.723880 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 742/1496] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 2 15:25:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:25:47.732081 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168788f5-6cbd-4154-97d5-500b168b0daa None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:25:47.741956 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168788f5-6cbd-4154-97d5-500b168b0daa None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:25:47.746507 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bec0b5f-7080-47f4-b234-9f0c7ba6b8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:25:47.747111 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec0b5f-7080-47f4-b234-9f0c7ba6b8ce admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:25:47.747425 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec0b5f-7080-47f4-b234-9f0c7ba6b8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:25:47.747701 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec0b5f-7080-47f4-b234-9f0c7ba6b8ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:25:47.748368 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bec0b5f-7080-47f4-b234-9f0c7ba6b8ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:25:47.750099 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: WARNING py.warnings [None req-3bec0b5f-7080-47f4-b234-9f0c7ba6b8ce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 15:25:47.750099 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: warnings.warn(msg) Aug 02 15:25:47.750099 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: Aug 02 15:25:47.751305 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bec0b5f-7080-47f4-b234-9f0c7ba6b8ce admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:25:47.790355 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 755/1497] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:25:47 2022] POST /identity/v3/projects => generated 377 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:25:47.795001 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75086ff1-d72e-4852-8e69-90e647baa410 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:25:47.805728 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75086ff1-d72e-4852-8e69-90e647baa410 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:25:47.855122 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:25:47.864118 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a12938-b4c4-4f87-8e1c-d7008c7c53dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:25:47.864937 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a12938-b4c4-4f87-8e1c-d7008c7c53dd admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:25:47.865255 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a12938-b4c4-4f87-8e1c-d7008c7c53dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:25:47.865631 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a12938-b4c4-4f87-8e1c-d7008c7c53dd admin admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:25:47.866661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a12938-b4c4-4f87-8e1c-d7008c7c53dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:25:47.868166 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: WARNING py.warnings [None req-d4a12938-b4c4-4f87-8e1c-d7008c7c53dd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 15:25:47.868166 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: warnings.warn(msg) Aug 02 15:25:47.868166 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: Aug 02 15:25:47.870026 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a12938-b4c4-4f87-8e1c-d7008c7c53dd admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:25:47.891489 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 743/1498] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:25:47 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 15:25:47.896155 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bec0b5f-7080-47f4-b234-9f0c7ba6b8ce admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:25:47.906581 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bec0b5f-7080-47f4-b234-9f0c7ba6b8ce admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:25:47.911774 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b440c-d379-4992-80d5-6b15707265cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:25:47.912379 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b440c-d379-4992-80d5-6b15707265cc admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:25:47.912663 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b440c-d379-4992-80d5-6b15707265cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:25:47.912938 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b440c-d379-4992-80d5-6b15707265cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:25:47.913632 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21b440c-d379-4992-80d5-6b15707265cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:25:47.914811 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: WARNING py.warnings [None req-c21b440c-d379-4992-80d5-6b15707265cc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 15:25:47.914811 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: warnings.warn(msg) Aug 02 15:25:47.914811 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: Aug 02 15:25:47.915801 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21b440c-d379-4992-80d5-6b15707265cc admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:25:47.929234 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 756/1499] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:25:47.933313 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a12938-b4c4-4f87-8e1c-d7008c7c53dd admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:25:47.943034 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a12938-b4c4-4f87-8e1c-d7008c7c53dd admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:25:47.947613 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43575540-853e-4fb9-9c7b-804239ffbb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:25:47.948215 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43575540-853e-4fb9-9c7b-804239ffbb9f admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:25:47.948497 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43575540-853e-4fb9-9c7b-804239ffbb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:25:47.948771 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43575540-853e-4fb9-9c7b-804239ffbb9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:25:47.949450 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43575540-853e-4fb9-9c7b-804239ffbb9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:25:47.950446 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: WARNING py.warnings [None req-43575540-853e-4fb9-9c7b-804239ffbb9f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 15:25:47.950446 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: warnings.warn(msg) Aug 02 15:25:47.950446 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: Aug 02 15:25:47.951416 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43575540-853e-4fb9-9c7b-804239ffbb9f admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:25:47.967676 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 744/1500] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:25:47.971988 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b440c-d379-4992-80d5-6b15707265cc admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:25:47.983073 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b440c-d379-4992-80d5-6b15707265cc admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:25:47.988460 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04431f6f-9e2b-4a9b-84f4-215393d41270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:25:47.989155 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04431f6f-9e2b-4a9b-84f4-215393d41270 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:25:47.989423 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04431f6f-9e2b-4a9b-84f4-215393d41270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:25:47.989703 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04431f6f-9e2b-4a9b-84f4-215393d41270 admin admin] PATH_INFO: `/v3/projects/b11f33990a1d49ef845cb6f53c18aa83/users/b1ace0ac91b142028bbe08f8ed6d4cc4/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:25:48.004626 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04431f6f-9e2b-4a9b-84f4-215393d41270 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b11f33990a1d49ef845cb6f53c18aa83, user_id=b1ace0ac91b142028bbe08f8ed6d4cc4, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:25:48.005671 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: WARNING py.warnings [None req-04431f6f-9e2b-4a9b-84f4-215393d41270 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 15:25:48.005671 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: warnings.warn(msg) Aug 02 15:25:48.005671 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: Aug 02 15:25:48.007627 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04431f6f-9e2b-4a9b-84f4-215393d41270 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:25:48.021296 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 757/1501] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:25:47 2022] PUT /identity/v3/projects/b11f33990a1d49ef845cb6f53c18aa83/users/b1ace0ac91b142028bbe08f8ed6d4cc4/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:25:48.033390 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dcfab9-1234-4862-b7c4-9315489cff12 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:25:48.033679 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dcfab9-1234-4862-b7c4-9315489cff12 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:25:48.033958 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dcfab9-1234-4862-b7c4-9315489cff12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:25:48.061674 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-f0dcfab9-1234-4862-b7c4-9315489cff12 None None] MFA Rules not processed for user `b1ace0ac91b142028bbe08f8ed6d4cc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:25:48.062875 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-f0dcfab9-1234-4862-b7c4-9315489cff12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:25:48.126425 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 745/1502] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:25:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:25:48.139902 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8758e3f-a9da-4be8-a07b-be2ed8ee2cda None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:25:48.140197 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8758e3f-a9da-4be8-a07b-be2ed8ee2cda None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:25:48.140475 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8758e3f-a9da-4be8-a07b-be2ed8ee2cda None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:25:48.141846 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 758/1503] 10.222.0.42 () {54 vars in 964 bytes} [Tue Aug 2 15:25:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:25:48.147658 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78659d9-9819-4002-92a8-9ad88dc6e890 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:25:48.147948 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78659d9-9819-4002-92a8-9ad88dc6e890 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:25:48.148224 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78659d9-9819-4002-92a8-9ad88dc6e890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:25:48.211438 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-a78659d9-9819-4002-92a8-9ad88dc6e890 None None] MFA Rules not processed for user `8d09126f1821420bb4218b611c89402a`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:25:48.212672 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-a78659d9-9819-4002-92a8-9ad88dc6e890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:25:48.293920 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 746/1504] 10.222.0.42 () {58 vars in 1061 bytes} [Tue Aug 2 15:25:48 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:25:48.301543 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8758e3f-a9da-4be8-a07b-be2ed8ee2cda None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:25:48.311973 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8758e3f-a9da-4be8-a07b-be2ed8ee2cda None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:25:48.315451 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af80bc-65be-48c0-b771-bbc7eb70c2aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:25:48.316051 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af80bc-65be-48c0-b771-bbc7eb70c2aa service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:25:48.316336 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af80bc-65be-48c0-b771-bbc7eb70c2aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:25:48.317111 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af80bc-65be-48c0-b771-bbc7eb70c2aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:25:48.325214 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61af80bc-65be-48c0-b771-bbc7eb70c2aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:25:48.326650 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61af80bc-65be-48c0-b771-bbc7eb70c2aa service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:25:48.336307 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 759/1505] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:25:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:25:48.382384 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc01728-3bbe-4872-ab1a-aaeeb22da0b8 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:25:48.382675 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc01728-3bbe-4872-ab1a-aaeeb22da0b8 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:25:48.382956 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc01728-3bbe-4872-ab1a-aaeeb22da0b8 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:25:48.384294 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 747/1506] 10.222.0.42 () {52 vars in 830 bytes} [Tue Aug 2 15:25:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:25:48.388226 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af80bc-65be-48c0-b771-bbc7eb70c2aa service cinder] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:25:48.451410 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af80bc-65be-48c0-b771-bbc7eb70c2aa service cinder] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:25:48.457489 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8df2dc-836b-462e-b364-3f185225b8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:25:48.458751 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8df2dc-836b-462e-b364-3f185225b8b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:25:48.459030 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8df2dc-836b-462e-b364-3f185225b8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:25:48.459347 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8df2dc-836b-462e-b364-3f185225b8b4 admin admin] PATH_INFO: `/v3/users/b1ace0ac91b142028bbe08f8ed6d4cc4` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:25:48.460567 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8df2dc-836b-462e-b364-3f185225b8b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1ace0ac91b142028bbe08f8ed6d4cc4)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:25:48.461588 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: WARNING py.warnings [None req-ed8df2dc-836b-462e-b364-3f185225b8b4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 15:25:48.461588 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: warnings.warn(msg) Aug 02 15:25:48.461588 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: Aug 02 15:25:48.462803 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8df2dc-836b-462e-b364-3f185225b8b4 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:25:48.534389 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-ed8df2dc-836b-462e-b364-3f185225b8b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1ace0ac91b142028bbe08f8ed6d4cc4'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:25:48.559907 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-ed8df2dc-836b-462e-b364-3f185225b8b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1ace0ac91b142028bbe08f8ed6d4cc4'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:25:48.560724 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-ed8df2dc-836b-462e-b364-3f185225b8b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1ace0ac91b142028bbe08f8ed6d4cc4'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:25:48.576167 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-ed8df2dc-836b-462e-b364-3f185225b8b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1ace0ac91b142028bbe08f8ed6d4cc4'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:25:48.580264 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:25:48.588020 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-ed8df2dc-836b-462e-b364-3f185225b8b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1ace0ac91b142028bbe08f8ed6d4cc4'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:25:48.595527 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 760/1507] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:25:48 2022] DELETE /identity/v3/users/b1ace0ac91b142028bbe08f8ed6d4cc4 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:25:48.599965 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61966a-7614-4dab-8606-6e443073a28b None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:25:48.600474 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61966a-7614-4dab-8606-6e443073a28b None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:25:48.600572 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61966a-7614-4dab-8606-6e443073a28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:25:48.619885 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-db61966a-7614-4dab-8606-6e443073a28b None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:25:48.621081 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-db61966a-7614-4dab-8606-6e443073a28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:25:48.630886 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:25:48.681118 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 748/1508] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:25:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:25:48.694144 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8df2dc-836b-462e-b364-3f185225b8b4 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:25:48.695661 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-ed8df2dc-836b-462e-b364-3f185225b8b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:25:48.773769 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8df2dc-836b-462e-b364-3f185225b8b4 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:25:48.777458 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a351fd-c08b-4e40-91f6-667a8b4b5964 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:25:48.778078 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a351fd-c08b-4e40-91f6-667a8b4b5964 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:25:48.778354 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a351fd-c08b-4e40-91f6-667a8b4b5964 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:25:48.778624 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a351fd-c08b-4e40-91f6-667a8b4b5964 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:25:48.787448 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a351fd-c08b-4e40-91f6-667a8b4b5964 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:25:48.788891 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a351fd-c08b-4e40-91f6-667a8b4b5964 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:25:48.798273 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 761/1509] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:25:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:25:49.169719 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61966a-7614-4dab-8606-6e443073a28b None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:25:49.171168 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-db61966a-7614-4dab-8606-6e443073a28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:25:49.183589 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61966a-7614-4dab-8606-6e443073a28b None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:25:49.188535 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3feb08-cdfe-4ba8-8eb5-6665d16b29f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:25:49.189199 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3feb08-cdfe-4ba8-8eb5-6665d16b29f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:25:49.189504 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3feb08-cdfe-4ba8-8eb5-6665d16b29f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:25:49.189788 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3feb08-cdfe-4ba8-8eb5-6665d16b29f2 admin admin] PATH_INFO: `/v3/projects/b11f33990a1d49ef845cb6f53c18aa83` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:25:49.190971 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3feb08-cdfe-4ba8-8eb5-6665d16b29f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b11f33990a1d49ef845cb6f53c18aa83)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:25:49.192048 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: WARNING py.warnings [None req-ee3feb08-cdfe-4ba8-8eb5-6665d16b29f2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 15:25:49.192048 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: warnings.warn(msg) Aug 02 15:25:49.192048 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: Aug 02 15:25:49.193756 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3feb08-cdfe-4ba8-8eb5-6665d16b29f2 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:25:49.258226 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-ee3feb08-cdfe-4ba8-8eb5-6665d16b29f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b11f33990a1d49ef845cb6f53c18aa83', 'request_id': 'req-ee3feb08-cdfe-4ba8-8eb5-6665d16b29f2'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:25:49.271761 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-ee3feb08-cdfe-4ba8-8eb5-6665d16b29f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b11f33990a1d49ef845cb6f53c18aa83', 'request_id': 'req-ee3feb08-cdfe-4ba8-8eb5-6665d16b29f2'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:25:49.286940 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-ee3feb08-cdfe-4ba8-8eb5-6665d16b29f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b11f33990a1d49ef845cb6f53c18aa83', 'request_id': 'req-ee3feb08-cdfe-4ba8-8eb5-6665d16b29f2'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:25:49.298982 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-ee3feb08-cdfe-4ba8-8eb5-6665d16b29f2 admin admin] The token cache is being invalidate because project b11f33990a1d49ef845cb6f53c18aa83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80360) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:25:49.299300 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-ee3feb08-cdfe-4ba8-8eb5-6665d16b29f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:25:49.300125 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-ee3feb08-cdfe-4ba8-8eb5-6665d16b29f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:25:49.302270 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 749/1510] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:25:49 2022] DELETE /identity/v3/projects/b11f33990a1d49ef845cb6f53c18aa83 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:25:58.794323 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:DELETE=1,keystone:SELECT=37 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:25:59.295412 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:27:37.773490 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9d00d-89d4-43bd-b903-d644f905c4f1 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:27:37.774137 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9d00d-89d4-43bd-b903-d644f905c4f1 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:27:37.774137 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9d00d-89d4-43bd-b903-d644f905c4f1 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:27:37.775735 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 762/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 15:27:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:27:37.783010 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf6178f-e5c4-4a39-87cb-732c90cf4f7a None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:27:37.783696 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf6178f-e5c4-4a39-87cb-732c90cf4f7a None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:27:37.783696 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf6178f-e5c4-4a39-87cb-732c90cf4f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:27:37.810379 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-eaf6178f-e5c4-4a39-87cb-732c90cf4f7a None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:27:37.811743 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-eaf6178f-e5c4-4a39-87cb-732c90cf4f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:27:37.883756 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 750/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 15:27:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:27:38.050512 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd9d00d-89d4-43bd-b903-d644f905c4f1 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:27:38.052527 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-7fd9d00d-89d4-43bd-b903-d644f905c4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:27:38.170104 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd9d00d-89d4-43bd-b903-d644f905c4f1 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:27:38.176029 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8bfb0-98f0-451d-8820-579ddd8130b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0865af59bf43dfa4c84213d7db53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:27:38.176667 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8bfb0-98f0-451d-8820-579ddd8130b4 service nova] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:27:38.176946 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8bfb0-98f0-451d-8820-579ddd8130b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:27:38.177217 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8bfb0-98f0-451d-8820-579ddd8130b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:27:38.186640 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b8bfb0-98f0-451d-8820-579ddd8130b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:27:38.188344 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b8bfb0-98f0-451d-8820-579ddd8130b4 service nova] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:27:38.200765 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 763/1513] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:27:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:27:39.079015 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c784787-0099-4c3b-8cde-3e9b557658d4 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:27:39.080251 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c784787-0099-4c3b-8cde-3e9b557658d4 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:27:39.080655 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c784787-0099-4c3b-8cde-3e9b557658d4 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:27:39.083471 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 751/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 15:27:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:27:39.089128 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe8ef0-b6a6-468d-8b63-513584b40e47 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:27:39.089773 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe8ef0-b6a6-468d-8b63-513584b40e47 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:27:39.089773 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe8ef0-b6a6-468d-8b63-513584b40e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:27:39.112051 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-67fe8ef0-b6a6-468d-8b63-513584b40e47 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:27:39.113348 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-67fe8ef0-b6a6-468d-8b63-513584b40e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:27:39.121967 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 764/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 15:27:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:27:39.281715 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c784787-0099-4c3b-8cde-3e9b557658d4 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:27:39.300340 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c784787-0099-4c3b-8cde-3e9b557658d4 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:27:39.307492 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ed438-cdb0-4ee9-8fcb-89e219bfe390 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0865af59bf43dfa4c84213d7db53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:27:39.308136 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ed438-cdb0-4ee9-8fcb-89e219bfe390 service nova] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:27:39.308413 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ed438-cdb0-4ee9-8fcb-89e219bfe390 service nova] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:27:39.308687 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ed438-cdb0-4ee9-8fcb-89e219bfe390 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:27:39.317783 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75ed438-cdb0-4ee9-8fcb-89e219bfe390 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:27:39.319425 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75ed438-cdb0-4ee9-8fcb-89e219bfe390 service nova] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:27:39.331173 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 752/1516] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:27:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:27:40.381591 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63a2d8-fbc6-422d-967e-9d4b9de46d23 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:27:40.382228 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63a2d8-fbc6-422d-967e-9d4b9de46d23 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:27:40.382228 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63a2d8-fbc6-422d-967e-9d4b9de46d23 None None] PATH_INFO: `/v3` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:27:40.383695 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 765/1517] 10.222.0.65 () {54 vars in 925 bytes} [Tue Aug 2 15:27:40 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:27:40.391185 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2d734-a50e-4f28-a7a5-46cbf00c4a04 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:27:40.391838 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2d734-a50e-4f28-a7a5-46cbf00c4a04 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:27:40.391838 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2d734-a50e-4f28-a7a5-46cbf00c4a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:27:40.453661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-14a2d734-a50e-4f28-a7a5-46cbf00c4a04 None None] MFA Rules not processed for user `57dfafee636a45ca98fe0e8bb13dd754`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:27:40.455491 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-14a2d734-a50e-4f28-a7a5-46cbf00c4a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:27:40.539132 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 753/1518] 10.222.0.65 () {58 vars in 1015 bytes} [Tue Aug 2 15:27:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:27:49.105768 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=49 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:27:50.176678 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e535e-2caa-4e51-b45c-8cd4def913c7 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:27:50.177759 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e535e-2caa-4e51-b45c-8cd4def913c7 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:27:50.177759 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e535e-2caa-4e51-b45c-8cd4def913c7 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:27:50.180521 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 766/1519] 10.222.0.42 () {54 vars in 961 bytes} [Tue Aug 2 15:27:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:27:50.189631 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80fa4e1-29f3-4e50-b9ab-f4f24ffdbf59 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:27:50.190218 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80fa4e1-29f3-4e50-b9ab-f4f24ffdbf59 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:27:50.190327 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80fa4e1-29f3-4e50-b9ab-f4f24ffdbf59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:27:50.213784 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-c80fa4e1-29f3-4e50-b9ab-f4f24ffdbf59 None None] MFA Rules not processed for user `57dfafee636a45ca98fe0e8bb13dd754`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:27:50.215604 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-c80fa4e1-29f3-4e50-b9ab-f4f24ffdbf59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:27:50.226101 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 754/1520] 10.222.0.42 () {58 vars in 1058 bytes} [Tue Aug 2 15:27:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:27:50.235300 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e535e-2caa-4e51-b45c-8cd4def913c7 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:27:50.259139 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e535e-2caa-4e51-b45c-8cd4def913c7 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:27:50.267995 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79f77d-376c-4d18-b8e6-31e4ec6dbea6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57dfafee636a45ca98fe0e8bb13dd754', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:27:50.269008 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79f77d-376c-4d18-b8e6-31e4ec6dbea6 service placement] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:27:50.269490 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79f77d-376c-4d18-b8e6-31e4ec6dbea6 service placement] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:27:50.269956 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79f77d-376c-4d18-b8e6-31e4ec6dbea6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:27:50.286195 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc79f77d-376c-4d18-b8e6-31e4ec6dbea6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:27:50.289087 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc79f77d-376c-4d18-b8e6-31e4ec6dbea6 service placement] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:27:50.308667 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 767/1521] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:27:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:27:50.720740 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc1e5cc-21f7-48ee-9391-3ee940900e8c None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:27:50.721042 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc1e5cc-21f7-48ee-9391-3ee940900e8c None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:27:50.721296 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc1e5cc-21f7-48ee-9391-3ee940900e8c None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:27:50.722789 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 755/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 15:27:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 15:27:50.729008 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5baafea-003c-488f-a334-8079b8466ed0 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:27:50.729293 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5baafea-003c-488f-a334-8079b8466ed0 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:27:50.729576 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5baafea-003c-488f-a334-8079b8466ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:27:50.751426 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-c5baafea-003c-488f-a334-8079b8466ed0 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:27:50.752867 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-c5baafea-003c-488f-a334-8079b8466ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:27:50.761389 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 768/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 15:27:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:27:50.922865 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc1e5cc-21f7-48ee-9391-3ee940900e8c None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:27:50.941377 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc1e5cc-21f7-48ee-9391-3ee940900e8c None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:27:50.947558 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fccadb-53f0-4a53-8e64-2faf13ca464c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0865af59bf43dfa4c84213d7db53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:27:50.948196 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fccadb-53f0-4a53-8e64-2faf13ca464c service nova] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:27:50.948484 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fccadb-53f0-4a53-8e64-2faf13ca464c service nova] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:27:50.948755 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fccadb-53f0-4a53-8e64-2faf13ca464c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:27:50.958268 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fccadb-53f0-4a53-8e64-2faf13ca464c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:27:50.959994 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fccadb-53f0-4a53-8e64-2faf13ca464c service nova] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:27:50.971786 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 756/1524] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:27:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:27:51.867540 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994acd5b-82a8-4672-a3eb-5fe24f2876f2 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:27:51.868427 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994acd5b-82a8-4672-a3eb-5fe24f2876f2 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:27:51.868427 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994acd5b-82a8-4672-a3eb-5fe24f2876f2 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:27:51.869964 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 769/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 15:27:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:27:51.875892 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa51306-a5af-4eae-a4e9-0363dd7c1043 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:27:51.876544 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa51306-a5af-4eae-a4e9-0363dd7c1043 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:27:51.876733 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa51306-a5af-4eae-a4e9-0363dd7c1043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:27:51.898323 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-ffa51306-a5af-4eae-a4e9-0363dd7c1043 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:27:51.899718 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-ffa51306-a5af-4eae-a4e9-0363dd7c1043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:27:51.908481 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 757/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 15:27:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:27:52.064933 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994acd5b-82a8-4672-a3eb-5fe24f2876f2 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:27:52.080070 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994acd5b-82a8-4672-a3eb-5fe24f2876f2 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:27:52.086041 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920ed82c-6e74-462b-b025-8ff5e0d5d358 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0865af59bf43dfa4c84213d7db53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:27:52.086677 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ed82c-6e74-462b-b025-8ff5e0d5d358 service nova] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:27:52.086958 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ed82c-6e74-462b-b025-8ff5e0d5d358 service nova] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:27:52.087260 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ed82c-6e74-462b-b025-8ff5e0d5d358 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:27:52.096917 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920ed82c-6e74-462b-b025-8ff5e0d5d358 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:27:52.098619 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920ed82c-6e74-462b-b025-8ff5e0d5d358 service nova] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:27:52.109518 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 770/1527] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:27:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:27:56.696708 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf31331-fbe4-4da7-8b95-df692c05799a None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:27:56.697301 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf31331-fbe4-4da7-8b95-df692c05799a None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:27:56.697301 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf31331-fbe4-4da7-8b95-df692c05799a None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:27:56.698601 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 758/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 15:27:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:27:56.704977 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b6684-e198-40ca-99d9-4bb0c791a768 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:27:56.705467 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b6684-e198-40ca-99d9-4bb0c791a768 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:27:56.705582 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b6684-e198-40ca-99d9-4bb0c791a768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:27:56.724992 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-ed0b6684-e198-40ca-99d9-4bb0c791a768 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:27:56.726198 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-ed0b6684-e198-40ca-99d9-4bb0c791a768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:27:56.734141 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 771/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 15:27:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:27:56.813679 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf31331-fbe4-4da7-8b95-df692c05799a None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:27:56.815438 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-9cf31331-fbe4-4da7-8b95-df692c05799a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:27:56.846836 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:27:56.878170 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf31331-fbe4-4da7-8b95-df692c05799a None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:27:56.881662 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f6e58c-471e-4d9a-80f5-efe7364c817b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:27:56.882279 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f6e58c-471e-4d9a-80f5-efe7364c817b service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:27:56.882567 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f6e58c-471e-4d9a-80f5-efe7364c817b service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:27:56.882845 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f6e58c-471e-4d9a-80f5-efe7364c817b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:27:56.892977 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f6e58c-471e-4d9a-80f5-efe7364c817b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:27:56.894460 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f6e58c-471e-4d9a-80f5-efe7364c817b service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:27:56.905998 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 759/1530] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:27:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:27:59.066488 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd2c33-0563-4236-863a-c07b2a142586 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:27:59.067080 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd2c33-0563-4236-863a-c07b2a142586 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:27:59.067080 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd2c33-0563-4236-863a-c07b2a142586 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:27:59.069062 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 772/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 15:27:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:27:59.075884 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0901ef-0d1c-479f-aff8-10eeaf703d2c None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:27:59.076521 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0901ef-0d1c-479f-aff8-10eeaf703d2c None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:27:59.076741 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0901ef-0d1c-479f-aff8-10eeaf703d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:27:59.106267 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-be0901ef-0d1c-479f-aff8-10eeaf703d2c None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:27:59.107534 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-be0901ef-0d1c-479f-aff8-10eeaf703d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:27:59.116152 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 760/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 15:27:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:27:59.154795 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd2c33-0563-4236-863a-c07b2a142586 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:27:59.169487 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd2c33-0563-4236-863a-c07b2a142586 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:27:59.173877 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b063e7-aea7-44a6-aa66-620f2b934307 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:27:59.174498 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b063e7-aea7-44a6-aa66-620f2b934307 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:27:59.174780 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b063e7-aea7-44a6-aa66-620f2b934307 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:27:59.175059 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b063e7-aea7-44a6-aa66-620f2b934307 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:27:59.185132 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b063e7-aea7-44a6-aa66-620f2b934307 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:27:59.186593 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b063e7-aea7-44a6-aa66-620f2b934307 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:27:59.200632 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 773/1533] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:27:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:28:02.720178 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e110e2-4d46-4c12-ae19-82335446fba5 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:28:02.720759 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e110e2-4d46-4c12-ae19-82335446fba5 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:28:02.720759 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e110e2-4d46-4c12-ae19-82335446fba5 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:28:02.722111 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 761/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 15:28:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:28:02.728316 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ec7d1-a513-4ea5-8075-1dbca7c7e919 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:28:02.728921 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ec7d1-a513-4ea5-8075-1dbca7c7e919 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:28:02.729017 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ec7d1-a513-4ea5-8075-1dbca7c7e919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:28:02.749928 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-865ec7d1-a513-4ea5-8075-1dbca7c7e919 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:28:02.751398 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-865ec7d1-a513-4ea5-8075-1dbca7c7e919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:28:02.759683 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 774/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 15:28:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:28:03.080563 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e110e2-4d46-4c12-ae19-82335446fba5 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:28:03.082274 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-f7e110e2-4d46-4c12-ae19-82335446fba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:28:03.149219 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e110e2-4d46-4c12-ae19-82335446fba5 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:28:03.153803 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9cd60-4433-4bdf-ba07-c2e3cdb56750 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:28:03.154454 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9cd60-4433-4bdf-ba07-c2e3cdb56750 service cinder] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:28:03.154740 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9cd60-4433-4bdf-ba07-c2e3cdb56750 service cinder] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:28:03.155020 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9cd60-4433-4bdf-ba07-c2e3cdb56750 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:28:03.165156 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f9cd60-4433-4bdf-ba07-c2e3cdb56750 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:28:03.166603 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f9cd60-4433-4bdf-ba07-c2e3cdb56750 service cinder] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:28:03.177258 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 762/1536] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:28:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:28:05.236278 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b2342-b9cb-41d3-8169-8837f5ae50e5 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:28:05.237155 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b2342-b9cb-41d3-8169-8837f5ae50e5 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:28:05.237155 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b2342-b9cb-41d3-8169-8837f5ae50e5 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:28:05.238736 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 775/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 15:28:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:28:05.245269 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1830a-3092-4092-b102-e89de54749ca None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:28:05.245972 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1830a-3092-4092-b102-e89de54749ca None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:28:05.245972 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1830a-3092-4092-b102-e89de54749ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:28:05.268957 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-38a1830a-3092-4092-b102-e89de54749ca None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:28:05.270202 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-38a1830a-3092-4092-b102-e89de54749ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:28:05.278565 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 763/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 15:28:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:28:05.597347 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563b2342-b9cb-41d3-8169-8837f5ae50e5 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:28:05.599076 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-563b2342-b9cb-41d3-8169-8837f5ae50e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:28:05.615823 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563b2342-b9cb-41d3-8169-8837f5ae50e5 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:28:05.621245 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca264817-6bea-4d7f-8258-0e30b5d15e77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:28:05.621998 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca264817-6bea-4d7f-8258-0e30b5d15e77 service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:28:05.622384 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca264817-6bea-4d7f-8258-0e30b5d15e77 service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:28:05.622755 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca264817-6bea-4d7f-8258-0e30b5d15e77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:28:05.633989 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca264817-6bea-4d7f-8258-0e30b5d15e77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:28:05.635547 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca264817-6bea-4d7f-8258-0e30b5d15e77 service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:28:05.646575 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 776/1539] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:28:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:28:15.262182 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=47 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:28:15.641413 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=33 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:29:36.313290 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be772b-2e3a-4054-85a7-1885abd7b97b None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:36.315076 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be772b-2e3a-4054-85a7-1885abd7b97b None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:36.315748 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be772b-2e3a-4054-85a7-1885abd7b97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:36.356704 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-f0be772b-2e3a-4054-85a7-1885abd7b97b None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:29:36.359525 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-f0be772b-2e3a-4054-85a7-1885abd7b97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:36.371455 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 764/1540] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:29:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:29:36.381793 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff00587-b39d-4ff0-9078-21436ff07531 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:36.382405 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff00587-b39d-4ff0-9078-21436ff07531 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:36.382405 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff00587-b39d-4ff0-9078-21436ff07531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:36.417779 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-8ff00587-b39d-4ff0-9078-21436ff07531 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:29:36.418933 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-8ff00587-b39d-4ff0-9078-21436ff07531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:36.436459 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 777/1541] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:29:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:29:36.441515 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be772b-2e3a-4054-85a7-1885abd7b97b None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:36.458577 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be772b-2e3a-4054-85a7-1885abd7b97b None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:36.466669 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aa097c-e479-41d0-a7bc-0845a06be0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:36.467848 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aa097c-e479-41d0-a7bc-0845a06be0d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:36.468401 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aa097c-e479-41d0-a7bc-0845a06be0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:36.468951 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aa097c-e479-41d0-a7bc-0845a06be0d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:36.469883 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aa097c-e479-41d0-a7bc-0845a06be0d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:29:36.470422 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aa097c-e479-41d0-a7bc-0845a06be0d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:36.473324 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aa097c-e479-41d0-a7bc-0845a06be0d7 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:36.492269 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 765/1542] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 2 15:29:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:29:36.500661 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff00587-b39d-4ff0-9078-21436ff07531 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:36.514715 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff00587-b39d-4ff0-9078-21436ff07531 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:36.523748 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc7ec6c-f719-41c8-96dd-87f5266935c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:36.524380 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7ec6c-f719-41c8-96dd-87f5266935c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:36.524662 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7ec6c-f719-41c8-96dd-87f5266935c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:36.524943 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7ec6c-f719-41c8-96dd-87f5266935c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:36.525624 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc7ec6c-f719-41c8-96dd-87f5266935c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:36.527667 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc7ec6c-f719-41c8-96dd-87f5266935c4 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:36.566010 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 778/1543] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:29:36 2022] POST /identity/v3/projects => generated 383 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:29:36.570361 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aa097c-e479-41d0-a7bc-0845a06be0d7 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:36.589951 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aa097c-e479-41d0-a7bc-0845a06be0d7 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:36.662700 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e336d76-720c-47d4-9180-93262ccf3155 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:36.663053 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e336d76-720c-47d4-9180-93262ccf3155 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:36.665148 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e336d76-720c-47d4-9180-93262ccf3155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:36.684436 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816b7e2-4227-4c60-8fcc-c47432251c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:36.685600 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816b7e2-4227-4c60-8fcc-c47432251c65 admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:36.686262 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816b7e2-4227-4c60-8fcc-c47432251c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:36.686795 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816b7e2-4227-4c60-8fcc-c47432251c65 admin admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:36.687722 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1816b7e2-4227-4c60-8fcc-c47432251c65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:36.691236 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1816b7e2-4227-4c60-8fcc-c47432251c65 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:36.710922 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-1e336d76-720c-47d4-9180-93262ccf3155 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:29:36.713728 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-1e336d76-720c-47d4-9180-93262ccf3155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:36.742636 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 766/1544] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:29:36 2022] POST /identity/v3/users => generated 292 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:29:36.745170 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 779/1545] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:29:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:29:36.752589 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816b7e2-4227-4c60-8fcc-c47432251c65 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:36.755184 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a348ea-b58e-4af9-875e-160be3ad5945 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:36.755616 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a348ea-b58e-4af9-875e-160be3ad5945 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:36.755908 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a348ea-b58e-4af9-875e-160be3ad5945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:36.781391 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816b7e2-4227-4c60-8fcc-c47432251c65 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:36.802501 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39c8462-45fb-424f-a998-18c55f76903a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:36.803186 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c8462-45fb-424f-a998-18c55f76903a admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:36.803531 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c8462-45fb-424f-a998-18c55f76903a admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:36.803832 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c8462-45fb-424f-a998-18c55f76903a admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:36.804576 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39c8462-45fb-424f-a998-18c55f76903a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:36.806296 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39c8462-45fb-424f-a998-18c55f76903a admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:36.816426 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-d8a348ea-b58e-4af9-875e-160be3ad5945 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:29:36.817653 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-d8a348ea-b58e-4af9-875e-160be3ad5945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:36.834254 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 767/1546] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:29:36 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:29:36.837334 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 780/1547] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:29:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:29:36.838745 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e018807-a96d-4f9a-a154-8d3ffc6365a2 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:36.839037 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e018807-a96d-4f9a-a154-8d3ffc6365a2 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:36.839346 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e018807-a96d-4f9a-a154-8d3ffc6365a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:36.841913 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a348ea-b58e-4af9-875e-160be3ad5945 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:36.853460 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a348ea-b58e-4af9-875e-160be3ad5945 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:36.866065 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad14b31-9d95-4398-9cfd-481aabff5f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:36.867078 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad14b31-9d95-4398-9cfd-481aabff5f0f admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:36.867601 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad14b31-9d95-4398-9cfd-481aabff5f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:36.868123 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad14b31-9d95-4398-9cfd-481aabff5f0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:36.869034 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad14b31-9d95-4398-9cfd-481aabff5f0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:36.871163 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad14b31-9d95-4398-9cfd-481aabff5f0f admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:36.898468 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-9e018807-a96d-4f9a-a154-8d3ffc6365a2 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:29:36.898468 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-9e018807-a96d-4f9a-a154-8d3ffc6365a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:36.899501 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 781/1548] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:29:36 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:29:36.900641 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad14b31-9d95-4398-9cfd-481aabff5f0f admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:36.917366 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad14b31-9d95-4398-9cfd-481aabff5f0f admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:36.924036 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 768/1549] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:29:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:29:36.925029 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e018807-a96d-4f9a-a154-8d3ffc6365a2 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:36.925472 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba353bc-54e1-499e-9fd4-105ebb4073a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:36.926096 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba353bc-54e1-499e-9fd4-105ebb4073a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:36.926384 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba353bc-54e1-499e-9fd4-105ebb4073a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:36.926669 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba353bc-54e1-499e-9fd4-105ebb4073a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:36.930347 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba353bc-54e1-499e-9fd4-105ebb4073a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:29:36.930347 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba353bc-54e1-499e-9fd4-105ebb4073a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:36.930347 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: WARNING py.warnings [None req-6ba353bc-54e1-499e-9fd4-105ebb4073a7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 15:29:36.930347 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: warnings.warn(msg) Aug 02 15:29:36.930347 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: Aug 02 15:29:36.930347 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba353bc-54e1-499e-9fd4-105ebb4073a7 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:36.947297 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e018807-a96d-4f9a-a154-8d3ffc6365a2 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:36.958905 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 782/1550] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 2 15:29:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:29:36.959937 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61d4854-fd3a-459e-841a-8ae5699c53ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:36.960998 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d4854-fd3a-459e-841a-8ae5699c53ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:36.962007 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d4854-fd3a-459e-841a-8ae5699c53ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:36.962512 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d4854-fd3a-459e-841a-8ae5699c53ac admin admin] PATH_INFO: `/v3/projects/2e7db419a01747d4945dbe362adfcb65/users/0f08ca03f3f44afcbbbe94fe0ac5baf7/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:36.963867 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d55259-cace-4de2-b0e0-9812c337954e None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:36.965226 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d55259-cace-4de2-b0e0-9812c337954e None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:36.965915 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d55259-cace-4de2-b0e0-9812c337954e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:36.995028 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61d4854-fd3a-459e-841a-8ae5699c53ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e7db419a01747d4945dbe362adfcb65, user_id=0f08ca03f3f44afcbbbe94fe0ac5baf7, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:36.996153 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: WARNING py.warnings [None req-f61d4854-fd3a-459e-841a-8ae5699c53ac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 15:29:36.996153 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: warnings.warn(msg) Aug 02 15:29:36.996153 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: Aug 02 15:29:36.997187 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-10d55259-cace-4de2-b0e0-9812c337954e None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:29:36.998177 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61d4854-fd3a-459e-841a-8ae5699c53ac admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:36.998422 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-10d55259-cace-4de2-b0e0-9812c337954e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:37.007203 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 783/1551] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:29:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:29:37.012161 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 769/1552] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:29:36 2022] PUT /identity/v3/projects/2e7db419a01747d4945dbe362adfcb65/users/0f08ca03f3f44afcbbbe94fe0ac5baf7/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:29:37.012538 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff987e22-eb17-48fb-bd02-af6278be8b7d None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:37.012828 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff987e22-eb17-48fb-bd02-af6278be8b7d None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:37.013660 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff987e22-eb17-48fb-bd02-af6278be8b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:37.015768 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f799c425-f6e1-40bf-a0db-ff02b183a28b None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:37.016230 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f799c425-f6e1-40bf-a0db-ff02b183a28b None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:37.016782 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f799c425-f6e1-40bf-a0db-ff02b183a28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:37.037082 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-ff987e22-eb17-48fb-bd02-af6278be8b7d None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:29:37.038351 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-ff987e22-eb17-48fb-bd02-af6278be8b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:37.040364 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-f799c425-f6e1-40bf-a0db-ff02b183a28b None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:29:37.041567 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-f799c425-f6e1-40bf-a0db-ff02b183a28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:37.099904 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 784/1553] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:29:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:29:37.100731 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff987e22-eb17-48fb-bd02-af6278be8b7d None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:37.101159 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 770/1554] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:29:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:29:37.102355 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18359c4e-5b68-4d5c-96c6-6f85324c8cb8 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:37.102650 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18359c4e-5b68-4d5c-96c6-6f85324c8cb8 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:37.102926 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18359c4e-5b68-4d5c-96c6-6f85324c8cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:37.116451 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff987e22-eb17-48fb-bd02-af6278be8b7d None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:37.121842 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff18fdf1-893d-484c-a65a-c712f7c1996c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:37.122461 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff18fdf1-893d-484c-a65a-c712f7c1996c admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:37.122776 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff18fdf1-893d-484c-a65a-c712f7c1996c admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:37.123051 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff18fdf1-893d-484c-a65a-c712f7c1996c admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:37.123753 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff18fdf1-893d-484c-a65a-c712f7c1996c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:37.124472 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-18359c4e-5b68-4d5c-96c6-6f85324c8cb8 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:29:37.125662 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff18fdf1-893d-484c-a65a-c712f7c1996c admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:37.125809 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-18359c4e-5b68-4d5c-96c6-6f85324c8cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:37.133509 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 771/1555] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:29:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:29:37.136909 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40239304-d0db-4dc9-ae2f-3d94bff8ca84 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:37.136909 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40239304-d0db-4dc9-ae2f-3d94bff8ca84 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:37.136909 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40239304-d0db-4dc9-ae2f-3d94bff8ca84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:37.163616 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 785/1556] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:29:37 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:29:37.164956 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926d892-87ad-4e1c-9f99-ae28536faaeb None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:37.165282 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926d892-87ad-4e1c-9f99-ae28536faaeb None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:37.165644 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926d892-87ad-4e1c-9f99-ae28536faaeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:37.167897 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-40239304-d0db-4dc9-ae2f-3d94bff8ca84 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:29:37.169196 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-40239304-d0db-4dc9-ae2f-3d94bff8ca84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:37.185087 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-8926d892-87ad-4e1c-9f99-ae28536faaeb None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:29:37.186262 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-8926d892-87ad-4e1c-9f99-ae28536faaeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:37.187378 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:29:37.233996 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 772/1557] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:29:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:29:37.239086 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5485c6-9053-4488-9711-1b731c91ee9e None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:37.239086 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5485c6-9053-4488-9711-1b731c91ee9e None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:37.239086 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5485c6-9053-4488-9711-1b731c91ee9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:37.262184 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 786/1558] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:29:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:29:37.262440 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-fa5485c6-9053-4488-9711-1b731c91ee9e None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:29:37.262539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef0cfd-c292-4ab3-8150-b229d4f0420a None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:37.262539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef0cfd-c292-4ab3-8150-b229d4f0420a None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:37.262539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef0cfd-c292-4ab3-8150-b229d4f0420a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:37.262752 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-fa5485c6-9053-4488-9711-1b731c91ee9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:37.266114 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 773/1559] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:29:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:29:37.268564 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5435e-59a0-4eb4-b16a-c38398d9fa1d None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:37.268852 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5435e-59a0-4eb4-b16a-c38398d9fa1d None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:37.269129 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5435e-59a0-4eb4-b16a-c38398d9fa1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:37.271065 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:29:37.277689 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-3bef0cfd-c292-4ab3-8150-b229d4f0420a None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:29:37.280404 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-3bef0cfd-c292-4ab3-8150-b229d4f0420a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:37.288157 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 787/1560] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:29:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:29:37.289013 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bef0cfd-c292-4ab3-8150-b229d4f0420a None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:37.292297 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-15b5435e-59a0-4eb4-b16a-c38398d9fa1d None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:29:37.293512 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-15b5435e-59a0-4eb4-b16a-c38398d9fa1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:37.299311 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bef0cfd-c292-4ab3-8150-b229d4f0420a None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:37.302003 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 774/1561] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:29:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:29:37.303065 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde41c9-bd5e-4f07-938d-4ce378b659b5 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:37.303466 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde41c9-bd5e-4f07-938d-4ce378b659b5 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:37.303744 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde41c9-bd5e-4f07-938d-4ce378b659b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:37.304692 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d15c20-0040-4315-904d-c5007ef07c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:37.305445 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d15c20-0040-4315-904d-c5007ef07c7e admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:37.305730 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d15c20-0040-4315-904d-c5007ef07c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:37.306006 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d15c20-0040-4315-904d-c5007ef07c7e admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:37.306704 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d15c20-0040-4315-904d-c5007ef07c7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:29:37.307010 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d15c20-0040-4315-904d-c5007ef07c7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:37.308733 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d15c20-0040-4315-904d-c5007ef07c7e admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:37.321160 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 788/1562] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 2 15:29:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:29:37.321824 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d15c20-0040-4315-904d-c5007ef07c7e admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:37.322673 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-adde41c9-bd5e-4f07-938d-4ce378b659b5 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:29:37.323881 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-adde41c9-bd5e-4f07-938d-4ce378b659b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:37.332133 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d15c20-0040-4315-904d-c5007ef07c7e admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:37.332768 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 775/1563] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:29:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:29:37.333986 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cda910-6600-4a7d-a7ac-5e25af3ad4b3 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:37.334270 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cda910-6600-4a7d-a7ac-5e25af3ad4b3 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:37.334543 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cda910-6600-4a7d-a7ac-5e25af3ad4b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:37.337196 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4beefd-d50a-4143-90d5-ff726cd95693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:37.337802 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4beefd-d50a-4143-90d5-ff726cd95693 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:37.338090 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4beefd-d50a-4143-90d5-ff726cd95693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:37.338373 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4beefd-d50a-4143-90d5-ff726cd95693 admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:37.339184 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4beefd-d50a-4143-90d5-ff726cd95693 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:37.340250 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: WARNING py.warnings [None req-3d4beefd-d50a-4143-90d5-ff726cd95693 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 15:29:37.340250 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: warnings.warn(msg) Aug 02 15:29:37.340250 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: Aug 02 15:29:37.342044 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4beefd-d50a-4143-90d5-ff726cd95693 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:37.355388 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-b8cda910-6600-4a7d-a7ac-5e25af3ad4b3 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:29:37.356583 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-b8cda910-6600-4a7d-a7ac-5e25af3ad4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:37.364604 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 776/1564] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:29:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:29:37.364769 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 789/1565] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:29:37 2022] POST /identity/v3/users => generated 293 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:29:37.368133 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4beefd-d50a-4143-90d5-ff726cd95693 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:37.368275 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa16a4-6a09-491c-9617-ee7552cef0fc None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:37.368275 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa16a4-6a09-491c-9617-ee7552cef0fc None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:37.368275 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa16a4-6a09-491c-9617-ee7552cef0fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:37.378722 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4beefd-d50a-4143-90d5-ff726cd95693 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:37.383550 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eef228-2df0-4989-b8a6-afb1f3d065f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:37.384149 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eef228-2df0-4989-b8a6-afb1f3d065f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:37.384438 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eef228-2df0-4989-b8a6-afb1f3d065f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:37.384711 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eef228-2df0-4989-b8a6-afb1f3d065f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:37.385095 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-88fa16a4-6a09-491c-9617-ee7552cef0fc None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:29:37.385427 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eef228-2df0-4989-b8a6-afb1f3d065f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:29:37.385736 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eef228-2df0-4989-b8a6-afb1f3d065f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:37.386273 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-88fa16a4-6a09-491c-9617-ee7552cef0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:37.387397 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eef228-2df0-4989-b8a6-afb1f3d065f8 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:37.395054 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 777/1566] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:29:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:29:37.395450 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa16a4-6a09-491c-9617-ee7552cef0fc None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:37.405103 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 790/1567] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 2 15:29:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:29:37.405103 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eef228-2df0-4989-b8a6-afb1f3d065f8 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:37.411555 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eef228-2df0-4989-b8a6-afb1f3d065f8 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:37.416135 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56dbe8c-3d6c-43e3-aad7-33ee8851b649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:37.416729 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56dbe8c-3d6c-43e3-aad7-33ee8851b649 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:37.417006 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56dbe8c-3d6c-43e3-aad7-33ee8851b649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:37.417507 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56dbe8c-3d6c-43e3-aad7-33ee8851b649 admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:37.417956 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56dbe8c-3d6c-43e3-aad7-33ee8851b649 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:29:37.418253 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56dbe8c-3d6c-43e3-aad7-33ee8851b649 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:37.420190 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56dbe8c-3d6c-43e3-aad7-33ee8851b649 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:37.433338 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 791/1568] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 2 15:29:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:29:37.433338 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56dbe8c-3d6c-43e3-aad7-33ee8851b649 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:37.443196 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56dbe8c-3d6c-43e3-aad7-33ee8851b649 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:37.447731 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf32561-b525-40cb-8fa4-1289ccfc0d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:37.448328 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf32561-b525-40cb-8fa4-1289ccfc0d88 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:37.448606 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf32561-b525-40cb-8fa4-1289ccfc0d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:37.448879 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf32561-b525-40cb-8fa4-1289ccfc0d88 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:37.449532 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf32561-b525-40cb-8fa4-1289ccfc0d88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:37.452040 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf32561-b525-40cb-8fa4-1289ccfc0d88 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:37.465496 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa16a4-6a09-491c-9617-ee7552cef0fc None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:37.469581 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2fde5b-bbf2-422c-8760-9c6da3dcb3bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:37.470363 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2fde5b-bbf2-422c-8760-9c6da3dcb3bd service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:37.470830 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2fde5b-bbf2-422c-8760-9c6da3dcb3bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:37.471116 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2fde5b-bbf2-422c-8760-9c6da3dcb3bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:37.477989 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 792/1569] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:29:37 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:29:37.478929 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf32561-b525-40cb-8fa4-1289ccfc0d88 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:37.480879 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2fde5b-bbf2-422c-8760-9c6da3dcb3bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:37.482389 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2fde5b-bbf2-422c-8760-9c6da3dcb3bd service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:37.495890 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 778/1570] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:29:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:29:37.495890 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2fde5b-bbf2-422c-8760-9c6da3dcb3bd service neutron] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:37.507876 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2fde5b-bbf2-422c-8760-9c6da3dcb3bd service neutron] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:37.566041 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf32561-b525-40cb-8fa4-1289ccfc0d88 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:37.571591 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d313d3a-17dd-4b3f-9d86-42037c0d1ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:37.572737 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d313d3a-17dd-4b3f-9d86-42037c0d1ff2 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:37.572965 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d313d3a-17dd-4b3f-9d86-42037c0d1ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:37.573352 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d313d3a-17dd-4b3f-9d86-42037c0d1ff2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:37.574149 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d313d3a-17dd-4b3f-9d86-42037c0d1ff2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:29:37.574456 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d313d3a-17dd-4b3f-9d86-42037c0d1ff2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:37.576785 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d313d3a-17dd-4b3f-9d86-42037c0d1ff2 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:37.588925 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b47421-9aa4-4005-bc8d-4beaa3f67384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:37.588925 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b47421-9aa4-4005-bc8d-4beaa3f67384 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:37.588925 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b47421-9aa4-4005-bc8d-4beaa3f67384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:37.588925 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b47421-9aa4-4005-bc8d-4beaa3f67384 admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:37.594314 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b47421-9aa4-4005-bc8d-4beaa3f67384 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:37.594569 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 793/1571] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 2 15:29:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:29:37.594738 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b47421-9aa4-4005-bc8d-4beaa3f67384 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:37.595026 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d313d3a-17dd-4b3f-9d86-42037c0d1ff2 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:37.605091 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d313d3a-17dd-4b3f-9d86-42037c0d1ff2 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:37.615186 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 779/1572] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:29:37.616720 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b47421-9aa4-4005-bc8d-4beaa3f67384 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:37.617518 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4cd568-80c2-415b-82e1-d901912711f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:37.618166 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4cd568-80c2-415b-82e1-d901912711f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:37.618461 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4cd568-80c2-415b-82e1-d901912711f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:37.618731 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4cd568-80c2-415b-82e1-d901912711f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:37.619464 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4cd568-80c2-415b-82e1-d901912711f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:29:37.619773 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4cd568-80c2-415b-82e1-d901912711f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:37.621986 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4cd568-80c2-415b-82e1-d901912711f1 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:37.634861 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b47421-9aa4-4005-bc8d-4beaa3f67384 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:37.639491 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 794/1573] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 2 15:29:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:29:37.643329 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4cd568-80c2-415b-82e1-d901912711f1 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:37.644952 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c774a0a-9f55-4ed5-8786-f74b85c66c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:37.645989 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c774a0a-9f55-4ed5-8786-f74b85c66c91 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:37.646482 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c774a0a-9f55-4ed5-8786-f74b85c66c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:37.647008 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c774a0a-9f55-4ed5-8786-f74b85c66c91 admin admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:37.648265 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c774a0a-9f55-4ed5-8786-f74b85c66c91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:29:37.648812 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c774a0a-9f55-4ed5-8786-f74b85c66c91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:37.652043 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c774a0a-9f55-4ed5-8786-f74b85c66c91 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:37.659165 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4cd568-80c2-415b-82e1-d901912711f1 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:37.664451 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee582dc-2024-46c7-b002-391088c8e2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:37.665400 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee582dc-2024-46c7-b002-391088c8e2c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:37.665400 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee582dc-2024-46c7-b002-391088c8e2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:37.665706 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee582dc-2024-46c7-b002-391088c8e2c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:37.666734 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee582dc-2024-46c7-b002-391088c8e2c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:37.668747 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee582dc-2024-46c7-b002-391088c8e2c2 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:37.673844 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 780/1574] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 2 15:29:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:29:37.674784 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c774a0a-9f55-4ed5-8786-f74b85c66c91 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:37.685832 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c774a0a-9f55-4ed5-8786-f74b85c66c91 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:37.691683 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d596973-7487-402b-837b-d477027be63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:37.693144 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d596973-7487-402b-837b-d477027be63a admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:37.693698 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d596973-7487-402b-837b-d477027be63a admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:37.694025 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d596973-7487-402b-837b-d477027be63a admin admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:37.695144 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d596973-7487-402b-837b-d477027be63a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:37.696792 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: WARNING py.warnings [None req-1d596973-7487-402b-837b-d477027be63a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 15:29:37.696792 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: warnings.warn(msg) Aug 02 15:29:37.696792 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: Aug 02 15:29:37.698479 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d596973-7487-402b-837b-d477027be63a admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:37.714665 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 795/1575] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:29:37 2022] POST /identity/v3/projects => generated 403 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:29:37.715778 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee582dc-2024-46c7-b002-391088c8e2c2 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:37.717401 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:29:37.742162 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 781/1576] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:29:37 2022] POST /identity/v3/projects => generated 393 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:29:37.742162 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d596973-7487-402b-837b-d477027be63a admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:37.786877 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:29:37.828615 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee582dc-2024-46c7-b002-391088c8e2c2 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:37.848632 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d596973-7487-402b-837b-d477027be63a admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:37.854556 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34728ce7-8156-41bc-aca0-b79f1250ff08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:37.855191 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34728ce7-8156-41bc-aca0-b79f1250ff08 admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:37.855506 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34728ce7-8156-41bc-aca0-b79f1250ff08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:37.855821 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34728ce7-8156-41bc-aca0-b79f1250ff08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:37.856501 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34728ce7-8156-41bc-aca0-b79f1250ff08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:37.859064 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34728ce7-8156-41bc-aca0-b79f1250ff08 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:37.898565 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 782/1577] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:29:37 2022] POST /identity/v3/projects => generated 379 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:29:37.899825 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34728ce7-8156-41bc-aca0-b79f1250ff08 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:37.899983 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570bbf3a-d58e-41c6-96dc-2708f082ba20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:37.901408 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570bbf3a-d58e-41c6-96dc-2708f082ba20 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:37.901999 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570bbf3a-d58e-41c6-96dc-2708f082ba20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:37.902508 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570bbf3a-d58e-41c6-96dc-2708f082ba20 admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:37.903421 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570bbf3a-d58e-41c6-96dc-2708f082ba20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:37.906509 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570bbf3a-d58e-41c6-96dc-2708f082ba20 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:37.933403 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 796/1578] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:29:37 2022] POST /identity/v3/users => generated 286 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:29:37.934035 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570bbf3a-d58e-41c6-96dc-2708f082ba20 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:37.947598 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570bbf3a-d58e-41c6-96dc-2708f082ba20 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:37.996717 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34728ce7-8156-41bc-aca0-b79f1250ff08 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:38.001745 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae2a39-fa80-403d-b51b-fb5b9f988e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:38.003163 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae2a39-fa80-403d-b51b-fb5b9f988e83 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:38.003163 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae2a39-fa80-403d-b51b-fb5b9f988e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:38.003163 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae2a39-fa80-403d-b51b-fb5b9f988e83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:38.004104 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae2a39-fa80-403d-b51b-fb5b9f988e83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:38.005902 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae2a39-fa80-403d-b51b-fb5b9f988e83 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:38.020895 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 783/1579] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:29:38.020895 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae2a39-fa80-403d-b51b-fb5b9f988e83 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:38.032475 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae2a39-fa80-403d-b51b-fb5b9f988e83 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:38.037915 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b8996e-aa55-40cb-8feb-bce71ffd3bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:38.038630 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8996e-aa55-40cb-8feb-bce71ffd3bbf admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:38.038996 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8996e-aa55-40cb-8feb-bce71ffd3bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:38.039382 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8996e-aa55-40cb-8feb-bce71ffd3bbf admin admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:38.040242 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b8996e-aa55-40cb-8feb-bce71ffd3bbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:38.043242 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b8996e-aa55-40cb-8feb-bce71ffd3bbf admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:38.087889 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 784/1580] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:29:38 2022] POST /identity/v3/projects => generated 379 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:29:38.087889 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b8996e-aa55-40cb-8feb-bce71ffd3bbf admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:38.088187 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf966514-4d54-43ac-91bd-9420be0bcb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:38.088907 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf966514-4d54-43ac-91bd-9420be0bcb83 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:38.089153 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf966514-4d54-43ac-91bd-9420be0bcb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:38.089426 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf966514-4d54-43ac-91bd-9420be0bcb83 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:38.090104 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf966514-4d54-43ac-91bd-9420be0bcb83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:38.092700 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf966514-4d54-43ac-91bd-9420be0bcb83 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:38.138001 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 797/1581] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:29:37 2022] POST /identity/v3/projects => generated 369 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:29:38.139420 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf966514-4d54-43ac-91bd-9420be0bcb83 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:38.163454 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:29:38.181988 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b8996e-aa55-40cb-8feb-bce71ffd3bbf admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:38.243865 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf966514-4d54-43ac-91bd-9420be0bcb83 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:38.250305 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb6210f-cf3e-4113-a55c-0754d5d24b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:38.251445 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6210f-cf3e-4113-a55c-0754d5d24b08 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:38.252034 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6210f-cf3e-4113-a55c-0754d5d24b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:38.252395 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6210f-cf3e-4113-a55c-0754d5d24b08 admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:38.253676 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb6210f-cf3e-4113-a55c-0754d5d24b08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:38.256431 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb6210f-cf3e-4113-a55c-0754d5d24b08 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:38.268139 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585a61ff-7adc-467f-b157-4fb0efe05a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:38.268651 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:29:38.269073 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a61ff-7adc-467f-b157-4fb0efe05a39 admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:38.270096 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a61ff-7adc-467f-b157-4fb0efe05a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:38.270522 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a61ff-7adc-467f-b157-4fb0efe05a39 admin admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:38.271814 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585a61ff-7adc-467f-b157-4fb0efe05a39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:38.275417 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585a61ff-7adc-467f-b157-4fb0efe05a39 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:38.298437 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 798/1582] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:29:38 2022] POST /identity/v3/users => generated 297 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:29:38.299884 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb6210f-cf3e-4113-a55c-0754d5d24b08 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:38.314094 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb6210f-cf3e-4113-a55c-0754d5d24b08 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:38.319986 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf61e24d-d463-433b-a006-18bc5ef816a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:38.323890 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf61e24d-d463-433b-a006-18bc5ef816a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:38.324105 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 785/1583] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:29:38 2022] POST /identity/v3/users => generated 302 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:29:38.324835 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585a61ff-7adc-467f-b157-4fb0efe05a39 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:38.325342 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf61e24d-d463-433b-a006-18bc5ef816a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:38.326079 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf61e24d-d463-433b-a006-18bc5ef816a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:38.331742 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf61e24d-d463-433b-a006-18bc5ef816a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:38.335650 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585a61ff-7adc-467f-b157-4fb0efe05a39 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:38.337178 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf61e24d-d463-433b-a006-18bc5ef816a9 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:38.342485 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefd0f85-bb2b-4e0f-9786-ff5698a1258b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:38.343194 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd0f85-bb2b-4e0f-9786-ff5698a1258b admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:38.343586 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd0f85-bb2b-4e0f-9786-ff5698a1258b admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:38.343921 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd0f85-bb2b-4e0f-9786-ff5698a1258b admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:38.344801 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefd0f85-bb2b-4e0f-9786-ff5698a1258b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:38.346682 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefd0f85-bb2b-4e0f-9786-ff5698a1258b admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:38.362192 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 786/1584] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:29:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:29:38.362192 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefd0f85-bb2b-4e0f-9786-ff5698a1258b admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:38.375010 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefd0f85-bb2b-4e0f-9786-ff5698a1258b admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:38.381497 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e5a13f-8e97-4924-b6db-9a8774b9ef79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:38.382490 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e5a13f-8e97-4924-b6db-9a8774b9ef79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:38.383128 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e5a13f-8e97-4924-b6db-9a8774b9ef79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:38.385452 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e5a13f-8e97-4924-b6db-9a8774b9ef79 admin admin] PATH_INFO: `/v3/projects/500a134ecb214ee1a365daba31c9c6a7/users/9b96db67678548b0940e3a8ec7e1f561/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:38.389275 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 799/1585] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:29:38 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:29:38.390126 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf61e24d-d463-433b-a006-18bc5ef816a9 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:38.408813 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e5a13f-8e97-4924-b6db-9a8774b9ef79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=500a134ecb214ee1a365daba31c9c6a7, user_id=9b96db67678548b0940e3a8ec7e1f561, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:38.411792 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e5a13f-8e97-4924-b6db-9a8774b9ef79 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:38.430956 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf61e24d-d463-433b-a006-18bc5ef816a9 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:38.447343 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 787/1586] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:29:38 2022] PUT /identity/v3/projects/500a134ecb214ee1a365daba31c9c6a7/users/9b96db67678548b0940e3a8ec7e1f561/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:29:38.447343 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e5a13f-8e97-4924-b6db-9a8774b9ef79 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:38.554679 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee33db-e022-4d9c-8fa6-c72822382c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:38.555632 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee33db-e022-4d9c-8fa6-c72822382c6a admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:38.556066 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee33db-e022-4d9c-8fa6-c72822382c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:38.556529 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee33db-e022-4d9c-8fa6-c72822382c6a admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:38.557282 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ee33db-e022-4d9c-8fa6-c72822382c6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:38.559352 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ee33db-e022-4d9c-8fa6-c72822382c6a admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:38.564216 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e5a13f-8e97-4924-b6db-9a8774b9ef79 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:38.570206 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d15676d-d36b-4523-b1d4-969cc526fce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:38.571615 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d15676d-d36b-4523-b1d4-969cc526fce3 admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:38.572757 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d15676d-d36b-4523-b1d4-969cc526fce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:38.573360 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d15676d-d36b-4523-b1d4-969cc526fce3 admin admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:38.574762 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d15676d-d36b-4523-b1d4-969cc526fce3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:38.578166 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d15676d-d36b-4523-b1d4-969cc526fce3 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:38.587063 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 800/1587] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:29:38 2022] POST /identity/v3/users => generated 290 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:29:38.588652 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee33db-e022-4d9c-8fa6-c72822382c6a admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:38.601242 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee33db-e022-4d9c-8fa6-c72822382c6a admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:38.607643 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 788/1588] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:29:38 2022] POST /identity/v3/users => generated 285 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:29:38.608617 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c6f82-1db5-496d-9d9c-02309c0aa7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:38.608894 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d15676d-d36b-4523-b1d4-969cc526fce3 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:38.609749 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c6f82-1db5-496d-9d9c-02309c0aa7c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:38.610107 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c6f82-1db5-496d-9d9c-02309c0aa7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:38.610465 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c6f82-1db5-496d-9d9c-02309c0aa7c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:38.611616 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212c6f82-1db5-496d-9d9c-02309c0aa7c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:38.613639 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212c6f82-1db5-496d-9d9c-02309c0aa7c2 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:38.626609 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d15676d-d36b-4523-b1d4-969cc526fce3 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:38.631405 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 801/1589] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:29:38 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:29:38.633125 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c6f82-1db5-496d-9d9c-02309c0aa7c2 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:38.640068 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2629e-82d4-4f8a-a528-5d7954640e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:38.641453 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2629e-82d4-4f8a-a528-5d7954640e77 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:38.641453 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2629e-82d4-4f8a-a528-5d7954640e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:38.641453 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2629e-82d4-4f8a-a528-5d7954640e77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:38.642088 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a2629e-82d4-4f8a-a528-5d7954640e77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:38.643838 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a2629e-82d4-4f8a-a528-5d7954640e77 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:38.653920 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c6f82-1db5-496d-9d9c-02309c0aa7c2 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:38.659883 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 789/1590] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:29:38 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:29:38.661666 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2629e-82d4-4f8a-a528-5d7954640e77 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:38.667519 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab7557-079d-4ff6-a598-c280ca958cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:38.668214 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab7557-079d-4ff6-a598-c280ca958cbd admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:38.668508 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab7557-079d-4ff6-a598-c280ca958cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:38.668812 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab7557-079d-4ff6-a598-c280ca958cbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:38.670426 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfab7557-079d-4ff6-a598-c280ca958cbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:38.672356 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfab7557-079d-4ff6-a598-c280ca958cbd admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:38.676119 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2629e-82d4-4f8a-a528-5d7954640e77 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:38.686390 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 802/1591] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:29:38 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:29:38.687739 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa00b65-b479-4548-a70d-915b86bd1248 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:38.688032 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa00b65-b479-4548-a70d-915b86bd1248 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:38.688284 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f0544-b051-4dd0-8294-0cd608bff22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:38.688425 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa00b65-b479-4548-a70d-915b86bd1248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:38.689206 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f0544-b051-4dd0-8294-0cd608bff22d admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:38.689627 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f0544-b051-4dd0-8294-0cd608bff22d admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:38.689912 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f0544-b051-4dd0-8294-0cd608bff22d admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:38.690666 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9f0544-b051-4dd0-8294-0cd608bff22d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:38.692809 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9f0544-b051-4dd0-8294-0cd608bff22d admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:38.712845 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 790/1592] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:29:38 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:29:38.715870 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f0544-b051-4dd0-8294-0cd608bff22d admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:38.720274 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-daa00b65-b479-4548-a70d-915b86bd1248 None None] MFA Rules not processed for user `9b96db67678548b0940e3a8ec7e1f561`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:29:38.721506 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-daa00b65-b479-4548-a70d-915b86bd1248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:38.726768 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f0544-b051-4dd0-8294-0cd608bff22d admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:38.732749 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c85a844-f236-47a3-a6c7-86979f5b2b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:38.733549 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85a844-f236-47a3-a6c7-86979f5b2b92 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:38.733842 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85a844-f236-47a3-a6c7-86979f5b2b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:38.734113 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85a844-f236-47a3-a6c7-86979f5b2b92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:38.734812 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c85a844-f236-47a3-a6c7-86979f5b2b92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:38.736455 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c85a844-f236-47a3-a6c7-86979f5b2b92 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:38.748465 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 791/1593] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:29:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:29:38.749654 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c85a844-f236-47a3-a6c7-86979f5b2b92 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:38.761021 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c85a844-f236-47a3-a6c7-86979f5b2b92 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:38.767314 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff0923-4712-484b-8f5c-6688aaa95803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:38.768035 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff0923-4712-484b-8f5c-6688aaa95803 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:38.768314 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff0923-4712-484b-8f5c-6688aaa95803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:38.769090 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff0923-4712-484b-8f5c-6688aaa95803 admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:38.769571 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ff0923-4712-484b-8f5c-6688aaa95803 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:38.771264 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ff0923-4712-484b-8f5c-6688aaa95803 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:38.779098 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:29:38.787268 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 792/1594] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:29:38 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:29:38.789704 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff0923-4712-484b-8f5c-6688aaa95803 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:38.804092 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff0923-4712-484b-8f5c-6688aaa95803 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:38.811342 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0416d20-bf20-4f5e-b59c-13c7e7468959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:38.811814 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0416d20-bf20-4f5e-b59c-13c7e7468959 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:38.812207 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0416d20-bf20-4f5e-b59c-13c7e7468959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:38.813303 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0416d20-bf20-4f5e-b59c-13c7e7468959 admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:38.819416 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 803/1595] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:29:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:29:38.819668 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0416d20-bf20-4f5e-b59c-13c7e7468959 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:38.819766 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa00b65-b479-4548-a70d-915b86bd1248 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:38.819928 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0416d20-bf20-4f5e-b59c-13c7e7468959 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:38.831932 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa00b65-b479-4548-a70d-915b86bd1248 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:38.833685 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 793/1596] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:29:38 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:29:38.834458 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0416d20-bf20-4f5e-b59c-13c7e7468959 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:38.843724 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2739f6e-6ac7-4431-9312-c9d013d30690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:38.844501 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2739f6e-6ac7-4431-9312-c9d013d30690 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:38.844800 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2739f6e-6ac7-4431-9312-c9d013d30690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:38.845082 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2739f6e-6ac7-4431-9312-c9d013d30690 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:38.845785 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2739f6e-6ac7-4431-9312-c9d013d30690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:38.847124 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0416d20-bf20-4f5e-b59c-13c7e7468959 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:38.847728 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2739f6e-6ac7-4431-9312-c9d013d30690 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:38.854027 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d871e78-74d4-4fdc-b302-512d4dddec56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:38.855327 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d871e78-74d4-4fdc-b302-512d4dddec56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:38.855671 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d871e78-74d4-4fdc-b302-512d4dddec56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:38.856013 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d871e78-74d4-4fdc-b302-512d4dddec56 admin admin] PATH_INFO: `/v3/projects/4bf22db3bef1462bb00f0bb1cbca5279/users/52fbc91b7cde44418ec96fb78787d183/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:38.863286 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 804/1597] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:29:38 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:29:38.864294 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2739f6e-6ac7-4431-9312-c9d013d30690 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:38.878684 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d871e78-74d4-4fdc-b302-512d4dddec56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bf22db3bef1462bb00f0bb1cbca5279, user_id=52fbc91b7cde44418ec96fb78787d183, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:38.883789 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d871e78-74d4-4fdc-b302-512d4dddec56 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:38.885222 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2739f6e-6ac7-4431-9312-c9d013d30690 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:38.891926 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1090a11c-21ea-46c5-a182-05a9493a8fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:38.892577 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090a11c-21ea-46c5-a182-05a9493a8fc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:38.892890 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090a11c-21ea-46c5-a182-05a9493a8fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:38.893181 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090a11c-21ea-46c5-a182-05a9493a8fc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:38.893893 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1090a11c-21ea-46c5-a182-05a9493a8fc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:38.895803 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1090a11c-21ea-46c5-a182-05a9493a8fc0 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:38.904257 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 794/1598] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:29:38 2022] PUT /identity/v3/projects/4bf22db3bef1462bb00f0bb1cbca5279/users/52fbc91b7cde44418ec96fb78787d183/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:29:38.915522 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d871e78-74d4-4fdc-b302-512d4dddec56 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:38.915632 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 805/1599] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:29:38 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:29:38.915632 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1090a11c-21ea-46c5-a182-05a9493a8fc0 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:38.928546 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1090a11c-21ea-46c5-a182-05a9493a8fc0 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:38.939449 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:29:39.025183 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a420c16-91e7-4d59-8ad2-9922735832cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:39.025612 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d871e78-74d4-4fdc-b302-512d4dddec56 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:39.026972 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a420c16-91e7-4d59-8ad2-9922735832cf admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:39.027303 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a420c16-91e7-4d59-8ad2-9922735832cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:39.027590 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a420c16-91e7-4d59-8ad2-9922735832cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:39.029477 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a420c16-91e7-4d59-8ad2-9922735832cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:39.031315 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a420c16-91e7-4d59-8ad2-9922735832cf admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:39.032934 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba1709-09b4-428e-9dbd-d3ec4799797d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:39.033708 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba1709-09b4-428e-9dbd-d3ec4799797d admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:39.034230 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba1709-09b4-428e-9dbd-d3ec4799797d admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:39.034838 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba1709-09b4-428e-9dbd-d3ec4799797d admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:39.036143 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba1709-09b4-428e-9dbd-d3ec4799797d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:39.038046 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba1709-09b4-428e-9dbd-d3ec4799797d admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:39.046078 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 806/1600] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:29:38 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:29:39.047106 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a420c16-91e7-4d59-8ad2-9922735832cf admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:39.059044 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 795/1601] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:29:38 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:29:39.059880 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a420c16-91e7-4d59-8ad2-9922735832cf admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:39.060154 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba1709-09b4-428e-9dbd-d3ec4799797d admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:39.069760 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5748696f-6b5e-44be-9058-2a0b68d94d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:39.070717 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5748696f-6b5e-44be-9058-2a0b68d94d10 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:39.071206 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5748696f-6b5e-44be-9058-2a0b68d94d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:39.071736 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5748696f-6b5e-44be-9058-2a0b68d94d10 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:39.072176 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba1709-09b4-428e-9dbd-d3ec4799797d admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:39.072868 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5748696f-6b5e-44be-9058-2a0b68d94d10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:39.075556 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5748696f-6b5e-44be-9058-2a0b68d94d10 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:39.077575 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613488ab-c5c5-4960-ae98-344fc77fb4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:39.078344 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613488ab-c5c5-4960-ae98-344fc77fb4a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:39.079334 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613488ab-c5c5-4960-ae98-344fc77fb4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:39.079635 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613488ab-c5c5-4960-ae98-344fc77fb4a0 admin admin] PATH_INFO: `/v3/projects/e6e99b35c7ee43e0bcf1aa605b7e1456/users/77c9a03620d04b2a9f80ec16f9738670/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:39.102664 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613488ab-c5c5-4960-ae98-344fc77fb4a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6e99b35c7ee43e0bcf1aa605b7e1456, user_id=77c9a03620d04b2a9f80ec16f9738670, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:39.105452 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613488ab-c5c5-4960-ae98-344fc77fb4a0 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:39.126114 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 796/1602] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:29:39 2022] PUT /identity/v3/projects/e6e99b35c7ee43e0bcf1aa605b7e1456/users/77c9a03620d04b2a9f80ec16f9738670/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:29:39.129847 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 807/1603] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:29:39 2022] POST /identity/v3/projects => generated 385 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:29:39.130016 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613488ab-c5c5-4960-ae98-344fc77fb4a0 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:39.131771 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5748696f-6b5e-44be-9058-2a0b68d94d10 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:39.233256 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613488ab-c5c5-4960-ae98-344fc77fb4a0 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:39.243719 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f31301d-6414-4350-aa89-3b88ad9d9137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:39.244558 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5748696f-6b5e-44be-9058-2a0b68d94d10 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:39.246299 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f31301d-6414-4350-aa89-3b88ad9d9137 admin admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:39.246694 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f31301d-6414-4350-aa89-3b88ad9d9137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:39.247076 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f31301d-6414-4350-aa89-3b88ad9d9137 admin admin] PATH_INFO: `/v3/projects/b9405562e74a4d09bda00edd12df77b5/users/0076b5aed46e49649960c8491a74637d/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:39.253152 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce2a95-1ba4-4bc8-bd74-b910a78cd84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:39.254505 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce2a95-1ba4-4bc8-bd74-b910a78cd84a admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:39.254956 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce2a95-1ba4-4bc8-bd74-b910a78cd84a admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:39.255412 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce2a95-1ba4-4bc8-bd74-b910a78cd84a admin admin] PATH_INFO: `/v3/projects/62c14f070f8a47af912e8166c2c81559/users/5c978c3804784f2483d11406dfe5d726/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:39.287006 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f31301d-6414-4350-aa89-3b88ad9d9137 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9405562e74a4d09bda00edd12df77b5, user_id=0076b5aed46e49649960c8491a74637d, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:39.289669 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ce2a95-1ba4-4bc8-bd74-b910a78cd84a admin admin] RBAC: Authorizing `identity:create_grant(project_id=62c14f070f8a47af912e8166c2c81559, user_id=5c978c3804784f2483d11406dfe5d726, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:39.290061 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f31301d-6414-4350-aa89-3b88ad9d9137 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:39.292908 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ce2a95-1ba4-4bc8-bd74-b910a78cd84a admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:39.309445 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 797/1604] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:29:39 2022] PUT /identity/v3/projects/b9405562e74a4d09bda00edd12df77b5/users/0076b5aed46e49649960c8491a74637d/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:29:39.310808 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f34732-d856-450d-9a35-795452b9e596 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:39.311104 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f34732-d856-450d-9a35-795452b9e596 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:39.311412 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f34732-d856-450d-9a35-795452b9e596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:39.311531 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 808/1605] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:29:39 2022] PUT /identity/v3/projects/62c14f070f8a47af912e8166c2c81559/users/5c978c3804784f2483d11406dfe5d726/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:29:39.312468 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce2a95-1ba4-4bc8-bd74-b910a78cd84a admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:39.347139 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-37f34732-d856-450d-9a35-795452b9e596 None None] MFA Rules not processed for user `52fbc91b7cde44418ec96fb78787d183`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:29:39.349288 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-37f34732-d856-450d-9a35-795452b9e596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:39.364034 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:29:39.414781 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce2a95-1ba4-4bc8-bd74-b910a78cd84a admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:39.420251 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f1e41-0073-44e4-82ec-f44cbb549dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:39.421056 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f1e41-0073-44e4-82ec-f44cbb549dc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:39.421569 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f1e41-0073-44e4-82ec-f44cbb549dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:39.421916 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f1e41-0073-44e4-82ec-f44cbb549dc7 admin admin] PATH_INFO: `/v3/projects/bf2108cd622344768035be61f90e4eac/users/e6ea47e912d4485ca03aa5a90b48a606/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:39.441248 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:29:39.451153 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2f1e41-0073-44e4-82ec-f44cbb549dc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf2108cd622344768035be61f90e4eac, user_id=e6ea47e912d4485ca03aa5a90b48a606, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:39.453681 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 798/1606] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:29:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:29:39.453893 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2f1e41-0073-44e4-82ec-f44cbb549dc7 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:39.454529 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f34732-d856-450d-9a35-795452b9e596 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:39.469161 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f34732-d856-450d-9a35-795452b9e596 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:39.475165 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3647da-78fe-4c19-b731-bc8ff3fd2723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:39.476049 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3647da-78fe-4c19-b731-bc8ff3fd2723 admin admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:39.476387 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3647da-78fe-4c19-b731-bc8ff3fd2723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:39.476740 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3647da-78fe-4c19-b731-bc8ff3fd2723 admin admin] PATH_INFO: `/v3/projects/c17d0272c13a4a35958e141d6571a627/users/a3a26ab281074e2b84ed1f354129ff3d/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:39.490309 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 809/1607] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:29:39 2022] PUT /identity/v3/projects/bf2108cd622344768035be61f90e4eac/users/e6ea47e912d4485ca03aa5a90b48a606/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:29:39.491972 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ee9a9-db3d-4f0c-8f3c-992ce5265fc5 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:39.492263 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ee9a9-db3d-4f0c-8f3c-992ce5265fc5 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:39.492540 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ee9a9-db3d-4f0c-8f3c-992ce5265fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:39.516676 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3647da-78fe-4c19-b731-bc8ff3fd2723 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c17d0272c13a4a35958e141d6571a627, user_id=a3a26ab281074e2b84ed1f354129ff3d, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:39.580220 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3647da-78fe-4c19-b731-bc8ff3fd2723 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:39.580220 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 799/1608] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:29:39 2022] PUT /identity/v3/projects/c17d0272c13a4a35958e141d6571a627/users/a3a26ab281074e2b84ed1f354129ff3d/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:29:39.580220 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3647da-78fe-4c19-b731-bc8ff3fd2723 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:39.580579 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-cf7ee9a9-db3d-4f0c-8f3c-992ce5265fc5 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:29:39.580579 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-cf7ee9a9-db3d-4f0c-8f3c-992ce5265fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:39.662418 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 810/1609] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:29:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:29:39.662418 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bbe667-f838-4f05-9cd9-efec95781b6f None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:39.662418 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bbe667-f838-4f05-9cd9-efec95781b6f None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:39.662418 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bbe667-f838-4f05-9cd9-efec95781b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:39.687627 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3647da-78fe-4c19-b731-bc8ff3fd2723 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:39.691468 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-87bbe667-f838-4f05-9cd9-efec95781b6f None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:29:39.692834 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-87bbe667-f838-4f05-9cd9-efec95781b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:39.693217 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54abe45d-e1e3-44b5-8b86-096a673babec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:39.693867 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54abe45d-e1e3-44b5-8b86-096a673babec admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:39.694151 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54abe45d-e1e3-44b5-8b86-096a673babec admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:39.694432 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54abe45d-e1e3-44b5-8b86-096a673babec admin admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:39.695395 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54abe45d-e1e3-44b5-8b86-096a673babec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:39.698063 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54abe45d-e1e3-44b5-8b86-096a673babec admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:39.705797 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 811/1610] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:29:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:29:39.707764 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e44da0-de01-4cbc-b8e3-e3c1d26d6cbd None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:39.708212 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e44da0-de01-4cbc-b8e3-e3c1d26d6cbd None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:39.708602 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e44da0-de01-4cbc-b8e3-e3c1d26d6cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:39.725734 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 800/1611] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:29:39 2022] POST /identity/v3/users => generated 299 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:29:39.727328 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869da8a-cae3-4796-9f2f-2e05320d7ccb None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:39.727600 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869da8a-cae3-4796-9f2f-2e05320d7ccb None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:39.727887 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869da8a-cae3-4796-9f2f-2e05320d7ccb None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:39.729374 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 801/1612] 10.222.0.42 () {54 vars in 962 bytes} [Tue Aug 2 15:29:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:29:39.730528 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e2178-e7ce-4bfc-b117-f02a9653248c None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:39.730884 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e2178-e7ce-4bfc-b117-f02a9653248c None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:39.731163 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e2178-e7ce-4bfc-b117-f02a9653248c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:39.752142 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-00e44da0-de01-4cbc-b8e3-e3c1d26d6cbd None None] MFA Rules not processed for user `5c978c3804784f2483d11406dfe5d726`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:29:39.753457 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-00e44da0-de01-4cbc-b8e3-e3c1d26d6cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:39.768157 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-8c4e2178-e7ce-4bfc-b117-f02a9653248c None None] MFA Rules not processed for user `e6ea47e912d4485ca03aa5a90b48a606`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:29:39.769717 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-8c4e2178-e7ce-4bfc-b117-f02a9653248c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:39.838090 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 812/1613] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:29:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:29:39.839673 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0c5de-d11c-443a-86c4-0f7a0487f825 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:39.840177 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0c5de-d11c-443a-86c4-0f7a0487f825 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:39.840653 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0c5de-d11c-443a-86c4-0f7a0487f825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:39.847687 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 802/1614] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:29:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:29:39.848635 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4e2178-e7ce-4bfc-b117-f02a9653248c None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:39.858184 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:29:39.863793 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-cce0c5de-d11c-443a-86c4-0f7a0487f825 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:29:39.865039 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-cce0c5de-d11c-443a-86c4-0f7a0487f825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:39.878546 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 813/1615] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:29:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:29:39.878546 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0c5de-d11c-443a-86c4-0f7a0487f825 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:39.936078 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4e2178-e7ce-4bfc-b117-f02a9653248c None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:39.939876 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1fe2cb-3a59-43a7-b296-ea0b3b650ce8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:39.940529 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1fe2cb-3a59-43a7-b296-ea0b3b650ce8 service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:39.940812 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1fe2cb-3a59-43a7-b296-ea0b3b650ce8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:39.941086 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1fe2cb-3a59-43a7-b296-ea0b3b650ce8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:39.951588 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1fe2cb-3a59-43a7-b296-ea0b3b650ce8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:39.953407 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1fe2cb-3a59-43a7-b296-ea0b3b650ce8 service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:39.957206 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0c5de-d11c-443a-86c4-0f7a0487f825 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:39.961300 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae2b574-3b96-44d6-8e54-fbfff4ed72c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:39.961916 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2b574-3b96-44d6-8e54-fbfff4ed72c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:39.962201 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2b574-3b96-44d6-8e54-fbfff4ed72c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:39.962469 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2b574-3b96-44d6-8e54-fbfff4ed72c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:39.963908 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 803/1616] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:29:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:29:39.964798 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1fe2cb-3a59-43a7-b296-ea0b3b650ce8 service neutron] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:39.973935 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae2b574-3b96-44d6-8e54-fbfff4ed72c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:39.975470 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae2b574-3b96-44d6-8e54-fbfff4ed72c2 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:39.976058 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1fe2cb-3a59-43a7-b296-ea0b3b650ce8 service neutron] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:39.983465 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e640b-ae78-482a-876c-c4dd77c2c4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:39.984217 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e640b-ae78-482a-876c-c4dd77c2c4e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:39.984550 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e640b-ae78-482a-876c-c4dd77c2c4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:39.984890 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e640b-ae78-482a-876c-c4dd77c2c4e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:39.985691 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455e640b-ae78-482a-876c-c4dd77c2c4e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:39.986462 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 814/1617] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:29:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:29:39.987504 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455e640b-ae78-482a-876c-c4dd77c2c4e9 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:39.987749 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ba768-31cc-40a6-bdb1-7ab6d9022dcd None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:39.988039 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ba768-31cc-40a6-bdb1-7ab6d9022dcd None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:39.988315 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ba768-31cc-40a6-bdb1-7ab6d9022dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:39.999340 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 804/1618] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:29:40.000345 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e640b-ae78-482a-876c-c4dd77c2c4e9 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:40.014550 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e640b-ae78-482a-876c-c4dd77c2c4e9 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:40.015138 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:29:40.021440 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea05be5-e57a-47c2-b6a6-5751dfc35b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:40.022144 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea05be5-e57a-47c2-b6a6-5751dfc35b5b admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:40.022515 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea05be5-e57a-47c2-b6a6-5751dfc35b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:40.022854 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea05be5-e57a-47c2-b6a6-5751dfc35b5b admin admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:40.023789 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea05be5-e57a-47c2-b6a6-5751dfc35b5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:40.025952 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea05be5-e57a-47c2-b6a6-5751dfc35b5b admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:40.041617 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-266ba768-31cc-40a6-bdb1-7ab6d9022dcd None None] MFA Rules not processed for user `4c0865af59bf43dfa4c84213d7db53c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:29:40.042894 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-266ba768-31cc-40a6-bdb1-7ab6d9022dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:40.059281 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 805/1619] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:29:39 2022] POST /identity/v3/projects => generated 381 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:29:40.061710 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea05be5-e57a-47c2-b6a6-5751dfc35b5b admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:40.150079 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 815/1620] 10.222.0.42 () {58 vars in 1059 bytes} [Tue Aug 2 15:29:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:29:40.151286 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266ba768-31cc-40a6-bdb1-7ab6d9022dcd None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:40.164000 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266ba768-31cc-40a6-bdb1-7ab6d9022dcd None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:40.165617 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea05be5-e57a-47c2-b6a6-5751dfc35b5b admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:40.177318 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f779990-f3dc-4c27-8800-ffb1d5798004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:40.178001 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f779990-f3dc-4c27-8800-ffb1d5798004 admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:40.178285 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f779990-f3dc-4c27-8800-ffb1d5798004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:40.178601 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f779990-f3dc-4c27-8800-ffb1d5798004 admin admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:40.179832 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f779990-f3dc-4c27-8800-ffb1d5798004 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:40.183535 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f779990-f3dc-4c27-8800-ffb1d5798004 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:40.240181 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 806/1621] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:29:40 2022] POST /identity/v3/projects => generated 373 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:29:40.241371 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f779990-f3dc-4c27-8800-ffb1d5798004 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:40.256934 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e9547d-46e3-4147-8f0d-3cfc5b64e474 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:40.258900 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9547d-46e3-4147-8f0d-3cfc5b64e474 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:40.259892 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9547d-46e3-4147-8f0d-3cfc5b64e474 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:40.260408 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9547d-46e3-4147-8f0d-3cfc5b64e474 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:40.275426 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e9547d-46e3-4147-8f0d-3cfc5b64e474 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:40.277707 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e9547d-46e3-4147-8f0d-3cfc5b64e474 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:40.303914 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 816/1622] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:29:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:29:40.305081 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e9547d-46e3-4147-8f0d-3cfc5b64e474 service neutron] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:40.319696 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e9547d-46e3-4147-8f0d-3cfc5b64e474 service neutron] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:40.348851 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f779990-f3dc-4c27-8800-ffb1d5798004 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:40.355252 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4879f8-8751-4a8d-bfbd-849366c2625b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:40.355993 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4879f8-8751-4a8d-bfbd-849366c2625b admin admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:40.356285 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4879f8-8751-4a8d-bfbd-849366c2625b admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:40.356622 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4879f8-8751-4a8d-bfbd-849366c2625b admin admin] PATH_INFO: `/v3/projects/1de9005f26c94d32a8941e5d5c10ae48/users/836d43950da74d6daeb849d96db2bede/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:40.360571 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:29:40.381581 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4879f8-8751-4a8d-bfbd-849366c2625b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1de9005f26c94d32a8941e5d5c10ae48, user_id=836d43950da74d6daeb849d96db2bede, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:40.385056 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4879f8-8751-4a8d-bfbd-849366c2625b admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:40.411298 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 807/1623] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:29:40 2022] PUT /identity/v3/projects/1de9005f26c94d32a8941e5d5c10ae48/users/836d43950da74d6daeb849d96db2bede/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:29:40.411298 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4879f8-8751-4a8d-bfbd-849366c2625b admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:40.430114 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f649b-215b-4b64-911a-fc418ecaf466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:40.430769 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f649b-215b-4b64-911a-fc418ecaf466 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:40.431054 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f649b-215b-4b64-911a-fc418ecaf466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:40.431529 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f649b-215b-4b64-911a-fc418ecaf466 admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:40.432305 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7f649b-215b-4b64-911a-fc418ecaf466 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:40.434322 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7f649b-215b-4b64-911a-fc418ecaf466 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:40.477907 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 817/1624] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:29:40 2022] POST /identity/v3/users => generated 297 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:29:40.478911 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f649b-215b-4b64-911a-fc418ecaf466 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:40.495333 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4879f8-8751-4a8d-bfbd-849366c2625b admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:40.499935 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f649b-215b-4b64-911a-fc418ecaf466 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:40.503606 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f2f9d3-bc4d-4854-9ed2-0dc0239eea24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0865af59bf43dfa4c84213d7db53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:40.504407 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f2f9d3-bc4d-4854-9ed2-0dc0239eea24 service nova] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:40.504844 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f2f9d3-bc4d-4854-9ed2-0dc0239eea24 service nova] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:40.505284 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f2f9d3-bc4d-4854-9ed2-0dc0239eea24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:40.526804 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:29:40.581440 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f2f9d3-bc4d-4854-9ed2-0dc0239eea24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:40.583609 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f2f9d3-bc4d-4854-9ed2-0dc0239eea24 service nova] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:40.597078 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d70db-d2dc-48bf-a0ec-5569f171711b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:40.597875 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d70db-d2dc-48bf-a0ec-5569f171711b admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:40.598125 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d70db-d2dc-48bf-a0ec-5569f171711b admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:40.598453 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d70db-d2dc-48bf-a0ec-5569f171711b admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:40.599070 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855d70db-d2dc-48bf-a0ec-5569f171711b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:40.602913 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 808/1625] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:29:40 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:29:40.604050 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f2f9d3-bc4d-4854-9ed2-0dc0239eea24 service nova] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:40.625819 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855d70db-d2dc-48bf-a0ec-5569f171711b admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:40.637684 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f2f9d3-bc4d-4854-9ed2-0dc0239eea24 service nova] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:40.654599 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387aa8d-ae9a-4fad-9fc5-8f62ee12337a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:40.655325 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387aa8d-ae9a-4fad-9fc5-8f62ee12337a admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:40.655611 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387aa8d-ae9a-4fad-9fc5-8f62ee12337a admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:40.655889 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387aa8d-ae9a-4fad-9fc5-8f62ee12337a admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:40.656601 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6387aa8d-ae9a-4fad-9fc5-8f62ee12337a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:40.662109 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6387aa8d-ae9a-4fad-9fc5-8f62ee12337a admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:40.663653 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 818/1626] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:29:40 2022] POST /identity/v3/users => generated 293 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:29:40.665157 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d70db-d2dc-48bf-a0ec-5569f171711b admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:40.682410 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d70db-d2dc-48bf-a0ec-5569f171711b admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:40.689186 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9630cd-6152-4f37-adbd-5cb8647050b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:40.689866 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9630cd-6152-4f37-adbd-5cb8647050b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:40.690445 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 809/1627] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:29:40.691422 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387aa8d-ae9a-4fad-9fc5-8f62ee12337a admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:40.693946 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9630cd-6152-4f37-adbd-5cb8647050b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:40.694334 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9630cd-6152-4f37-adbd-5cb8647050b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:40.695414 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9630cd-6152-4f37-adbd-5cb8647050b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:40.698856 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9630cd-6152-4f37-adbd-5cb8647050b5 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:40.714805 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 819/1628] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:29:40.716171 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9630cd-6152-4f37-adbd-5cb8647050b5 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:40.722012 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387aa8d-ae9a-4fad-9fc5-8f62ee12337a admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:40.735720 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c58f3a-01d5-474f-bac7-9569baf8d93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:40.736366 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c58f3a-01d5-474f-bac7-9569baf8d93c admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:40.736648 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c58f3a-01d5-474f-bac7-9569baf8d93c admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:40.736932 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c58f3a-01d5-474f-bac7-9569baf8d93c admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:40.737614 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c58f3a-01d5-474f-bac7-9569baf8d93c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:40.739294 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c58f3a-01d5-474f-bac7-9569baf8d93c admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:40.748299 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9630cd-6152-4f37-adbd-5cb8647050b5 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:40.759624 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3cfd1f-e035-40e1-acab-0226ed6f75ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:40.762321 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3cfd1f-e035-40e1-acab-0226ed6f75ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:40.762642 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3cfd1f-e035-40e1-acab-0226ed6f75ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:40.763674 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 810/1629] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:29:40.764549 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c58f3a-01d5-474f-bac7-9569baf8d93c admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:40.767948 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3cfd1f-e035-40e1-acab-0226ed6f75ac admin admin] PATH_INFO: `/v3/projects/1de9005f26c94d32a8941e5d5c10ae48/users/836d43950da74d6daeb849d96db2bede/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:40.773230 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3cfd1f-e035-40e1-acab-0226ed6f75ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=1de9005f26c94d32a8941e5d5c10ae48, user_id=836d43950da74d6daeb849d96db2bede, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:40.780909 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3cfd1f-e035-40e1-acab-0226ed6f75ac admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:40.789336 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c58f3a-01d5-474f-bac7-9569baf8d93c admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:40.803774 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebfaf9e-d1b0-41f5-b9b8-277047755466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:40.804480 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebfaf9e-d1b0-41f5-b9b8-277047755466 admin admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:40.804756 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebfaf9e-d1b0-41f5-b9b8-277047755466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:40.805038 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebfaf9e-d1b0-41f5-b9b8-277047755466 admin admin] PATH_INFO: `/v3/projects/e34dd106c8604e69926f06756f30424e/users/55d1da5b20474e02b017aaefcebb318d/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:40.821731 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 820/1630] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:29:40 2022] PUT /identity/v3/projects/1de9005f26c94d32a8941e5d5c10ae48/users/836d43950da74d6daeb849d96db2bede/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:29:40.824165 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3cfd1f-e035-40e1-acab-0226ed6f75ac admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:40.842064 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebfaf9e-d1b0-41f5-b9b8-277047755466 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e34dd106c8604e69926f06756f30424e, user_id=55d1da5b20474e02b017aaefcebb318d, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:40.846459 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebfaf9e-d1b0-41f5-b9b8-277047755466 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:40.871157 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 811/1631] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:29:40 2022] PUT /identity/v3/projects/e34dd106c8604e69926f06756f30424e/users/55d1da5b20474e02b017aaefcebb318d/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:29:40.872508 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9e628-f9df-42bf-9535-89d2f681542f None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:40.872803 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9e628-f9df-42bf-9535-89d2f681542f None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:40.873091 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9e628-f9df-42bf-9535-89d2f681542f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:40.970772 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-c3f9e628-f9df-42bf-9535-89d2f681542f None None] MFA Rules not processed for user `836d43950da74d6daeb849d96db2bede`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:29:40.972093 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-c3f9e628-f9df-42bf-9535-89d2f681542f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:41.038988 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:29:41.051294 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3cfd1f-e035-40e1-acab-0226ed6f75ac admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:41.159110 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9725962-fba9-4cc4-86fd-5f7035e8e6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:41.159742 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9725962-fba9-4cc4-86fd-5f7035e8e6a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:41.160024 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9725962-fba9-4cc4-86fd-5f7035e8e6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:41.160294 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9725962-fba9-4cc4-86fd-5f7035e8e6a7 admin admin] PATH_INFO: `/v3/projects/e32f8f26bbc64a07bd8f8e1fb3024919/users/b164f4de52f44c06893ab831f378f4b3/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:41.174180 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 812/1632] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:29:40 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:29:41.175370 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f9e628-f9df-42bf-9535-89d2f681542f None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:41.191022 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9725962-fba9-4cc4-86fd-5f7035e8e6a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e32f8f26bbc64a07bd8f8e1fb3024919, user_id=b164f4de52f44c06893ab831f378f4b3, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:41.192875 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9725962-fba9-4cc4-86fd-5f7035e8e6a7 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:41.214844 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f9e628-f9df-42bf-9535-89d2f681542f None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:41.230998 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338bdf05-732a-4d7e-bacb-ad4d8c12d699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:41.233087 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338bdf05-732a-4d7e-bacb-ad4d8c12d699 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:41.233548 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338bdf05-732a-4d7e-bacb-ad4d8c12d699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:41.233990 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338bdf05-732a-4d7e-bacb-ad4d8c12d699 admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:41.235004 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338bdf05-732a-4d7e-bacb-ad4d8c12d699 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:41.236881 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338bdf05-732a-4d7e-bacb-ad4d8c12d699 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:41.238663 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 821/1633] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:29:40 2022] PUT /identity/v3/projects/e32f8f26bbc64a07bd8f8e1fb3024919/users/b164f4de52f44c06893ab831f378f4b3/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:29:41.239802 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9725962-fba9-4cc4-86fd-5f7035e8e6a7 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:41.262293 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 813/1634] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:29:41 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:29:41.263542 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338bdf05-732a-4d7e-bacb-ad4d8c12d699 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:41.265201 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:29:41.284276 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338bdf05-732a-4d7e-bacb-ad4d8c12d699 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:41.381089 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9725962-fba9-4cc4-86fd-5f7035e8e6a7 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:41.391047 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b5216-39f2-4346-aa91-d17627841f86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:41.393940 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b5216-39f2-4346-aa91-d17627841f86 service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:41.394303 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b5216-39f2-4346-aa91-d17627841f86 service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:41.394656 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b5216-39f2-4346-aa91-d17627841f86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:41.424260 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56769123-9fab-4ff7-ab9f-a066fd2038d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:41.424995 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56769123-9fab-4ff7-ab9f-a066fd2038d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:41.425155 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56769123-9fab-4ff7-ab9f-a066fd2038d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:41.425465 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56769123-9fab-4ff7-ab9f-a066fd2038d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:41.426234 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56769123-9fab-4ff7-ab9f-a066fd2038d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:41.427898 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56769123-9fab-4ff7-ab9f-a066fd2038d8 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:41.453065 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 814/1635] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:29:41 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:29:41.453962 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56769123-9fab-4ff7-ab9f-a066fd2038d8 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:41.477717 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56769123-9fab-4ff7-ab9f-a066fd2038d8 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:41.491920 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8e09de-00f3-45ae-b7a4-a5ec5e9188d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:41.492613 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e09de-00f3-45ae-b7a4-a5ec5e9188d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:41.492898 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e09de-00f3-45ae-b7a4-a5ec5e9188d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:41.493180 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e09de-00f3-45ae-b7a4-a5ec5e9188d0 admin admin] PATH_INFO: `/v3/projects/e34dd106c8604e69926f06756f30424e/users/55d1da5b20474e02b017aaefcebb318d/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:41.508258 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8e09de-00f3-45ae-b7a4-a5ec5e9188d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e34dd106c8604e69926f06756f30424e, user_id=55d1da5b20474e02b017aaefcebb318d, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:41.510972 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8e09de-00f3-45ae-b7a4-a5ec5e9188d0 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:41.532282 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 815/1636] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:29:41 2022] PUT /identity/v3/projects/e34dd106c8604e69926f06756f30424e/users/55d1da5b20474e02b017aaefcebb318d/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:29:41.533153 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8e09de-00f3-45ae-b7a4-a5ec5e9188d0 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:41.558395 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938b5216-39f2-4346-aa91-d17627841f86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:41.562089 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938b5216-39f2-4346-aa91-d17627841f86 service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:41.605334 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 822/1637] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:29:41 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:29:41.610224 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d761db-616e-487d-813e-e8658f13819b None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:41.613152 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d761db-616e-487d-813e-e8658f13819b None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:41.614066 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d761db-616e-487d-813e-e8658f13819b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:41.691611 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-26d761db-616e-487d-813e-e8658f13819b None None] MFA Rules not processed for user `55d1da5b20474e02b017aaefcebb318d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:29:41.694692 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-26d761db-616e-487d-813e-e8658f13819b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:41.716997 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8e09de-00f3-45ae-b7a4-a5ec5e9188d0 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:41.739591 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e87152-ae84-4077-9bd1-36462fe0e7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:41.740324 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e87152-ae84-4077-9bd1-36462fe0e7f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:41.740680 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e87152-ae84-4077-9bd1-36462fe0e7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:41.740984 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e87152-ae84-4077-9bd1-36462fe0e7f0 admin admin] PATH_INFO: `/v3/projects/e32f8f26bbc64a07bd8f8e1fb3024919/users/b164f4de52f44c06893ab831f378f4b3/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:41.744172 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e87152-ae84-4077-9bd1-36462fe0e7f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e32f8f26bbc64a07bd8f8e1fb3024919, user_id=b164f4de52f44c06893ab831f378f4b3, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:41.749406 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e87152-ae84-4077-9bd1-36462fe0e7f0 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:41.791575 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 816/1638] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:29:41 2022] PUT /identity/v3/projects/e32f8f26bbc64a07bd8f8e1fb3024919/users/b164f4de52f44c06893ab831f378f4b3/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:29:41.791575 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28df993-031d-4287-b917-ce7b1d9ff805 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:41.791575 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28df993-031d-4287-b917-ce7b1d9ff805 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:41.791575 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28df993-031d-4287-b917-ce7b1d9ff805 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:41.800552 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 817/1639] 10.222.0.42 () {54 vars in 912 bytes} [Tue Aug 2 15:29:41 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:29:41.801597 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb156ce-5dcd-4d15-b80e-1868a3b79a0d None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:41.801879 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb156ce-5dcd-4d15-b80e-1868a3b79a0d None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:41.802150 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb156ce-5dcd-4d15-b80e-1868a3b79a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:41.908376 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-ebb156ce-5dcd-4d15-b80e-1868a3b79a0d None None] MFA Rules not processed for user `b164f4de52f44c06893ab831f378f4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:29:41.910933 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-ebb156ce-5dcd-4d15-b80e-1868a3b79a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:41.946748 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:29:41.959575 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 823/1640] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:29:41 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:29:41.960942 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df8052-d7f0-44e9-af4a-c0dc925fe674 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:41.961235 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df8052-d7f0-44e9-af4a-c0dc925fe674 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:41.961519 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df8052-d7f0-44e9-af4a-c0dc925fe674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:42.028011 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-a4df8052-d7f0-44e9-af4a-c0dc925fe674 None None] MFA Rules not processed for user `4c0865af59bf43dfa4c84213d7db53c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:29:42.030626 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-a4df8052-d7f0-44e9-af4a-c0dc925fe674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:42.126860 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 818/1641] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:29:41 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:29:42.128495 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb156ce-5dcd-4d15-b80e-1868a3b79a0d None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:42.145725 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:29:42.227944 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 824/1642] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Aug 2 15:29:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:29:42.229188 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df8052-d7f0-44e9-af4a-c0dc925fe674 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:42.319868 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb156ce-5dcd-4d15-b80e-1868a3b79a0d None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:42.331536 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf334a-7c4d-4803-864a-fdcee6c49354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:42.332226 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf334a-7c4d-4803-864a-fdcee6c49354 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:42.332508 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf334a-7c4d-4803-864a-fdcee6c49354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:42.332783 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf334a-7c4d-4803-864a-fdcee6c49354 admin admin] PATH_INFO: `/v3/users/9b96db67678548b0940e3a8ec7e1f561` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:42.336369 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcf334a-7c4d-4803-864a-fdcee6c49354 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b96db67678548b0940e3a8ec7e1f561)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:42.337938 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: WARNING py.warnings [None req-3bcf334a-7c4d-4803-864a-fdcee6c49354 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 15:29:42.337938 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: warnings.warn(msg) Aug 02 15:29:42.337938 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: Aug 02 15:29:42.339176 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcf334a-7c4d-4803-864a-fdcee6c49354 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:42.363096 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df8052-d7f0-44e9-af4a-c0dc925fe674 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:42.368504 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8137a3-c3b5-4973-a4cf-8cc1a7729029 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:42.369660 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8137a3-c3b5-4973-a4cf-8cc1a7729029 service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:42.370083 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8137a3-c3b5-4973-a4cf-8cc1a7729029 service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:42.370497 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8137a3-c3b5-4973-a4cf-8cc1a7729029 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:42.538267 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8137a3-c3b5-4973-a4cf-8cc1a7729029 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:42.541468 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8137a3-c3b5-4973-a4cf-8cc1a7729029 service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:42.542858 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-3bcf334a-7c4d-4803-864a-fdcee6c49354 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b96db67678548b0940e3a8ec7e1f561'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:29:42.577384 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 825/1643] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:29:42 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:29:42.578820 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8137a3-c3b5-4973-a4cf-8cc1a7729029 service cinder] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:42.586349 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-3bcf334a-7c4d-4803-864a-fdcee6c49354 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b96db67678548b0940e3a8ec7e1f561'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:29:42.600521 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8137a3-c3b5-4973-a4cf-8cc1a7729029 service cinder] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:42.616389 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d870ff8a-4838-4658-b86b-4037402247ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:42.617288 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d870ff8a-4838-4658-b86b-4037402247ae service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:42.617717 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d870ff8a-4838-4658-b86b-4037402247ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:42.618449 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d870ff8a-4838-4658-b86b-4037402247ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:42.659954 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-3bcf334a-7c4d-4803-864a-fdcee6c49354 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b96db67678548b0940e3a8ec7e1f561'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:29:42.661467 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d870ff8a-4838-4658-b86b-4037402247ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:42.665870 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-3bcf334a-7c4d-4803-864a-fdcee6c49354 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b96db67678548b0940e3a8ec7e1f561'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:29:42.671092 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-3bcf334a-7c4d-4803-864a-fdcee6c49354 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b96db67678548b0940e3a8ec7e1f561'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:29:42.671826 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d870ff8a-4838-4658-b86b-4037402247ae service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:42.709576 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 826/1644] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:29:42 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:29:42.711762 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d870ff8a-4838-4658-b86b-4037402247ae service cinder] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:42.713337 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 819/1645] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:29:42 2022] DELETE /identity/v3/users/9b96db67678548b0940e3a8ec7e1f561 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:29:42.720203 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6352956-50df-4b21-b205-9bbb7989f258 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:42.720698 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6352956-50df-4b21-b205-9bbb7989f258 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:42.720984 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6352956-50df-4b21-b205-9bbb7989f258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:42.724683 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d870ff8a-4838-4658-b86b-4037402247ae service cinder] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:42.751473 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-e6352956-50df-4b21-b205-9bbb7989f258 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:29:42.753116 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-e6352956-50df-4b21-b205-9bbb7989f258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:42.793286 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:29:42.798384 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87de37a-ed4d-4c0c-a7dc-dea87e8db8e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:42.800265 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87de37a-ed4d-4c0c-a7dc-dea87e8db8e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:42.802824 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87de37a-ed4d-4c0c-a7dc-dea87e8db8e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:42.803527 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87de37a-ed4d-4c0c-a7dc-dea87e8db8e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:42.807837 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-a87de37a-ed4d-4c0c-a7dc-dea87e8db8e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:42.897079 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:29:42.899061 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 820/1646] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:29:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:29:42.982405 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6352956-50df-4b21-b205-9bbb7989f258 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:42.983911 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-e6352956-50df-4b21-b205-9bbb7989f258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:43.025116 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87de37a-ed4d-4c0c-a7dc-dea87e8db8e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:43.026747 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87de37a-ed4d-4c0c-a7dc-dea87e8db8e5 service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:43.061424 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 827/1647] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:29:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:29:43.084323 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87de37a-ed4d-4c0c-a7dc-dea87e8db8e5 service cinder] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:43.086752 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-a87de37a-ed4d-4c0c-a7dc-dea87e8db8e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:43.106036 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87de37a-ed4d-4c0c-a7dc-dea87e8db8e5 service cinder] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:43.114399 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ff30f-a16a-4a6e-b418-cb1618bafc3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:43.115237 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ff30f-a16a-4a6e-b418-cb1618bafc3a service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:43.115536 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ff30f-a16a-4a6e-b418-cb1618bafc3a service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:43.115871 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ff30f-a16a-4a6e-b418-cb1618bafc3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:43.121160 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-b99ff30f-a16a-4a6e-b418-cb1618bafc3a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:43.161867 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6352956-50df-4b21-b205-9bbb7989f258 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:43.167395 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01befd3-4d5d-4f6a-8eef-3cc3b5408999 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:43.168083 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01befd3-4d5d-4f6a-8eef-3cc3b5408999 service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:43.168366 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01befd3-4d5d-4f6a-8eef-3cc3b5408999 service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:43.168639 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01befd3-4d5d-4f6a-8eef-3cc3b5408999 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:43.204128 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01befd3-4d5d-4f6a-8eef-3cc3b5408999 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:43.205644 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01befd3-4d5d-4f6a-8eef-3cc3b5408999 service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:43.243322 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 821/1648] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:29:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:29:43.284099 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99ff30f-a16a-4a6e-b418-cb1618bafc3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:43.289373 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99ff30f-a16a-4a6e-b418-cb1618bafc3a service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:43.311456 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 828/1649] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:29:43 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 15:29:43.688937 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01befd3-4d5d-4f6a-8eef-3cc3b5408999 service neutron] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:43.706635 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01befd3-4d5d-4f6a-8eef-3cc3b5408999 service neutron] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:43.723105 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e1d1b5-f6cc-481b-8859-ae0c78d61c1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:43.725434 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1d1b5-f6cc-481b-8859-ae0c78d61c1c service cinder] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:43.728626 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1d1b5-f6cc-481b-8859-ae0c78d61c1c service cinder] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:43.730073 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1d1b5-f6cc-481b-8859-ae0c78d61c1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:43.743726 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-f2e1d1b5-f6cc-481b-8859-ae0c78d61c1c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:43.987706 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e1d1b5-f6cc-481b-8859-ae0c78d61c1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:43.991263 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e1d1b5-f6cc-481b-8859-ae0c78d61c1c service cinder] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:44.015312 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 822/1650] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:29:43 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 15:29:44.297878 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c55ba6-5d0d-4f7d-ae6a-fb9d82610f10 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:44.298351 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c55ba6-5d0d-4f7d-ae6a-fb9d82610f10 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:44.298525 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c55ba6-5d0d-4f7d-ae6a-fb9d82610f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:44.366898 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-f0c55ba6-5d0d-4f7d-ae6a-fb9d82610f10 None None] MFA Rules not processed for user `0076b5aed46e49649960c8491a74637d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:29:44.368275 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-f0c55ba6-5d0d-4f7d-ae6a-fb9d82610f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:44.427139 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e1d1b5-f6cc-481b-8859-ae0c78d61c1c service cinder] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:44.428739 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-f2e1d1b5-f6cc-481b-8859-ae0c78d61c1c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:44.479402 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e1d1b5-f6cc-481b-8859-ae0c78d61c1c service cinder] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:44.487046 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34858a-8b66-477d-8798-2482b0d698c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:44.487604 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34858a-8b66-477d-8798-2482b0d698c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:44.487887 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34858a-8b66-477d-8798-2482b0d698c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:44.488168 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34858a-8b66-477d-8798-2482b0d698c9 admin admin] PATH_INFO: `/v3/projects/500a134ecb214ee1a365daba31c9c6a7` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:44.493089 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b34858a-8b66-477d-8798-2482b0d698c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=500a134ecb214ee1a365daba31c9c6a7)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:44.493482 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b34858a-8b66-477d-8798-2482b0d698c9 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:44.632401 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 829/1651] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:29:44 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:29:44.634080 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c55ba6-5d0d-4f7d-ae6a-fb9d82610f10 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:44.641420 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-f0c55ba6-5d0d-4f7d-ae6a-fb9d82610f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:44.662699 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-6b34858a-8b66-477d-8798-2482b0d698c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '500a134ecb214ee1a365daba31c9c6a7', 'request_id': 'req-6b34858a-8b66-477d-8798-2482b0d698c9'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:29:44.692216 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-6b34858a-8b66-477d-8798-2482b0d698c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '500a134ecb214ee1a365daba31c9c6a7', 'request_id': 'req-6b34858a-8b66-477d-8798-2482b0d698c9'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:29:44.703678 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-6b34858a-8b66-477d-8798-2482b0d698c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '500a134ecb214ee1a365daba31c9c6a7', 'request_id': 'req-6b34858a-8b66-477d-8798-2482b0d698c9'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:29:44.706982 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c55ba6-5d0d-4f7d-ae6a-fb9d82610f10 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:44.738127 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:29:44.775532 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-6b34858a-8b66-477d-8798-2482b0d698c9 admin admin] The token cache is being invalidate because project 500a134ecb214ee1a365daba31c9c6a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80360) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:29:44.777255 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-6b34858a-8b66-477d-8798-2482b0d698c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:29:44.780702 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-6b34858a-8b66-477d-8798-2482b0d698c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:29:44.792427 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 823/1652] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:29:44 2022] DELETE /identity/v3/projects/500a134ecb214ee1a365daba31c9c6a7 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:29:44.799553 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34858a-8b66-477d-8798-2482b0d698c9 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:44.803071 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-6b34858a-8b66-477d-8798-2482b0d698c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:44.974415 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:29:45.059384 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f1c227-54a2-4183-9058-fc3c01cac772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:45.060941 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1c227-54a2-4183-9058-fc3c01cac772 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:45.061442 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1c227-54a2-4183-9058-fc3c01cac772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:45.061926 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1c227-54a2-4183-9058-fc3c01cac772 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:45.067369 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f1c227-54a2-4183-9058-fc3c01cac772 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:45.070983 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f1c227-54a2-4183-9058-fc3c01cac772 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:45.121999 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34858a-8b66-477d-8798-2482b0d698c9 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:45.134669 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef0f55a-7b94-44ad-b223-7f505af23104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:45.137147 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0f55a-7b94-44ad-b223-7f505af23104 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:45.148675 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0f55a-7b94-44ad-b223-7f505af23104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:45.150281 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0f55a-7b94-44ad-b223-7f505af23104 admin admin] PATH_INFO: `/v3/users/836d43950da74d6daeb849d96db2bede` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:45.154101 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef0f55a-7b94-44ad-b223-7f505af23104 admin admin] RBAC: Authorizing `identity:delete_user(user_id=836d43950da74d6daeb849d96db2bede)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:45.159441 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef0f55a-7b94-44ad-b223-7f505af23104 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:45.232904 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 830/1653] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:29:44 2022] POST /identity/v3/projects => generated 405 bytes in 600 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 15:29:45.235390 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516bcbd-f74d-4699-864b-5596028a2223 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:45.236423 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516bcbd-f74d-4699-864b-5596028a2223 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:45.236894 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516bcbd-f74d-4699-864b-5596028a2223 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:45.256859 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 831/1654] 10.222.0.42 () {54 vars in 962 bytes} [Tue Aug 2 15:29:45 2022] GET /identity => generated 270 bytes in 23 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:29:45.258185 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516bcbd-f74d-4699-864b-5596028a2223 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:45.269266 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-4516bcbd-f74d-4699-864b-5596028a2223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:45.287681 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-4ef0f55a-7b94-44ad-b223-7f505af23104 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '836d43950da74d6daeb849d96db2bede'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:29:45.306912 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-4ef0f55a-7b94-44ad-b223-7f505af23104 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '836d43950da74d6daeb849d96db2bede'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:29:45.336294 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-4ef0f55a-7b94-44ad-b223-7f505af23104 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '836d43950da74d6daeb849d96db2bede'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:29:45.338124 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-4ef0f55a-7b94-44ad-b223-7f505af23104 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '836d43950da74d6daeb849d96db2bede'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:29:45.338796 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-4ef0f55a-7b94-44ad-b223-7f505af23104 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '836d43950da74d6daeb849d96db2bede'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:29:45.371848 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 824/1655] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:29:44 2022] DELETE /identity/v3/users/836d43950da74d6daeb849d96db2bede => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:29:45.374034 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77e4b24-1b13-4278-b004-f63b8ecb27e7 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:45.374492 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77e4b24-1b13-4278-b004-f63b8ecb27e7 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:45.374753 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77e4b24-1b13-4278-b004-f63b8ecb27e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:45.431588 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-e77e4b24-1b13-4278-b004-f63b8ecb27e7 None None] MFA Rules not processed for user `4c0865af59bf43dfa4c84213d7db53c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:29:45.433010 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-e77e4b24-1b13-4278-b004-f63b8ecb27e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:45.595589 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516bcbd-f74d-4699-864b-5596028a2223 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:45.642613 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 825/1656] 10.222.0.42 () {58 vars in 1059 bytes} [Tue Aug 2 15:29:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:29:45.647845 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c30d0-a666-4955-b0c6-b5c48108b5b1 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:45.648365 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c30d0-a666-4955-b0c6-b5c48108b5b1 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:45.651690 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c30d0-a666-4955-b0c6-b5c48108b5b1 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:45.655528 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 826/1657] 10.222.0.42 () {54 vars in 912 bytes} [Tue Aug 2 15:29:45 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:29:45.661334 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c638336-b596-4a9b-b8bb-028d765ee153 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:45.666716 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c638336-b596-4a9b-b8bb-028d765ee153 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:45.667057 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c638336-b596-4a9b-b8bb-028d765ee153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:45.693453 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:29:45.714172 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-6c638336-b596-4a9b-b8bb-028d765ee153 None None] MFA Rules not processed for user `4c0865af59bf43dfa4c84213d7db53c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:29:45.715847 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-6c638336-b596-4a9b-b8bb-028d765ee153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:45.756313 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 827/1658] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Aug 2 15:29:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:29:45.829422 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d98c9-5569-4f92-acdf-9933bd123f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:45.830009 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d98c9-5569-4f92-acdf-9933bd123f5f admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:45.830292 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d98c9-5569-4f92-acdf-9933bd123f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:45.830572 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d98c9-5569-4f92-acdf-9933bd123f5f admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:45.831260 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184d98c9-5569-4f92-acdf-9933bd123f5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:45.833707 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184d98c9-5569-4f92-acdf-9933bd123f5f admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:45.852606 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c638336-b596-4a9b-b8bb-028d765ee153 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:45.855252 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-6c638336-b596-4a9b-b8bb-028d765ee153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:45.893528 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 832/1659] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:29:45 2022] POST /identity/v3/users => generated 309 bytes in 636 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:29:45.898778 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d98c9-5569-4f92-acdf-9933bd123f5f admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:45.907766 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-184d98c9-5569-4f92-acdf-9933bd123f5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:45.933881 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d98c9-5569-4f92-acdf-9933bd123f5f admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:45.938990 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c638336-b596-4a9b-b8bb-028d765ee153 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:45.942950 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cebfdff-33d3-4f61-83af-cf0d69ee94ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:45.943892 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cebfdff-33d3-4f61-83af-cf0d69ee94ee service cinder] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:45.944372 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cebfdff-33d3-4f61-83af-cf0d69ee94ee service cinder] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:45.945010 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cebfdff-33d3-4f61-83af-cf0d69ee94ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:45.958954 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aace7da-92ee-45d4-8048-6863a5df93e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:45.960986 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cebfdff-33d3-4f61-83af-cf0d69ee94ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:45.961395 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aace7da-92ee-45d4-8048-6863a5df93e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:45.961685 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aace7da-92ee-45d4-8048-6863a5df93e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:45.961963 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aace7da-92ee-45d4-8048-6863a5df93e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:45.963369 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cebfdff-33d3-4f61-83af-cf0d69ee94ee service cinder] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:45.967772 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aace7da-92ee-45d4-8048-6863a5df93e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:45.971404 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aace7da-92ee-45d4-8048-6863a5df93e8 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:45.989573 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 828/1660] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:29:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 15:29:46.009915 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 833/1661] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:29:46.011142 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cebfdff-33d3-4f61-83af-cf0d69ee94ee service cinder] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:46.037390 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cebfdff-33d3-4f61-83af-cf0d69ee94ee service cinder] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:46.054727 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f22432-76bd-4490-a41c-53ccc2496563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:46.055609 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f22432-76bd-4490-a41c-53ccc2496563 admin admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:46.055990 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f22432-76bd-4490-a41c-53ccc2496563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:46.057346 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f22432-76bd-4490-a41c-53ccc2496563 admin admin] PATH_INFO: `/v3/projects/f1791a1136724dea9dc2741ef180870d/users/dc97948a7016401689c57dae4d59eb71/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:46.088451 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44af2b2-92dd-483f-8c25-f858f4137779 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:46.088798 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44af2b2-92dd-483f-8c25-f858f4137779 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:46.089157 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44af2b2-92dd-483f-8c25-f858f4137779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:46.093715 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f22432-76bd-4490-a41c-53ccc2496563 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1791a1136724dea9dc2741ef180870d, user_id=dc97948a7016401689c57dae4d59eb71, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:46.097865 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f22432-76bd-4490-a41c-53ccc2496563 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:46.128224 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 829/1662] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:29:46 2022] PUT /identity/v3/projects/f1791a1136724dea9dc2741ef180870d/users/dc97948a7016401689c57dae4d59eb71/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:29:46.137443 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f22432-76bd-4490-a41c-53ccc2496563 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:46.188421 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-a44af2b2-92dd-483f-8c25-f858f4137779 None None] MFA Rules not processed for user `0f08ca03f3f44afcbbbe94fe0ac5baf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:29:46.191145 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-a44af2b2-92dd-483f-8c25-f858f4137779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:46.343505 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:29:46.351435 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f22432-76bd-4490-a41c-53ccc2496563 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:46.373033 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76761b34-d27d-4a6c-89d3-f6ceffa15d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:46.374929 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76761b34-d27d-4a6c-89d3-f6ceffa15d06 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:46.376615 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76761b34-d27d-4a6c-89d3-f6ceffa15d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:46.378029 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76761b34-d27d-4a6c-89d3-f6ceffa15d06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:46.379279 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76761b34-d27d-4a6c-89d3-f6ceffa15d06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:46.380721 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76761b34-d27d-4a6c-89d3-f6ceffa15d06 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:46.406473 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 834/1663] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:29:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:29:46.411168 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 830/1664] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:29:46 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:29:46.414230 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44af2b2-92dd-483f-8c25-f858f4137779 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:46.426565 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76761b34-d27d-4a6c-89d3-f6ceffa15d06 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:46.428613 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-76761b34-d27d-4a6c-89d3-f6ceffa15d06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:46.442030 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44af2b2-92dd-483f-8c25-f858f4137779 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:46.469318 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e272c075-68bf-491d-a205-4e2275ca7a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:46.470039 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e272c075-68bf-491d-a205-4e2275ca7a54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:46.470510 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e272c075-68bf-491d-a205-4e2275ca7a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:46.470671 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e272c075-68bf-491d-a205-4e2275ca7a54 admin admin] PATH_INFO: `/v3/projects/f1791a1136724dea9dc2741ef180870d/users/dc97948a7016401689c57dae4d59eb71/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:46.480123 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e272c075-68bf-491d-a205-4e2275ca7a54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1791a1136724dea9dc2741ef180870d, user_id=dc97948a7016401689c57dae4d59eb71, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:46.483503 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e272c075-68bf-491d-a205-4e2275ca7a54 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:46.513854 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 835/1665] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:29:46 2022] PUT /identity/v3/projects/f1791a1136724dea9dc2741ef180870d/users/dc97948a7016401689c57dae4d59eb71/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:29:46.692924 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76761b34-d27d-4a6c-89d3-f6ceffa15d06 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:46.708530 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:29:46.868500 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f192366-2292-4c01-af2c-a77b981b15b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0865af59bf43dfa4c84213d7db53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:46.869596 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f192366-2292-4c01-af2c-a77b981b15b9 service nova] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:46.870075 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f192366-2292-4c01-af2c-a77b981b15b9 service nova] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:46.870620 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f192366-2292-4c01-af2c-a77b981b15b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:46.941096 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e272c075-68bf-491d-a205-4e2275ca7a54 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:46.942994 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-e272c075-68bf-491d-a205-4e2275ca7a54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:47.028516 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f192366-2292-4c01-af2c-a77b981b15b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:47.030891 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f192366-2292-4c01-af2c-a77b981b15b9 service nova] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:47.058908 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 831/1666] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:29:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 633 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:29:47.191945 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e272c075-68bf-491d-a205-4e2275ca7a54 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:47.217174 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494b9d3b-f8b1-4560-a7d2-b61f3677dfad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:47.217993 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b9d3b-f8b1-4560-a7d2-b61f3677dfad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:47.218506 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b9d3b-f8b1-4560-a7d2-b61f3677dfad admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:47.221754 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b9d3b-f8b1-4560-a7d2-b61f3677dfad admin admin] PATH_INFO: `/v3/projects/1de9005f26c94d32a8941e5d5c10ae48` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:47.223914 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494b9d3b-f8b1-4560-a7d2-b61f3677dfad admin admin] RBAC: Authorizing `identity:delete_project(project_id=1de9005f26c94d32a8941e5d5c10ae48)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:47.225273 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: WARNING py.warnings [None req-494b9d3b-f8b1-4560-a7d2-b61f3677dfad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 15:29:47.225273 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: warnings.warn(msg) Aug 02 15:29:47.225273 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: Aug 02 15:29:47.228235 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494b9d3b-f8b1-4560-a7d2-b61f3677dfad admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:47.398786 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-494b9d3b-f8b1-4560-a7d2-b61f3677dfad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1de9005f26c94d32a8941e5d5c10ae48', 'request_id': 'req-494b9d3b-f8b1-4560-a7d2-b61f3677dfad'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:29:47.431810 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-494b9d3b-f8b1-4560-a7d2-b61f3677dfad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1de9005f26c94d32a8941e5d5c10ae48', 'request_id': 'req-494b9d3b-f8b1-4560-a7d2-b61f3677dfad'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:29:47.452820 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-494b9d3b-f8b1-4560-a7d2-b61f3677dfad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1de9005f26c94d32a8941e5d5c10ae48', 'request_id': 'req-494b9d3b-f8b1-4560-a7d2-b61f3677dfad'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:29:47.475290 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-494b9d3b-f8b1-4560-a7d2-b61f3677dfad admin admin] The token cache is being invalidate because project 1de9005f26c94d32a8941e5d5c10ae48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:29:47.475635 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-494b9d3b-f8b1-4560-a7d2-b61f3677dfad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:29:47.476376 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-494b9d3b-f8b1-4560-a7d2-b61f3677dfad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:29:47.484334 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 836/1667] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:29:46 2022] DELETE /identity/v3/projects/1de9005f26c94d32a8941e5d5c10ae48 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 15:29:47.486095 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86c2f0-7343-4b5e-8a41-1ae2dcb9f1e6 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:47.486386 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86c2f0-7343-4b5e-8a41-1ae2dcb9f1e6 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:47.486661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86c2f0-7343-4b5e-8a41-1ae2dcb9f1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:47.551936 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-9c86c2f0-7343-4b5e-8a41-1ae2dcb9f1e6 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:29:47.556020 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-9c86c2f0-7343-4b5e-8a41-1ae2dcb9f1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:47.739436 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 832/1668] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:29:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:29:47.748428 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ed766-0726-4ce7-8d83-fc23a7460182 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:47.749713 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ed766-0726-4ce7-8d83-fc23a7460182 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:47.750148 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ed766-0726-4ce7-8d83-fc23a7460182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:47.797408 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-e75ed766-0726-4ce7-8d83-fc23a7460182 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:29:47.799401 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-e75ed766-0726-4ce7-8d83-fc23a7460182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:47.875701 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 837/1669] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:29:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:29:47.880926 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c86c2f0-7343-4b5e-8a41-1ae2dcb9f1e6 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:47.896723 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c86c2f0-7343-4b5e-8a41-1ae2dcb9f1e6 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:47.916681 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b8ef55-4410-411d-b7ea-3cb25ba7820f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:47.916681 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b8ef55-4410-411d-b7ea-3cb25ba7820f admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:47.916681 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b8ef55-4410-411d-b7ea-3cb25ba7820f admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:47.916681 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b8ef55-4410-411d-b7ea-3cb25ba7820f admin admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:47.917418 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b8ef55-4410-411d-b7ea-3cb25ba7820f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:29:47.917724 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b8ef55-4410-411d-b7ea-3cb25ba7820f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:47.919815 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ed766-0726-4ce7-8d83-fc23a7460182 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:47.920057 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b8ef55-4410-411d-b7ea-3cb25ba7820f admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:47.922195 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-e75ed766-0726-4ce7-8d83-fc23a7460182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:47.939202 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ed766-0726-4ce7-8d83-fc23a7460182 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:47.951070 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f90ac9-1b45-474d-bfde-cb44192fb024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:47.952258 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f90ac9-1b45-474d-bfde-cb44192fb024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:47.952750 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f90ac9-1b45-474d-bfde-cb44192fb024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:47.953297 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f90ac9-1b45-474d-bfde-cb44192fb024 admin admin] PATH_INFO: `/v3/users/52fbc91b7cde44418ec96fb78787d183` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:47.956039 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f90ac9-1b45-474d-bfde-cb44192fb024 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52fbc91b7cde44418ec96fb78787d183)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:47.957997 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 833/1670] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 2 15:29:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:29:47.962346 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b8ef55-4410-411d-b7ea-3cb25ba7820f admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:47.965917 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f90ac9-1b45-474d-bfde-cb44192fb024 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:47.987327 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b8ef55-4410-411d-b7ea-3cb25ba7820f admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:48.007063 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde3017a-b42c-43de-8c91-62e5a47784a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:48.011593 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde3017a-b42c-43de-8c91-62e5a47784a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:48.013777 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde3017a-b42c-43de-8c91-62e5a47784a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:48.015635 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde3017a-b42c-43de-8c91-62e5a47784a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:48.021937 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde3017a-b42c-43de-8c91-62e5a47784a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:48.031600 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde3017a-b42c-43de-8c91-62e5a47784a4 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:48.134524 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-54f90ac9-1b45-474d-bfde-cb44192fb024 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52fbc91b7cde44418ec96fb78787d183'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:29:48.153017 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 834/1671] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:29:47 2022] POST /identity/v3/projects => generated 393 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 15:29:48.156502 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde3017a-b42c-43de-8c91-62e5a47784a4 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:48.158480 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=83,keystone:INSERT=2,keystone:DELETE=15 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:29:48.187268 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-54f90ac9-1b45-474d-bfde-cb44192fb024 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52fbc91b7cde44418ec96fb78787d183'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:29:48.188296 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-54f90ac9-1b45-474d-bfde-cb44192fb024 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52fbc91b7cde44418ec96fb78787d183'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:29:48.204771 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:29:48.206705 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-54f90ac9-1b45-474d-bfde-cb44192fb024 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52fbc91b7cde44418ec96fb78787d183'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:29:48.227623 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-54f90ac9-1b45-474d-bfde-cb44192fb024 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52fbc91b7cde44418ec96fb78787d183'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:29:48.247254 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 838/1672] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:29:47 2022] DELETE /identity/v3/users/52fbc91b7cde44418ec96fb78787d183 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:29:48.252888 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae19fe0-33f2-475c-9d33-4f7ff79950b8 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:48.254536 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae19fe0-33f2-475c-9d33-4f7ff79950b8 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:48.254536 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae19fe0-33f2-475c-9d33-4f7ff79950b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:48.300939 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-3ae19fe0-33f2-475c-9d33-4f7ff79950b8 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:29:48.314815 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-3ae19fe0-33f2-475c-9d33-4f7ff79950b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:48.394214 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde3017a-b42c-43de-8c91-62e5a47784a4 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:48.625277 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 839/1673] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:29:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:29:48.629068 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc8412-2af7-4b2e-b71c-dda0106e3d7d None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:48.629362 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc8412-2af7-4b2e-b71c-dda0106e3d7d None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:48.629672 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc8412-2af7-4b2e-b71c-dda0106e3d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:48.680152 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7525e890-eec5-4d37-848c-158ce828cf4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:48.681274 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525e890-eec5-4d37-848c-158ce828cf4c admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:48.681750 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525e890-eec5-4d37-848c-158ce828cf4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:48.682466 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525e890-eec5-4d37-848c-158ce828cf4c admin admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:48.683838 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7525e890-eec5-4d37-848c-158ce828cf4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:48.688359 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7525e890-eec5-4d37-848c-158ce828cf4c admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:48.709251 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-5adc8412-2af7-4b2e-b71c-dda0106e3d7d None None] MFA Rules not processed for user `dc97948a7016401689c57dae4d59eb71`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:29:48.713750 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-5adc8412-2af7-4b2e-b71c-dda0106e3d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:48.731045 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 835/1674] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:29:48 2022] POST /identity/v3/users => generated 297 bytes in 577 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:29:48.734459 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7525e890-eec5-4d37-848c-158ce828cf4c admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:48.738404 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-7525e890-eec5-4d37-848c-158ce828cf4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:48.885783 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7525e890-eec5-4d37-848c-158ce828cf4c admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:48.905656 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caed08a-f493-44a1-ab9d-c691e0592d9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:48.906330 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caed08a-f493-44a1-ab9d-c691e0592d9c service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:48.906617 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caed08a-f493-44a1-ab9d-c691e0592d9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:48.906898 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caed08a-f493-44a1-ab9d-c691e0592d9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:48.923914 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 840/1675] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:29:48 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:29:48.923914 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc8412-2af7-4b2e-b71c-dda0106e3d7d None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:48.926298 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-5adc8412-2af7-4b2e-b71c-dda0106e3d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:48.929765 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caed08a-f493-44a1-ab9d-c691e0592d9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:48.932910 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caed08a-f493-44a1-ab9d-c691e0592d9c service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:48.951985 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc8412-2af7-4b2e-b71c-dda0106e3d7d None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:48.957759 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 836/1676] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:29:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:29:48.961682 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fcf6d8-352f-4c4f-8f58-5a7aa6b3e673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:48.962270 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fcf6d8-352f-4c4f-8f58-5a7aa6b3e673 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:48.962557 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fcf6d8-352f-4c4f-8f58-5a7aa6b3e673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:48.962837 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fcf6d8-352f-4c4f-8f58-5a7aa6b3e673 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:48.963713 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fcf6d8-352f-4c4f-8f58-5a7aa6b3e673 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:48.965425 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fcf6d8-352f-4c4f-8f58-5a7aa6b3e673 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:48.992521 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 841/1677] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:29:48 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:29:48.995964 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caed08a-f493-44a1-ab9d-c691e0592d9c service neutron] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:49.011267 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caed08a-f493-44a1-ab9d-c691e0592d9c service neutron] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:49.017855 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadb0224-121e-4de3-bcaa-cd81704d6caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:49.018747 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb0224-121e-4de3-bcaa-cd81704d6caa admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:49.019190 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb0224-121e-4de3-bcaa-cd81704d6caa admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:49.019560 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb0224-121e-4de3-bcaa-cd81704d6caa admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:49.020391 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadb0224-121e-4de3-bcaa-cd81704d6caa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:49.023584 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadb0224-121e-4de3-bcaa-cd81704d6caa admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:49.053293 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 837/1678] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:29:48 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:29:49.058063 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fcf6d8-352f-4c4f-8f58-5a7aa6b3e673 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:49.095296 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fcf6d8-352f-4c4f-8f58-5a7aa6b3e673 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:49.104721 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9338c29e-0f38-446d-a714-aea749e2143d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:49.107561 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338c29e-0f38-446d-a714-aea749e2143d admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:49.108607 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338c29e-0f38-446d-a714-aea749e2143d admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:49.109312 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338c29e-0f38-446d-a714-aea749e2143d admin admin] PATH_INFO: `/v3/projects/b2577ee5db224e45a98206ad77d0a8b4/users/bdf14d75b80e46bd97aad102c365e857/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:49.159509 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9338c29e-0f38-446d-a714-aea749e2143d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2577ee5db224e45a98206ad77d0a8b4, user_id=bdf14d75b80e46bd97aad102c365e857, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:49.161830 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9338c29e-0f38-446d-a714-aea749e2143d admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:49.213774 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 842/1679] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:29:49 2022] PUT /identity/v3/projects/b2577ee5db224e45a98206ad77d0a8b4/users/bdf14d75b80e46bd97aad102c365e857/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:29:49.215418 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832a8b2-8e39-4b4a-b596-940374e50fbe None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:49.216019 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832a8b2-8e39-4b4a-b596-940374e50fbe None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:49.216547 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832a8b2-8e39-4b4a-b596-940374e50fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:49.256213 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-6832a8b2-8e39-4b4a-b596-940374e50fbe None None] MFA Rules not processed for user `bdf14d75b80e46bd97aad102c365e857`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:29:49.258248 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-6832a8b2-8e39-4b4a-b596-940374e50fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:49.337355 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:29:49.481646 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 838/1680] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:29:49 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:29:49.486606 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9338c29e-0f38-446d-a714-aea749e2143d admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:49.534817 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:29:49.602604 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9338c29e-0f38-446d-a714-aea749e2143d admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:49.608298 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f47ad2-3e70-4998-a7cf-68ac8deb2041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:49.608886 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f47ad2-3e70-4998-a7cf-68ac8deb2041 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:49.609638 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f47ad2-3e70-4998-a7cf-68ac8deb2041 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:49.609638 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f47ad2-3e70-4998-a7cf-68ac8deb2041 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:49.610108 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f47ad2-3e70-4998-a7cf-68ac8deb2041 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:49.612362 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f47ad2-3e70-4998-a7cf-68ac8deb2041 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:49.657773 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 843/1681] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:29:49 2022] POST /identity/v3/projects => generated 391 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:29:49.658745 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6832a8b2-8e39-4b4a-b596-940374e50fbe None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:49.676526 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6832a8b2-8e39-4b4a-b596-940374e50fbe None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:49.787571 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0190421-796b-4ed4-903a-509b32f4eebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:49.788459 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0190421-796b-4ed4-903a-509b32f4eebb admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:49.788929 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0190421-796b-4ed4-903a-509b32f4eebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:49.789213 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0190421-796b-4ed4-903a-509b32f4eebb admin admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:49.790151 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0190421-796b-4ed4-903a-509b32f4eebb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:49.793158 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0190421-796b-4ed4-903a-509b32f4eebb admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:49.868325 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 839/1682] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:29:49 2022] POST /identity/v3/users => generated 302 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 15:29:49.869086 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f47ad2-3e70-4998-a7cf-68ac8deb2041 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:49.886009 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f47ad2-3e70-4998-a7cf-68ac8deb2041 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:49.893055 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d501c4b0-ddfc-4470-8c9f-a36519e83422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:49.893713 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501c4b0-ddfc-4470-8c9f-a36519e83422 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:49.894025 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501c4b0-ddfc-4470-8c9f-a36519e83422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:49.894303 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501c4b0-ddfc-4470-8c9f-a36519e83422 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:49.895019 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d501c4b0-ddfc-4470-8c9f-a36519e83422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:49.896939 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d501c4b0-ddfc-4470-8c9f-a36519e83422 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:49.916616 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 844/1683] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:29:49 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:29:49.928263 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0190421-796b-4ed4-903a-509b32f4eebb admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:49.951725 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0190421-796b-4ed4-903a-509b32f4eebb admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:49.958797 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decdc4bb-d8d1-48d4-adfe-23fa3ed7e8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:49.959737 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decdc4bb-d8d1-48d4-adfe-23fa3ed7e8bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:49.960128 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decdc4bb-d8d1-48d4-adfe-23fa3ed7e8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:49.962602 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decdc4bb-d8d1-48d4-adfe-23fa3ed7e8bc admin admin] PATH_INFO: `/v3/projects/8b688aa4e5a64d1f8e6fc30f2350e443/users/87f98dc02d1c4d4c90a281743788adfe/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:50.003135 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decdc4bb-d8d1-48d4-adfe-23fa3ed7e8bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b688aa4e5a64d1f8e6fc30f2350e443, user_id=87f98dc02d1c4d4c90a281743788adfe, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:50.006592 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decdc4bb-d8d1-48d4-adfe-23fa3ed7e8bc admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:50.037738 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 840/1684] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:29:49 2022] PUT /identity/v3/projects/8b688aa4e5a64d1f8e6fc30f2350e443/users/87f98dc02d1c4d4c90a281743788adfe/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:29:50.043953 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d501c4b0-ddfc-4470-8c9f-a36519e83422 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:50.059270 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d501c4b0-ddfc-4470-8c9f-a36519e83422 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:50.240596 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e6c10d-b233-4b7f-a6ef-750228f6d29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:50.242715 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6c10d-b233-4b7f-a6ef-750228f6d29b admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:50.243262 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6c10d-b233-4b7f-a6ef-750228f6d29b admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:50.243763 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6c10d-b233-4b7f-a6ef-750228f6d29b admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:50.245380 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e6c10d-b233-4b7f-a6ef-750228f6d29b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:50.248917 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e6c10d-b233-4b7f-a6ef-750228f6d29b admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:50.298483 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 845/1685] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:29:50 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:29:50.305908 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decdc4bb-d8d1-48d4-adfe-23fa3ed7e8bc admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:50.328049 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decdc4bb-d8d1-48d4-adfe-23fa3ed7e8bc admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:50.344703 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851d7ba-d048-4a28-bf71-ae4fb6ad207f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:50.345558 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851d7ba-d048-4a28-bf71-ae4fb6ad207f admin admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:50.345855 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851d7ba-d048-4a28-bf71-ae4fb6ad207f admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:50.346138 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851d7ba-d048-4a28-bf71-ae4fb6ad207f admin admin] PATH_INFO: `/v3/projects/8b688aa4e5a64d1f8e6fc30f2350e443/users/87f98dc02d1c4d4c90a281743788adfe/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:50.349642 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3851d7ba-d048-4a28-bf71-ae4fb6ad207f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b688aa4e5a64d1f8e6fc30f2350e443, user_id=87f98dc02d1c4d4c90a281743788adfe, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:50.356020 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3851d7ba-d048-4a28-bf71-ae4fb6ad207f admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:50.382041 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 841/1686] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:29:50 2022] PUT /identity/v3/projects/8b688aa4e5a64d1f8e6fc30f2350e443/users/87f98dc02d1c4d4c90a281743788adfe/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:29:50.383253 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f865992-8dcb-4f08-befc-1cc4daff51a9 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:50.383918 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f865992-8dcb-4f08-befc-1cc4daff51a9 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:50.385185 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f865992-8dcb-4f08-befc-1cc4daff51a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:50.488033 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-9f865992-8dcb-4f08-befc-1cc4daff51a9 None None] MFA Rules not processed for user `87f98dc02d1c4d4c90a281743788adfe`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:29:50.496463 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-9f865992-8dcb-4f08-befc-1cc4daff51a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:50.675911 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 846/1687] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:29:50 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:29:50.688502 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851d7ba-d048-4a28-bf71-ae4fb6ad207f admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:50.691195 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-3851d7ba-d048-4a28-bf71-ae4fb6ad207f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:50.851907 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851d7ba-d048-4a28-bf71-ae4fb6ad207f admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:50.861161 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a8ee8f-b63a-42c1-80c7-4414a5481d4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:50.864369 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8ee8f-b63a-42c1-80c7-4414a5481d4e service cinder] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:50.865226 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8ee8f-b63a-42c1-80c7-4414a5481d4e service cinder] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:50.865657 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8ee8f-b63a-42c1-80c7-4414a5481d4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:50.896676 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a8ee8f-b63a-42c1-80c7-4414a5481d4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:50.898512 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a8ee8f-b63a-42c1-80c7-4414a5481d4e service cinder] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:50.920486 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 842/1688] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:29:50 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:29:51.032855 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f865992-8dcb-4f08-befc-1cc4daff51a9 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:51.047305 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f865992-8dcb-4f08-befc-1cc4daff51a9 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:51.054909 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67395b77-ea81-4a7d-89c8-d330c2184855 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:51.055925 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67395b77-ea81-4a7d-89c8-d330c2184855 service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:51.056545 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67395b77-ea81-4a7d-89c8-d330c2184855 service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:51.057023 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67395b77-ea81-4a7d-89c8-d330c2184855 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:51.079751 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:29:51.157077 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67395b77-ea81-4a7d-89c8-d330c2184855 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:51.157077 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67395b77-ea81-4a7d-89c8-d330c2184855 service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:51.185599 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 847/1689] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:29:51 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:29:51.244834 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d49b5-c67a-45d8-8a69-8a97f9b7c605 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:51.245454 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d49b5-c67a-45d8-8a69-8a97f9b7c605 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:51.245454 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d49b5-c67a-45d8-8a69-8a97f9b7c605 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:51.250412 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 843/1690] 10.222.0.42 () {54 vars in 921 bytes} [Tue Aug 2 15:29:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:29:51.289103 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e39059-4e0d-49cc-8fa0-a87a840c1842 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:51.289833 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e39059-4e0d-49cc-8fa0-a87a840c1842 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:51.290464 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e39059-4e0d-49cc-8fa0-a87a840c1842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:51.324496 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-00e39059-4e0d-49cc-8fa0-a87a840c1842 None None] MFA Rules not processed for user `57dfafee636a45ca98fe0e8bb13dd754`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:29:51.328348 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-00e39059-4e0d-49cc-8fa0-a87a840c1842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:51.348536 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52d49b5-c67a-45d8-8a69-8a97f9b7c605 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:51.354556 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-b52d49b5-c67a-45d8-8a69-8a97f9b7c605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:51.482846 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:29:51.549757 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 848/1691] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Aug 2 15:29:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:29:51.681751 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52d49b5-c67a-45d8-8a69-8a97f9b7c605 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:51.699649 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed8443-82f1-422f-9180-8c74575335e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:51.702672 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed8443-82f1-422f-9180-8c74575335e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:51.703341 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed8443-82f1-422f-9180-8c74575335e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:51.704725 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed8443-82f1-422f-9180-8c74575335e3 admin admin] PATH_INFO: `/v3/projects/4bf22db3bef1462bb00f0bb1cbca5279` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:51.708461 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbed8443-82f1-422f-9180-8c74575335e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bf22db3bef1462bb00f0bb1cbca5279)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:51.718913 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbed8443-82f1-422f-9180-8c74575335e3 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:51.732561 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af30dc-d6cf-48bb-a936-3f026f533e73 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:51.733104 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af30dc-d6cf-48bb-a936-3f026f533e73 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:51.734165 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af30dc-d6cf-48bb-a936-3f026f533e73 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:51.735779 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 849/1692] 10.222.0.42 () {54 vars in 961 bytes} [Tue Aug 2 15:29:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 15:29:51.749690 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750a870-89c3-4a64-afa0-74a7565eb923 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:51.750211 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750a870-89c3-4a64-afa0-74a7565eb923 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:51.750633 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750a870-89c3-4a64-afa0-74a7565eb923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:51.790816 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-b750a870-89c3-4a64-afa0-74a7565eb923 None None] MFA Rules not processed for user `57dfafee636a45ca98fe0e8bb13dd754`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:29:51.795677 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-b750a870-89c3-4a64-afa0-74a7565eb923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:51.827355 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 850/1693] 10.222.0.42 () {58 vars in 1058 bytes} [Tue Aug 2 15:29:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:29:51.842860 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750a870-89c3-4a64-afa0-74a7565eb923 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:51.856123 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750a870-89c3-4a64-afa0-74a7565eb923 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:51.870413 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-bbed8443-82f1-422f-9180-8c74575335e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bf22db3bef1462bb00f0bb1cbca5279', 'request_id': 'req-bbed8443-82f1-422f-9180-8c74575335e3'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:29:51.891671 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-bbed8443-82f1-422f-9180-8c74575335e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bf22db3bef1462bb00f0bb1cbca5279', 'request_id': 'req-bbed8443-82f1-422f-9180-8c74575335e3'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:29:51.933088 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-bbed8443-82f1-422f-9180-8c74575335e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bf22db3bef1462bb00f0bb1cbca5279', 'request_id': 'req-bbed8443-82f1-422f-9180-8c74575335e3'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:29:51.952372 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-bbed8443-82f1-422f-9180-8c74575335e3 admin admin] The token cache is being invalidate because project 4bf22db3bef1462bb00f0bb1cbca5279 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80360) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:29:51.952853 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-bbed8443-82f1-422f-9180-8c74575335e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:29:51.953701 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-bbed8443-82f1-422f-9180-8c74575335e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:29:51.959004 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 844/1694] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:29:51 2022] DELETE /identity/v3/projects/4bf22db3bef1462bb00f0bb1cbca5279 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 15:29:51.961284 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6809c-e134-4e38-8cd5-c3c75ddd32c8 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:51.961714 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6809c-e134-4e38-8cd5-c3c75ddd32c8 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:51.962144 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6809c-e134-4e38-8cd5-c3c75ddd32c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:51.991030 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-21c6809c-e134-4e38-8cd5-c3c75ddd32c8 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:29:51.993409 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-21c6809c-e134-4e38-8cd5-c3c75ddd32c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:52.092862 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c5d48-6cd7-442f-a258-2c4bd6772155 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57dfafee636a45ca98fe0e8bb13dd754', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:52.095202 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c5d48-6cd7-442f-a258-2c4bd6772155 service placement] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:52.095776 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c5d48-6cd7-442f-a258-2c4bd6772155 service placement] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:52.096210 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c5d48-6cd7-442f-a258-2c4bd6772155 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:52.100401 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-218c5d48-6cd7-442f-a258-2c4bd6772155 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:52.136117 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218c5d48-6cd7-442f-a258-2c4bd6772155 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:52.138183 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218c5d48-6cd7-442f-a258-2c4bd6772155 service placement] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:52.158428 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 845/1696] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:29:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:29:52.158634 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 851/1696] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:29:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 15:29:52.161095 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b642b-112c-4452-a77d-960962045691 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:52.161395 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b642b-112c-4452-a77d-960962045691 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:52.161864 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b642b-112c-4452-a77d-960962045691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:52.203768 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-ca0b642b-112c-4452-a77d-960962045691 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:29:52.205187 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-ca0b642b-112c-4452-a77d-960962045691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:52.224256 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 846/1697] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:29:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:29:52.228327 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c5d48-6cd7-442f-a258-2c4bd6772155 service placement] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:52.253969 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c5d48-6cd7-442f-a258-2c4bd6772155 service placement] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:52.266767 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14f7b5-ea8a-46ab-908d-5bf4eb6129e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:52.267437 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14f7b5-ea8a-46ab-908d-5bf4eb6129e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:52.267724 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14f7b5-ea8a-46ab-908d-5bf4eb6129e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:52.268006 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14f7b5-ea8a-46ab-908d-5bf4eb6129e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:52.268718 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea14f7b5-ea8a-46ab-908d-5bf4eb6129e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:29:52.269028 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea14f7b5-ea8a-46ab-908d-5bf4eb6129e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:52.270859 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea14f7b5-ea8a-46ab-908d-5bf4eb6129e2 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:52.293817 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 852/1698] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 2 15:29:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:29:52.298915 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b642b-112c-4452-a77d-960962045691 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:52.318083 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b642b-112c-4452-a77d-960962045691 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:52.323974 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7708ad3-497f-43fb-b1a3-5bb88f0912a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:52.324696 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7708ad3-497f-43fb-b1a3-5bb88f0912a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:52.324891 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7708ad3-497f-43fb-b1a3-5bb88f0912a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:52.325172 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7708ad3-497f-43fb-b1a3-5bb88f0912a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:52.328965 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7708ad3-497f-43fb-b1a3-5bb88f0912a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:52.328965 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7708ad3-497f-43fb-b1a3-5bb88f0912a0 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:52.393884 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 847/1699] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:29:52 2022] POST /identity/v3/projects => generated 369 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:29:52.395029 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14f7b5-ea8a-46ab-908d-5bf4eb6129e2 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:52.408451 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14f7b5-ea8a-46ab-908d-5bf4eb6129e2 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:52.453189 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:29:52.631616 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92298b6-85f0-4152-a790-df9dc3d3ceab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:52.638099 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92298b6-85f0-4152-a790-df9dc3d3ceab admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:52.638099 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92298b6-85f0-4152-a790-df9dc3d3ceab admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:52.642810 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92298b6-85f0-4152-a790-df9dc3d3ceab admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:52.643638 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92298b6-85f0-4152-a790-df9dc3d3ceab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:52.650574 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92298b6-85f0-4152-a790-df9dc3d3ceab admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:52.712790 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 853/1700] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:29:52 2022] POST /identity/v3/users => generated 285 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:29:52.715464 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7708ad3-497f-43fb-b1a3-5bb88f0912a0 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:52.732523 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7708ad3-497f-43fb-b1a3-5bb88f0912a0 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:52.759858 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb22effe-b0c7-48fa-9dde-3e2ebdef5255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:52.780119 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22effe-b0c7-48fa-9dde-3e2ebdef5255 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:52.780584 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22effe-b0c7-48fa-9dde-3e2ebdef5255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:52.780968 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22effe-b0c7-48fa-9dde-3e2ebdef5255 admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:52.783030 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb22effe-b0c7-48fa-9dde-3e2ebdef5255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:52.790673 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb22effe-b0c7-48fa-9dde-3e2ebdef5255 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:52.826880 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 848/1701] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:29:52.827503 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92298b6-85f0-4152-a790-df9dc3d3ceab admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:52.840266 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92298b6-85f0-4152-a790-df9dc3d3ceab admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:52.863476 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a437dde6-5469-476d-9a79-c718535626fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:52.864570 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437dde6-5469-476d-9a79-c718535626fe admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:52.865067 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437dde6-5469-476d-9a79-c718535626fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:52.865566 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437dde6-5469-476d-9a79-c718535626fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:52.873750 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a437dde6-5469-476d-9a79-c718535626fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:52.891122 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a437dde6-5469-476d-9a79-c718535626fe admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:52.970871 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 854/1702] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 15:29:52.972213 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb22effe-b0c7-48fa-9dde-3e2ebdef5255 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:52.992776 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb22effe-b0c7-48fa-9dde-3e2ebdef5255 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:53.010806 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f03c48-c324-4987-98b0-74ad42ee7721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:53.011826 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f03c48-c324-4987-98b0-74ad42ee7721 admin admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:53.012114 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f03c48-c324-4987-98b0-74ad42ee7721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:53.012413 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f03c48-c324-4987-98b0-74ad42ee7721 admin admin] PATH_INFO: `/v3/projects/ab4f64b0357d48dca6777ca5a735642e/users/bfb38dcd163a4ffcb5d81b09632f95b7/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:53.048052 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f03c48-c324-4987-98b0-74ad42ee7721 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab4f64b0357d48dca6777ca5a735642e, user_id=bfb38dcd163a4ffcb5d81b09632f95b7, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:53.051368 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f03c48-c324-4987-98b0-74ad42ee7721 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:53.058114 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:29:53.098416 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 849/1703] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:29:52 2022] PUT /identity/v3/projects/ab4f64b0357d48dca6777ca5a735642e/users/bfb38dcd163a4ffcb5d81b09632f95b7/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:29:53.102210 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b10ec-7af2-4500-a58f-6523b0f6e5eb None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:53.102786 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b10ec-7af2-4500-a58f-6523b0f6e5eb None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:53.103786 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b10ec-7af2-4500-a58f-6523b0f6e5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:53.206806 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-937b10ec-7af2-4500-a58f-6523b0f6e5eb None None] MFA Rules not processed for user `bfb38dcd163a4ffcb5d81b09632f95b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:29:53.208444 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-937b10ec-7af2-4500-a58f-6523b0f6e5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:53.227900 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67274bd0-91bf-4b4a-a35f-48b1dd3128e5 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:53.228263 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67274bd0-91bf-4b4a-a35f-48b1dd3128e5 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:53.228576 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67274bd0-91bf-4b4a-a35f-48b1dd3128e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:53.259965 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-67274bd0-91bf-4b4a-a35f-48b1dd3128e5 None None] MFA Rules not processed for user `0f08ca03f3f44afcbbbe94fe0ac5baf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:29:53.262395 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-67274bd0-91bf-4b4a-a35f-48b1dd3128e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:53.369108 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 850/1704] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:29:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:29:53.369744 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 855/1705] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:29:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:29:53.369853 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67274bd0-91bf-4b4a-a35f-48b1dd3128e5 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:53.511852 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67274bd0-91bf-4b4a-a35f-48b1dd3128e5 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:53.518288 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d038d-2b1e-4138-b9bf-a68b657dd0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:53.519157 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d038d-2b1e-4138-b9bf-a68b657dd0e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:53.519685 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d038d-2b1e-4138-b9bf-a68b657dd0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:53.520470 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d038d-2b1e-4138-b9bf-a68b657dd0e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:53.521315 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d038d-2b1e-4138-b9bf-a68b657dd0e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:53.523607 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d038d-2b1e-4138-b9bf-a68b657dd0e8 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:53.588997 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 851/1706] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:29:53 2022] POST /identity/v3/projects => generated 367 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:29:53.589556 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b10ec-7af2-4500-a58f-6523b0f6e5eb None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:53.608236 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b10ec-7af2-4500-a58f-6523b0f6e5eb None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:53.705548 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2735ce79-8d50-4b9e-a314-6b5aaa7ed36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:53.706333 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735ce79-8d50-4b9e-a314-6b5aaa7ed36f admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:53.706730 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735ce79-8d50-4b9e-a314-6b5aaa7ed36f admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:53.707299 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735ce79-8d50-4b9e-a314-6b5aaa7ed36f admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:53.708122 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2735ce79-8d50-4b9e-a314-6b5aaa7ed36f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:53.710217 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2735ce79-8d50-4b9e-a314-6b5aaa7ed36f admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:53.762561 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 856/1707] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:29:53 2022] POST /identity/v3/users => generated 290 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 15:29:53.768834 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d038d-2b1e-4138-b9bf-a68b657dd0e8 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:53.808152 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d038d-2b1e-4138-b9bf-a68b657dd0e8 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:53.815768 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc42a5f5-2c7f-4f42-b32b-e95c95e6c2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:53.816817 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42a5f5-2c7f-4f42-b32b-e95c95e6c2de admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:53.817276 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42a5f5-2c7f-4f42-b32b-e95c95e6c2de admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:53.817775 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42a5f5-2c7f-4f42-b32b-e95c95e6c2de admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:53.819406 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc42a5f5-2c7f-4f42-b32b-e95c95e6c2de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:53.821849 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc42a5f5-2c7f-4f42-b32b-e95c95e6c2de admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:53.845923 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 852/1708] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:29:53.847235 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2735ce79-8d50-4b9e-a314-6b5aaa7ed36f admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:53.867950 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2735ce79-8d50-4b9e-a314-6b5aaa7ed36f admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:53.875757 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e038daab-09da-4f42-b550-f9601de8ca28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:53.876476 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038daab-09da-4f42-b550-f9601de8ca28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:53.876760 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038daab-09da-4f42-b550-f9601de8ca28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:53.877034 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038daab-09da-4f42-b550-f9601de8ca28 admin admin] PATH_INFO: `/v3/projects/09d3ada2bad447b9bcaacd03cd2a30dd/users/a6c4460f1d9344f3a95bfd1b20ff0efc/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:53.918318 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e038daab-09da-4f42-b550-f9601de8ca28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09d3ada2bad447b9bcaacd03cd2a30dd, user_id=a6c4460f1d9344f3a95bfd1b20ff0efc, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:53.924623 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e038daab-09da-4f42-b550-f9601de8ca28 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:53.928627 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:29:53.963981 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc42a5f5-2c7f-4f42-b32b-e95c95e6c2de admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:53.964978 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 857/1709] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:29:53 2022] PUT /identity/v3/projects/09d3ada2bad447b9bcaacd03cd2a30dd/users/a6c4460f1d9344f3a95bfd1b20ff0efc/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:29:53.983245 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc42a5f5-2c7f-4f42-b32b-e95c95e6c2de admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:54.103359 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b2abf9-4e9f-4ed3-9647-1dd258e8a19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:54.105961 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2abf9-4e9f-4ed3-9647-1dd258e8a19b admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:54.106446 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2abf9-4e9f-4ed3-9647-1dd258e8a19b admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:54.107546 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2abf9-4e9f-4ed3-9647-1dd258e8a19b admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:54.112407 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b2abf9-4e9f-4ed3-9647-1dd258e8a19b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:54.114222 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b2abf9-4e9f-4ed3-9647-1dd258e8a19b admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:54.151425 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e038daab-09da-4f42-b550-f9601de8ca28 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:54.161777 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 853/1710] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:29:54.177690 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e038daab-09da-4f42-b550-f9601de8ca28 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:54.185814 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb320f-0d48-47b2-9242-3b66efc4ed9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:54.187717 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb320f-0d48-47b2-9242-3b66efc4ed9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:54.188122 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb320f-0d48-47b2-9242-3b66efc4ed9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:54.189412 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb320f-0d48-47b2-9242-3b66efc4ed9b admin admin] PATH_INFO: `/v3/projects/09d3ada2bad447b9bcaacd03cd2a30dd/users/a6c4460f1d9344f3a95bfd1b20ff0efc/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:54.194938 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cb320f-0d48-47b2-9242-3b66efc4ed9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=09d3ada2bad447b9bcaacd03cd2a30dd, user_id=a6c4460f1d9344f3a95bfd1b20ff0efc, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:54.199421 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cb320f-0d48-47b2-9242-3b66efc4ed9b admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:54.224948 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e472dfa-0a3b-4a98-bad8-d23101cf06ab None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:54.225459 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e472dfa-0a3b-4a98-bad8-d23101cf06ab None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:54.225848 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e472dfa-0a3b-4a98-bad8-d23101cf06ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:54.229253 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 858/1711] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:29:54 2022] PUT /identity/v3/projects/09d3ada2bad447b9bcaacd03cd2a30dd/users/a6c4460f1d9344f3a95bfd1b20ff0efc/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:29:54.258573 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:29:54.274717 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-9e472dfa-0a3b-4a98-bad8-d23101cf06ab None None] MFA Rules not processed for user `a6c4460f1d9344f3a95bfd1b20ff0efc`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:29:54.277016 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-9e472dfa-0a3b-4a98-bad8-d23101cf06ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:54.485880 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 854/1712] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:29:54 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:29:54.496502 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb320f-0d48-47b2-9242-3b66efc4ed9b admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:54.499078 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-d4cb320f-0d48-47b2-9242-3b66efc4ed9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:54.606254 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c7500-bf95-4ed7-967b-a82da14e753c None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:54.607114 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c7500-bf95-4ed7-967b-a82da14e753c None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:54.607541 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c7500-bf95-4ed7-967b-a82da14e753c None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:54.610927 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 855/1713] 10.222.0.42 () {54 vars in 921 bytes} [Tue Aug 2 15:29:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 15:29:54.660234 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e1427-8657-4f8c-b516-8cb0cb08a675 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:54.660624 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e1427-8657-4f8c-b516-8cb0cb08a675 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:54.661105 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e1427-8657-4f8c-b516-8cb0cb08a675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:54.681832 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb320f-0d48-47b2-9242-3b66efc4ed9b admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:54.708465 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eee0012-05d2-4468-9f40-222c8cab5718 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:54.709303 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee0012-05d2-4468-9f40-222c8cab5718 service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:54.711579 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee0012-05d2-4468-9f40-222c8cab5718 service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:54.712013 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee0012-05d2-4468-9f40-222c8cab5718 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:54.738779 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-7f7e1427-8657-4f8c-b516-8cb0cb08a675 None None] MFA Rules not processed for user `57dfafee636a45ca98fe0e8bb13dd754`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:29:54.741370 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-7f7e1427-8657-4f8c-b516-8cb0cb08a675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:54.757895 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eee0012-05d2-4468-9f40-222c8cab5718 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:54.764590 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eee0012-05d2-4468-9f40-222c8cab5718 service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:54.803964 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 859/1714] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:29:54 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:29:54.841561 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eee0012-05d2-4468-9f40-222c8cab5718 service cinder] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:54.843376 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-5eee0012-05d2-4468-9f40-222c8cab5718 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:54.958699 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 856/1715] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Aug 2 15:29:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:29:54.961949 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e1427-8657-4f8c-b516-8cb0cb08a675 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:54.996837 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e1427-8657-4f8c-b516-8cb0cb08a675 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:55.010323 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef61231c-0d7f-43bd-af78-d4ad02709743 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:55.012035 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef61231c-0d7f-43bd-af78-d4ad02709743 service cinder] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:55.012356 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef61231c-0d7f-43bd-af78-d4ad02709743 service cinder] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:55.014226 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef61231c-0d7f-43bd-af78-d4ad02709743 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:55.040498 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eee0012-05d2-4468-9f40-222c8cab5718 service cinder] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:55.062121 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f9bb5e-63fd-4420-8fba-ef769504d564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:55.065205 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9bb5e-63fd-4420-8fba-ef769504d564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:55.065697 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9bb5e-63fd-4420-8fba-ef769504d564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:55.068226 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9bb5e-63fd-4420-8fba-ef769504d564 admin admin] PATH_INFO: `/v3/users/0076b5aed46e49649960c8491a74637d` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:55.069933 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f9bb5e-63fd-4420-8fba-ef769504d564 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0076b5aed46e49649960c8491a74637d)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:55.075507 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f9bb5e-63fd-4420-8fba-ef769504d564 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:55.163822 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef61231c-0d7f-43bd-af78-d4ad02709743 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:55.165286 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef61231c-0d7f-43bd-af78-d4ad02709743 service cinder] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:55.173427 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-f7f9bb5e-63fd-4420-8fba-ef769504d564 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0076b5aed46e49649960c8491a74637d'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:29:55.189920 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 857/1716] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:29:54 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:29:55.194083 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66836b-47ba-41d6-80ab-07a22909da5c None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:55.194384 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66836b-47ba-41d6-80ab-07a22909da5c None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:55.194670 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66836b-47ba-41d6-80ab-07a22909da5c None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:55.196141 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 858/1717] 10.222.0.42 () {54 vars in 912 bytes} [Tue Aug 2 15:29:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:29:55.196858 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b66836b-47ba-41d6-80ab-07a22909da5c None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:55.199688 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-f7f9bb5e-63fd-4420-8fba-ef769504d564 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0076b5aed46e49649960c8491a74637d'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:29:55.200790 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-f7f9bb5e-63fd-4420-8fba-ef769504d564 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0076b5aed46e49649960c8491a74637d'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:29:55.203436 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-6b66836b-47ba-41d6-80ab-07a22909da5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:55.216921 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-f7f9bb5e-63fd-4420-8fba-ef769504d564 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0076b5aed46e49649960c8491a74637d'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:29:55.234965 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-f7f9bb5e-63fd-4420-8fba-ef769504d564 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0076b5aed46e49649960c8491a74637d'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:29:55.251314 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 860/1718] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:29:54 2022] DELETE /identity/v3/users/0076b5aed46e49649960c8491a74637d => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:29:55.251492 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b66836b-47ba-41d6-80ab-07a22909da5c None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:55.251572 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32582ad-4623-44a8-866b-fc39cb537c14 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:55.251572 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32582ad-4623-44a8-866b-fc39cb537c14 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:55.251695 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32582ad-4623-44a8-866b-fc39cb537c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:55.286713 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:29:55.346460 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:29:55.406663 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-a32582ad-4623-44a8-866b-fc39cb537c14 None None] MFA Rules not processed for user `f6d1caa34f2b41bfbcc95fa58d85f004`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:29:55.410075 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-a32582ad-4623-44a8-866b-fc39cb537c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:55.439077 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca54815b-c3ae-4276-84f6-1ecc866f6b2f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57dfafee636a45ca98fe0e8bb13dd754', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:55.439762 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54815b-c3ae-4276-84f6-1ecc866f6b2f service placement] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:55.440042 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54815b-c3ae-4276-84f6-1ecc866f6b2f service placement] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:55.440312 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54815b-c3ae-4276-84f6-1ecc866f6b2f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:55.448710 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-ca54815b-c3ae-4276-84f6-1ecc866f6b2f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:55.474589 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca54815b-c3ae-4276-84f6-1ecc866f6b2f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:55.479337 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca54815b-c3ae-4276-84f6-1ecc866f6b2f service placement] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:55.509199 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 859/1719] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:29:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:29:55.605293 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 861/1720] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Aug 2 15:29:55 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:29:55.651930 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca54815b-c3ae-4276-84f6-1ecc866f6b2f service placement] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:55.654227 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-ca54815b-c3ae-4276-84f6-1ecc866f6b2f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:55.675841 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca54815b-c3ae-4276-84f6-1ecc866f6b2f service placement] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:55.686819 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a1225-49be-47e3-8869-b1dc2bbaa045 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:55.690632 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a1225-49be-47e3-8869-b1dc2bbaa045 service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:55.691169 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a1225-49be-47e3-8869-b1dc2bbaa045 service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:55.692036 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a1225-49be-47e3-8869-b1dc2bbaa045 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:55.715594 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176a1225-49be-47e3-8869-b1dc2bbaa045 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:55.718812 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176a1225-49be-47e3-8869-b1dc2bbaa045 service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:55.744583 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 860/1721] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:29:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:29:55.906847 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32582ad-4623-44a8-866b-fc39cb537c14 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:55.908260 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-a32582ad-4623-44a8-866b-fc39cb537c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:56.100897 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32582ad-4623-44a8-866b-fc39cb537c14 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:56.127682 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746ce05e-6350-4a79-91c9-885cef55f34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:56.130275 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ce05e-6350-4a79-91c9-885cef55f34a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:56.130701 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ce05e-6350-4a79-91c9-885cef55f34a admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:56.131300 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ce05e-6350-4a79-91c9-885cef55f34a admin admin] PATH_INFO: `/v3/projects/b9405562e74a4d09bda00edd12df77b5` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:56.135315 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746ce05e-6350-4a79-91c9-885cef55f34a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9405562e74a4d09bda00edd12df77b5)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:56.137469 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746ce05e-6350-4a79-91c9-885cef55f34a admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:56.312739 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-746ce05e-6350-4a79-91c9-885cef55f34a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9405562e74a4d09bda00edd12df77b5', 'request_id': 'req-746ce05e-6350-4a79-91c9-885cef55f34a'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:29:56.332918 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-746ce05e-6350-4a79-91c9-885cef55f34a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9405562e74a4d09bda00edd12df77b5', 'request_id': 'req-746ce05e-6350-4a79-91c9-885cef55f34a'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:29:56.351943 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-746ce05e-6350-4a79-91c9-885cef55f34a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9405562e74a4d09bda00edd12df77b5', 'request_id': 'req-746ce05e-6350-4a79-91c9-885cef55f34a'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:29:56.387245 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-746ce05e-6350-4a79-91c9-885cef55f34a admin admin] The token cache is being invalidate because project b9405562e74a4d09bda00edd12df77b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:29:56.387551 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-746ce05e-6350-4a79-91c9-885cef55f34a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:29:56.391597 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-746ce05e-6350-4a79-91c9-885cef55f34a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:29:56.394307 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 862/1722] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:29:55 2022] DELETE /identity/v3/projects/b9405562e74a4d09bda00edd12df77b5 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:29:56.398313 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a1225-49be-47e3-8869-b1dc2bbaa045 service neutron] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:56.416021 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a1225-49be-47e3-8869-b1dc2bbaa045 service neutron] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:56.593308 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0c6881-8ba3-4189-b6a3-877307253272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:56.594071 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c6881-8ba3-4189-b6a3-877307253272 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:56.594360 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c6881-8ba3-4189-b6a3-877307253272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:56.594636 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c6881-8ba3-4189-b6a3-877307253272 admin admin] PATH_INFO: `/v3/users/dc97948a7016401689c57dae4d59eb71` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:56.596405 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0c6881-8ba3-4189-b6a3-877307253272 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc97948a7016401689c57dae4d59eb71)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:56.598685 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0c6881-8ba3-4189-b6a3-877307253272 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:56.714622 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-6e0c6881-8ba3-4189-b6a3-877307253272 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc97948a7016401689c57dae4d59eb71'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:29:56.752434 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-6e0c6881-8ba3-4189-b6a3-877307253272 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc97948a7016401689c57dae4d59eb71'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:29:56.798121 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-6e0c6881-8ba3-4189-b6a3-877307253272 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc97948a7016401689c57dae4d59eb71'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:29:56.799645 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-6e0c6881-8ba3-4189-b6a3-877307253272 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc97948a7016401689c57dae4d59eb71'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:29:56.808902 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-6e0c6881-8ba3-4189-b6a3-877307253272 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc97948a7016401689c57dae4d59eb71'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:29:56.857596 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 861/1723] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:29:56 2022] DELETE /identity/v3/users/dc97948a7016401689c57dae4d59eb71 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:29:57.143451 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746ce05e-6350-4a79-91c9-885cef55f34a admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:57.148780 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-746ce05e-6350-4a79-91c9-885cef55f34a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:57.259793 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:29:57.385634 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746ce05e-6350-4a79-91c9-885cef55f34a admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:57.523283 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05088ea2-bb8e-4e63-bf4c-8c97333da4c4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57dfafee636a45ca98fe0e8bb13dd754', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:57.523952 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05088ea2-bb8e-4e63-bf4c-8c97333da4c4 service placement] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:57.524298 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05088ea2-bb8e-4e63-bf4c-8c97333da4c4 service placement] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:57.524808 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05088ea2-bb8e-4e63-bf4c-8c97333da4c4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:57.530673 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-05088ea2-bb8e-4e63-bf4c-8c97333da4c4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:57.531971 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0c6881-8ba3-4189-b6a3-877307253272 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:57.533749 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-6e0c6881-8ba3-4189-b6a3-877307253272 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:57.561071 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05088ea2-bb8e-4e63-bf4c-8c97333da4c4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:57.570604 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05088ea2-bb8e-4e63-bf4c-8c97333da4c4 service placement] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:57.591399 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 863/1724] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:29:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:29:57.636410 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:29:57.762866 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0c6881-8ba3-4189-b6a3-877307253272 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:57.823586 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae8639-1081-413e-a2bc-e49d73df58c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:57.833057 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae8639-1081-413e-a2bc-e49d73df58c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:57.835029 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae8639-1081-413e-a2bc-e49d73df58c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:57.837484 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae8639-1081-413e-a2bc-e49d73df58c8 admin admin] PATH_INFO: `/v3/projects/f1791a1136724dea9dc2741ef180870d` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:57.847665 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efae8639-1081-413e-a2bc-e49d73df58c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1791a1136724dea9dc2741ef180870d)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:57.863859 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efae8639-1081-413e-a2bc-e49d73df58c8 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:58.171625 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-efae8639-1081-413e-a2bc-e49d73df58c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1791a1136724dea9dc2741ef180870d', 'request_id': 'req-efae8639-1081-413e-a2bc-e49d73df58c8'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:29:58.200003 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-efae8639-1081-413e-a2bc-e49d73df58c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1791a1136724dea9dc2741ef180870d', 'request_id': 'req-efae8639-1081-413e-a2bc-e49d73df58c8'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:29:58.233642 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-efae8639-1081-413e-a2bc-e49d73df58c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1791a1136724dea9dc2741ef180870d', 'request_id': 'req-efae8639-1081-413e-a2bc-e49d73df58c8'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:29:58.283431 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-efae8639-1081-413e-a2bc-e49d73df58c8 admin admin] The token cache is being invalidate because project f1791a1136724dea9dc2741ef180870d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80360) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:29:58.285701 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-efae8639-1081-413e-a2bc-e49d73df58c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:29:58.289991 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-efae8639-1081-413e-a2bc-e49d73df58c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:29:58.296548 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 862/1725] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:29:57 2022] DELETE /identity/v3/projects/f1791a1136724dea9dc2741ef180870d => generated 0 bytes in 765 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:29:58.302904 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d6f9d3-1464-4913-81ed-82443f742d39 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:58.308723 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d6f9d3-1464-4913-81ed-82443f742d39 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:58.313483 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d6f9d3-1464-4913-81ed-82443f742d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:58.416362 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-50d6f9d3-1464-4913-81ed-82443f742d39 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:29:58.417759 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-50d6f9d3-1464-4913-81ed-82443f742d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:58.443687 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae8639-1081-413e-a2bc-e49d73df58c8 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:58.445213 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-efae8639-1081-413e-a2bc-e49d73df58c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:58.605097 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae8639-1081-413e-a2bc-e49d73df58c8 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:58.615675 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d677d31-89ad-4ab7-b8ee-936f3672c084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:58.619038 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d677d31-89ad-4ab7-b8ee-936f3672c084 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:58.619436 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d677d31-89ad-4ab7-b8ee-936f3672c084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:58.619925 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d677d31-89ad-4ab7-b8ee-936f3672c084 admin admin] PATH_INFO: `/v3/users/5c978c3804784f2483d11406dfe5d726` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:58.628907 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d677d31-89ad-4ab7-b8ee-936f3672c084 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c978c3804784f2483d11406dfe5d726)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:58.637632 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 864/1726] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:29:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:29:58.649823 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48259aff-d9c9-4b3c-8199-392fb6f6edda None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:58.650107 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48259aff-d9c9-4b3c-8199-392fb6f6edda None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:58.650587 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48259aff-d9c9-4b3c-8199-392fb6f6edda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:58.654792 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d677d31-89ad-4ab7-b8ee-936f3672c084 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:58.694162 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-48259aff-d9c9-4b3c-8199-392fb6f6edda None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:29:58.696056 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-48259aff-d9c9-4b3c-8199-392fb6f6edda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:58.715536 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 865/1727] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:29:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:29:58.721106 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48259aff-d9c9-4b3c-8199-392fb6f6edda None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:58.741468 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48259aff-d9c9-4b3c-8199-392fb6f6edda None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:58.754065 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7e3d5d-ab69-44cb-8b35-7f20d0807f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:58.766792 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e3d5d-ab69-44cb-8b35-7f20d0807f6a admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:58.767263 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e3d5d-ab69-44cb-8b35-7f20d0807f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:58.770890 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e3d5d-ab69-44cb-8b35-7f20d0807f6a admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:58.772097 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7e3d5d-ab69-44cb-8b35-7f20d0807f6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:29:58.774588 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7e3d5d-ab69-44cb-8b35-7f20d0807f6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:58.787204 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7e3d5d-ab69-44cb-8b35-7f20d0807f6a admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:58.807518 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-0d677d31-89ad-4ab7-b8ee-936f3672c084 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c978c3804784f2483d11406dfe5d726'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:29:58.828817 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 866/1728] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 2 15:29:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:29:58.829895 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7e3d5d-ab69-44cb-8b35-7f20d0807f6a admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:58.836892 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-0d677d31-89ad-4ab7-b8ee-936f3672c084 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c978c3804784f2483d11406dfe5d726'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:29:58.839830 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:29:58.847644 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7e3d5d-ab69-44cb-8b35-7f20d0807f6a admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:58.862339 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f81eff-b534-4533-bc41-173969fd3765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:58.863011 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f81eff-b534-4533-bc41-173969fd3765 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:58.863400 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f81eff-b534-4533-bc41-173969fd3765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:58.863669 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f81eff-b534-4533-bc41-173969fd3765 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:58.864353 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f81eff-b534-4533-bc41-173969fd3765 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:58.866660 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f81eff-b534-4533-bc41-173969fd3765 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:58.873598 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-0d677d31-89ad-4ab7-b8ee-936f3672c084 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c978c3804784f2483d11406dfe5d726'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:29:58.874804 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-0d677d31-89ad-4ab7-b8ee-936f3672c084 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c978c3804784f2483d11406dfe5d726'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:29:58.875933 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-0d677d31-89ad-4ab7-b8ee-936f3672c084 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c978c3804784f2483d11406dfe5d726'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:29:58.918337 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 863/1729] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:29:58 2022] DELETE /identity/v3/users/5c978c3804784f2483d11406dfe5d726 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 15:29:58.924676 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d1550-ebc0-4220-8c3b-de219e271f60 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:58.925198 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d1550-ebc0-4220-8c3b-de219e271f60 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:58.926104 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d1550-ebc0-4220-8c3b-de219e271f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:58.977652 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-198d1550-ebc0-4220-8c3b-de219e271f60 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:29:58.981929 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-198d1550-ebc0-4220-8c3b-de219e271f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:58.982628 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 867/1730] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:29:58 2022] POST /identity/v3/projects => generated 371 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:29:58.987854 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f81eff-b534-4533-bc41-173969fd3765 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:58.993958 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-35f81eff-b534-4533-bc41-173969fd3765 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:59.118884 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:29:59.189182 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 864/1731] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:29:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:29:59.207988 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d1550-ebc0-4220-8c3b-de219e271f60 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:59.211944 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-198d1550-ebc0-4220-8c3b-de219e271f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:59.249361 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f81eff-b534-4533-bc41-173969fd3765 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:59.260983 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b216fb4-8413-4147-b514-cce20417b875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:59.261930 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b216fb4-8413-4147-b514-cce20417b875 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:59.262397 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b216fb4-8413-4147-b514-cce20417b875 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:59.263755 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b216fb4-8413-4147-b514-cce20417b875 admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:59.264669 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b216fb4-8413-4147-b514-cce20417b875 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:59.268224 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b216fb4-8413-4147-b514-cce20417b875 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:59.326123 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 868/1732] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:29:58 2022] POST /identity/v3/users => generated 286 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:29:59.327340 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b216fb4-8413-4147-b514-cce20417b875 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:59.343358 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b216fb4-8413-4147-b514-cce20417b875 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:59.348886 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d1550-ebc0-4220-8c3b-de219e271f60 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:59.351487 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a10ce-c4ff-48da-b79b-0c5377877e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:59.352372 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a10ce-c4ff-48da-b79b-0c5377877e78 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:59.352860 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a10ce-c4ff-48da-b79b-0c5377877e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:59.353419 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a10ce-c4ff-48da-b79b-0c5377877e78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:59.354372 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2504fd5-7e6d-47a0-b64b-e53d05722f4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:59.355021 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544a10ce-c4ff-48da-b79b-0c5377877e78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:59.355127 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2504fd5-7e6d-47a0-b64b-e53d05722f4d service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:59.355523 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2504fd5-7e6d-47a0-b64b-e53d05722f4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:59.361257 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544a10ce-c4ff-48da-b79b-0c5377877e78 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:59.366395 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2504fd5-7e6d-47a0-b64b-e53d05722f4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:59.380305 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2504fd5-7e6d-47a0-b64b-e53d05722f4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:59.381805 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2504fd5-7e6d-47a0-b64b-e53d05722f4d service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:59.386998 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 869/1733] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:29:59.389127 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a10ce-c4ff-48da-b79b-0c5377877e78 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:59.418598 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a10ce-c4ff-48da-b79b-0c5377877e78 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:59.446713 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341ce1ad-c006-4784-9d07-b41cf246b48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:59.447647 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ce1ad-c006-4784-9d07-b41cf246b48d admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:59.448111 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ce1ad-c006-4784-9d07-b41cf246b48d admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:59.448521 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ce1ad-c006-4784-9d07-b41cf246b48d admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:59.449363 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341ce1ad-c006-4784-9d07-b41cf246b48d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:59.452344 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 865/1734] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:29:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:29:59.452624 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341ce1ad-c006-4784-9d07-b41cf246b48d admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:59.499532 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 870/1735] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:29:59.501502 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2504fd5-7e6d-47a0-b64b-e53d05722f4d service neutron] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:59.531848 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2504fd5-7e6d-47a0-b64b-e53d05722f4d service neutron] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:29:59.561421 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88375fb-79c9-43b9-b2ff-ad7e8d7cd256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:29:59.567038 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88375fb-79c9-43b9-b2ff-ad7e8d7cd256 admin admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:59.567412 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88375fb-79c9-43b9-b2ff-ad7e8d7cd256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:59.570315 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88375fb-79c9-43b9-b2ff-ad7e8d7cd256 admin admin] PATH_INFO: `/v3/projects/e8b0328240694de5a2328a828ff69550/users/516f6f181b444d529377aa5cd7aa429d/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:59.621145 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88375fb-79c9-43b9-b2ff-ad7e8d7cd256 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8b0328240694de5a2328a828ff69550, user_id=516f6f181b444d529377aa5cd7aa429d, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:29:59.649775 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88375fb-79c9-43b9-b2ff-ad7e8d7cd256 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:29:59.695638 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 866/1736] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:29:59 2022] PUT /identity/v3/projects/e8b0328240694de5a2328a828ff69550/users/516f6f181b444d529377aa5cd7aa429d/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:29:59.712761 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d083c-c9a3-49bb-8c0c-bbe354dcc2e3 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:29:59.713673 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d083c-c9a3-49bb-8c0c-bbe354dcc2e3 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:29:59.714855 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d083c-c9a3-49bb-8c0c-bbe354dcc2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:29:59.810302 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-d54d083c-c9a3-49bb-8c0c-bbe354dcc2e3 None None] MFA Rules not processed for user `516f6f181b444d529377aa5cd7aa429d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:29:59.812178 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-d54d083c-c9a3-49bb-8c0c-bbe354dcc2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:29:59.969062 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88375fb-79c9-43b9-b2ff-ad7e8d7cd256 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:29:59.971748 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-c88375fb-79c9-43b9-b2ff-ad7e8d7cd256 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:00.087040 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 871/1737] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:29:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:30:00.091800 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d083c-c9a3-49bb-8c0c-bbe354dcc2e3 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:00.267855 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d083c-c9a3-49bb-8c0c-bbe354dcc2e3 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:00.280254 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c27065-1447-4567-8696-50a34048f92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:00.285184 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c27065-1447-4567-8696-50a34048f92b admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:00.286581 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c27065-1447-4567-8696-50a34048f92b admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:00.286748 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c27065-1447-4567-8696-50a34048f92b admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:00.289839 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:00.290575 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c27065-1447-4567-8696-50a34048f92b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:00.300904 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c27065-1447-4567-8696-50a34048f92b admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:00.337409 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88375fb-79c9-43b9-b2ff-ad7e8d7cd256 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:00.350094 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ac9ee-dc5e-4cdf-b33e-57623982f808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:00.353382 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ac9ee-dc5e-4cdf-b33e-57623982f808 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:00.359151 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ac9ee-dc5e-4cdf-b33e-57623982f808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:00.360544 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ac9ee-dc5e-4cdf-b33e-57623982f808 admin admin] PATH_INFO: `/v3/users/bdf14d75b80e46bd97aad102c365e857` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:00.365089 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ac9ee-dc5e-4cdf-b33e-57623982f808 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdf14d75b80e46bd97aad102c365e857)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:00.377569 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ac9ee-dc5e-4cdf-b33e-57623982f808 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:00.442408 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 872/1738] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:30:00 2022] POST /identity/v3/projects => generated 371 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:30:00.444211 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c27065-1447-4567-8696-50a34048f92b admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:00.448893 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-f8c27065-1447-4567-8696-50a34048f92b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:00.485963 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:00.593061 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-c08ac9ee-dc5e-4cdf-b33e-57623982f808 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdf14d75b80e46bd97aad102c365e857'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:00.625213 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-c08ac9ee-dc5e-4cdf-b33e-57623982f808 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdf14d75b80e46bd97aad102c365e857'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:00.657127 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-c08ac9ee-dc5e-4cdf-b33e-57623982f808 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdf14d75b80e46bd97aad102c365e857'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:00.658535 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-c08ac9ee-dc5e-4cdf-b33e-57623982f808 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdf14d75b80e46bd97aad102c365e857'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:00.660865 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-c08ac9ee-dc5e-4cdf-b33e-57623982f808 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdf14d75b80e46bd97aad102c365e857'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:00.730958 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 867/1739] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:29:59 2022] DELETE /identity/v3/users/bdf14d75b80e46bd97aad102c365e857 => generated 0 bytes in 760 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:00.738170 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ac9ee-dc5e-4cdf-b33e-57623982f808 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:00.744711 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-c08ac9ee-dc5e-4cdf-b33e-57623982f808 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:00.764475 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c27065-1447-4567-8696-50a34048f92b admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:00.969973 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f8dd51-c1b8-48d0-a573-5177163f34f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:00.970992 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8dd51-c1b8-48d0-a573-5177163f34f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:00.971499 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8dd51-c1b8-48d0-a573-5177163f34f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:00.971902 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8dd51-c1b8-48d0-a573-5177163f34f1 admin admin] PATH_INFO: `/v3/projects/62c14f070f8a47af912e8166c2c81559` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:00.974453 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f8dd51-c1b8-48d0-a573-5177163f34f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62c14f070f8a47af912e8166c2c81559)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:00.977126 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f8dd51-c1b8-48d0-a573-5177163f34f1 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:01.009668 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ac9ee-dc5e-4cdf-b33e-57623982f808 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:01.030380 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d83f47f-fb86-45cb-b2ef-efb96b62f3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:01.031059 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83f47f-fb86-45cb-b2ef-efb96b62f3cc admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:01.031367 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83f47f-fb86-45cb-b2ef-efb96b62f3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:01.031759 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83f47f-fb86-45cb-b2ef-efb96b62f3cc admin admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:01.032345 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d83f47f-fb86-45cb-b2ef-efb96b62f3cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:01.034365 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d83f47f-fb86-45cb-b2ef-efb96b62f3cc admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:01.127514 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 868/1740] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:30:00 2022] POST /identity/v3/users => generated 292 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:30:01.144264 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3bcd6-0425-4928-a297-c9cdc0abe056 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:01.144596 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3bcd6-0425-4928-a297-c9cdc0abe056 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:01.144815 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3bcd6-0425-4928-a297-c9cdc0abe056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:01.192042 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-36f8dd51-c1b8-48d0-a573-5177163f34f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62c14f070f8a47af912e8166c2c81559', 'request_id': 'req-36f8dd51-c1b8-48d0-a573-5177163f34f1'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:01.211163 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-36f8dd51-c1b8-48d0-a573-5177163f34f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62c14f070f8a47af912e8166c2c81559', 'request_id': 'req-36f8dd51-c1b8-48d0-a573-5177163f34f1'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:01.221173 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-36f8dd51-c1b8-48d0-a573-5177163f34f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62c14f070f8a47af912e8166c2c81559', 'request_id': 'req-36f8dd51-c1b8-48d0-a573-5177163f34f1'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:01.230017 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-e5b3bcd6-0425-4928-a297-c9cdc0abe056 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:01.234860 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-e5b3bcd6-0425-4928-a297-c9cdc0abe056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:01.246789 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-36f8dd51-c1b8-48d0-a573-5177163f34f1 admin admin] The token cache is being invalidate because project 62c14f070f8a47af912e8166c2c81559 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:30:01.247113 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-36f8dd51-c1b8-48d0-a573-5177163f34f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:01.249820 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-36f8dd51-c1b8-48d0-a573-5177163f34f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:01.254006 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 873/1741] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:30:00 2022] DELETE /identity/v3/projects/62c14f070f8a47af912e8166c2c81559 => generated 0 bytes in 810 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:01.255182 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f8dd51-c1b8-48d0-a573-5177163f34f1 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:01.259519 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-36f8dd51-c1b8-48d0-a573-5177163f34f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:01.392923 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 869/1742] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:30:01.398191 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3bcd6-0425-4928-a297-c9cdc0abe056 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:01.400886 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-e5b3bcd6-0425-4928-a297-c9cdc0abe056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:01.417309 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:01.419088 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:01.435181 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3bcd6-0425-4928-a297-c9cdc0abe056 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:01.452901 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dab4a5-d984-4d65-b28b-8ef0e18af912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:01.453699 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dab4a5-d984-4d65-b28b-8ef0e18af912 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:01.453995 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dab4a5-d984-4d65-b28b-8ef0e18af912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:01.454282 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dab4a5-d984-4d65-b28b-8ef0e18af912 admin admin] PATH_INFO: `/v3/users/55d1da5b20474e02b017aaefcebb318d` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:01.457014 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dab4a5-d984-4d65-b28b-8ef0e18af912 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55d1da5b20474e02b017aaefcebb318d)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:01.459964 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f8dd51-c1b8-48d0-a573-5177163f34f1 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:01.462514 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dab4a5-d984-4d65-b28b-8ef0e18af912 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:01.480580 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfd3501-3bcf-4d82-b31f-cac0915b4589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:01.481405 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd3501-3bcf-4d82-b31f-cac0915b4589 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:01.481710 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd3501-3bcf-4d82-b31f-cac0915b4589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:01.481983 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd3501-3bcf-4d82-b31f-cac0915b4589 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:01.482668 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfd3501-3bcf-4d82-b31f-cac0915b4589 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:01.486642 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfd3501-3bcf-4d82-b31f-cac0915b4589 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:01.515405 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 874/1743] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:30:01 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:30:01.516430 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfd3501-3bcf-4d82-b31f-cac0915b4589 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:01.525951 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-fcfd3501-3bcf-4d82-b31f-cac0915b4589 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:01.588007 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-f0dab4a5-d984-4d65-b28b-8ef0e18af912 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55d1da5b20474e02b017aaefcebb318d'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:01.601401 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-f0dab4a5-d984-4d65-b28b-8ef0e18af912 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55d1da5b20474e02b017aaefcebb318d'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:01.640937 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-f0dab4a5-d984-4d65-b28b-8ef0e18af912 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55d1da5b20474e02b017aaefcebb318d'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:01.642460 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-f0dab4a5-d984-4d65-b28b-8ef0e18af912 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55d1da5b20474e02b017aaefcebb318d'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:01.644369 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-f0dab4a5-d984-4d65-b28b-8ef0e18af912 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55d1da5b20474e02b017aaefcebb318d'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:01.671881 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 870/1744] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:30:01 2022] DELETE /identity/v3/users/55d1da5b20474e02b017aaefcebb318d => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:01.678723 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dab4a5-d984-4d65-b28b-8ef0e18af912 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:01.682764 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfd3501-3bcf-4d82-b31f-cac0915b4589 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:01.684194 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-f0dab4a5-d984-4d65-b28b-8ef0e18af912 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:01.804116 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dab4a5-d984-4d65-b28b-8ef0e18af912 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:01.811037 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb21a7-8510-48a9-9d58-fa050564ddb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:01.811801 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb21a7-8510-48a9-9d58-fa050564ddb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:01.812087 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb21a7-8510-48a9-9d58-fa050564ddb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:01.812365 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb21a7-8510-48a9-9d58-fa050564ddb2 admin admin] PATH_INFO: `/v3/projects/8893400fc01e40be80f0829e506ce414/users/d23fa5fe96394d758fb6cecffba53b45/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:01.832790 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb21a7-8510-48a9-9d58-fa050564ddb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8893400fc01e40be80f0829e506ce414, user_id=d23fa5fe96394d758fb6cecffba53b45, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:01.836112 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb21a7-8510-48a9-9d58-fa050564ddb2 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:01.864637 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd9b6c-ca88-43dd-aaab-b785fae69950 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:01.865384 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd9b6c-ca88-43dd-aaab-b785fae69950 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:01.865835 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd9b6c-ca88-43dd-aaab-b785fae69950 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:01.866254 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd9b6c-ca88-43dd-aaab-b785fae69950 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:01.873482 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 871/1745] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:30:01 2022] PUT /identity/v3/projects/8893400fc01e40be80f0829e506ce414/users/d23fa5fe96394d758fb6cecffba53b45/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:01.887743 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb21a7-8510-48a9-9d58-fa050564ddb2 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:01.892283 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-c1cd9b6c-ca88-43dd-aaab-b785fae69950 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:01.928622 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cd9b6c-ca88-43dd-aaab-b785fae69950 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:01.934154 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cd9b6c-ca88-43dd-aaab-b785fae69950 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:01.957687 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 875/1746] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:30:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:30:01.985587 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354511d-b47c-48cc-8469-082450ea1bb2 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:01.986065 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354511d-b47c-48cc-8469-082450ea1bb2 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:01.986631 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354511d-b47c-48cc-8469-082450ea1bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:02.018864 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:02.025757 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb21a7-8510-48a9-9d58-fa050564ddb2 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:02.033737 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec9da01-e2ad-4cdb-b38a-1a586018e970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:02.034467 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9da01-e2ad-4cdb-b38a-1a586018e970 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:02.034896 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9da01-e2ad-4cdb-b38a-1a586018e970 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:02.035208 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9da01-e2ad-4cdb-b38a-1a586018e970 admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:02.036159 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec9da01-e2ad-4cdb-b38a-1a586018e970 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:02.038107 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec9da01-e2ad-4cdb-b38a-1a586018e970 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:02.057377 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 872/1747] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:30:01 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 15:30:02.058373 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec9da01-e2ad-4cdb-b38a-1a586018e970 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:02.062342 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-9ec9da01-e2ad-4cdb-b38a-1a586018e970 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:02.081829 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec9da01-e2ad-4cdb-b38a-1a586018e970 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:02.086339 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-d354511d-b47c-48cc-8469-082450ea1bb2 None None] MFA Rules not processed for user `a3a26ab281074e2b84ed1f354129ff3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:02.087988 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-d354511d-b47c-48cc-8469-082450ea1bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:02.096587 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f40e71-b883-44aa-8c11-7640438aefd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:02.097683 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f40e71-b883-44aa-8c11-7640438aefd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:02.097977 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f40e71-b883-44aa-8c11-7640438aefd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:02.098263 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f40e71-b883-44aa-8c11-7640438aefd0 admin admin] PATH_INFO: `/v3/users/bfb38dcd163a4ffcb5d81b09632f95b7` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:02.099701 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f40e71-b883-44aa-8c11-7640438aefd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfb38dcd163a4ffcb5d81b09632f95b7)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:02.102177 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f40e71-b883-44aa-8c11-7640438aefd0 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:02.220606 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-68f40e71-b883-44aa-8c11-7640438aefd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfb38dcd163a4ffcb5d81b09632f95b7'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:02.241857 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-68f40e71-b883-44aa-8c11-7640438aefd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfb38dcd163a4ffcb5d81b09632f95b7'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:02.257889 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 876/1748] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:30:02.259190 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d354511d-b47c-48cc-8469-082450ea1bb2 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:02.284301 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-68f40e71-b883-44aa-8c11-7640438aefd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfb38dcd163a4ffcb5d81b09632f95b7'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:02.288088 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-68f40e71-b883-44aa-8c11-7640438aefd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfb38dcd163a4ffcb5d81b09632f95b7'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:02.289019 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-68f40e71-b883-44aa-8c11-7640438aefd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfb38dcd163a4ffcb5d81b09632f95b7'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:02.295337 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d354511d-b47c-48cc-8469-082450ea1bb2 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:02.301400 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47806c1f-9e7e-4f02-98d5-f9e684482fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:02.303109 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47806c1f-9e7e-4f02-98d5-f9e684482fb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:02.303473 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47806c1f-9e7e-4f02-98d5-f9e684482fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:02.303892 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47806c1f-9e7e-4f02-98d5-f9e684482fb0 admin admin] PATH_INFO: `/v3/projects/8893400fc01e40be80f0829e506ce414/users/d23fa5fe96394d758fb6cecffba53b45/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:02.305932 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47806c1f-9e7e-4f02-98d5-f9e684482fb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8893400fc01e40be80f0829e506ce414, user_id=d23fa5fe96394d758fb6cecffba53b45, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:02.308666 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47806c1f-9e7e-4f02-98d5-f9e684482fb0 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:02.315946 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 873/1749] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:30:02 2022] DELETE /identity/v3/users/bfb38dcd163a4ffcb5d81b09632f95b7 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:02.320651 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c77a5fc-1a34-488b-a1d5-f176f7058414 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:02.321979 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c77a5fc-1a34-488b-a1d5-f176f7058414 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:02.322282 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c77a5fc-1a34-488b-a1d5-f176f7058414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:02.330506 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 877/1750] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:30:02 2022] PUT /identity/v3/projects/8893400fc01e40be80f0829e506ce414/users/d23fa5fe96394d758fb6cecffba53b45/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:02.332526 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a050664-601f-422b-87c2-ab6d4a8d576b None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:02.333104 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a050664-601f-422b-87c2-ab6d4a8d576b None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:02.333548 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a050664-601f-422b-87c2-ab6d4a8d576b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:02.361511 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:02.380006 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-8c77a5fc-1a34-488b-a1d5-f176f7058414 None None] MFA Rules not processed for user `a3a26ab281074e2b84ed1f354129ff3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:02.381635 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-8c77a5fc-1a34-488b-a1d5-f176f7058414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:02.408864 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-3a050664-601f-422b-87c2-ab6d4a8d576b None None] MFA Rules not processed for user `dfe8c00c0c3d4c4b8b6f36e39a3a2e71`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:02.410356 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-3a050664-601f-422b-87c2-ab6d4a8d576b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:02.500456 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 878/1751] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Aug 2 15:30:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:30:02.501311 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f8557-a371-4c37-81ba-49491acccf49 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:02.501672 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f8557-a371-4c37-81ba-49491acccf49 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:02.502999 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f8557-a371-4c37-81ba-49491acccf49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:02.527004 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-c58f8557-a371-4c37-81ba-49491acccf49 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:02.533311 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-c58f8557-a371-4c37-81ba-49491acccf49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:02.562297 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 874/1752] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:02 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:30:02.564631 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7539dc17-13ad-4562-8bdd-397f55472e32 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:02.565130 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7539dc17-13ad-4562-8bdd-397f55472e32 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:02.565611 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7539dc17-13ad-4562-8bdd-397f55472e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:02.639924 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 879/1753] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:30:02.639924 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f8557-a371-4c37-81ba-49491acccf49 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:02.641181 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-c58f8557-a371-4c37-81ba-49491acccf49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:02.645338 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-7539dc17-13ad-4562-8bdd-397f55472e32 None None] MFA Rules not processed for user `d23fa5fe96394d758fb6cecffba53b45`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:02.646584 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-7539dc17-13ad-4562-8bdd-397f55472e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:02.801492 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:02.820312 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f8557-a371-4c37-81ba-49491acccf49 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:02.826582 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 875/1754] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:02 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:30:02.827513 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7539dc17-13ad-4562-8bdd-397f55472e32 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:02.829843 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-7539dc17-13ad-4562-8bdd-397f55472e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:02.839993 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b994a74-37a2-4f77-a372-0945c26f5ec6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0865af59bf43dfa4c84213d7db53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:02.840950 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b994a74-37a2-4f77-a372-0945c26f5ec6 service nova] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:02.841067 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b994a74-37a2-4f77-a372-0945c26f5ec6 service nova] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:02.841436 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b994a74-37a2-4f77-a372-0945c26f5ec6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:02.843645 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-0b994a74-37a2-4f77-a372-0945c26f5ec6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:02.867061 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b994a74-37a2-4f77-a372-0945c26f5ec6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:02.868760 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b994a74-37a2-4f77-a372-0945c26f5ec6 service nova] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:02.888928 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 880/1755] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:30:02 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:30:02.891721 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96315862-b6f9-4f5b-b9ca-7d042b2a0213 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:02.891941 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96315862-b6f9-4f5b-b9ca-7d042b2a0213 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:02.892227 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96315862-b6f9-4f5b-b9ca-7d042b2a0213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:02.963896 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:02.980895 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-96315862-b6f9-4f5b-b9ca-7d042b2a0213 None None] MFA Rules not processed for user `77c9a03620d04b2a9f80ec16f9738670`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:02.982704 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-96315862-b6f9-4f5b-b9ca-7d042b2a0213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:03.064778 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7539dc17-13ad-4562-8bdd-397f55472e32 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:03.069532 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1473697-53c7-48b0-beae-06d1010563e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:03.071422 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1473697-53c7-48b0-beae-06d1010563e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:03.071422 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1473697-53c7-48b0-beae-06d1010563e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:03.071422 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1473697-53c7-48b0-beae-06d1010563e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:03.087420 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1473697-53c7-48b0-beae-06d1010563e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:03.089068 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1473697-53c7-48b0-beae-06d1010563e2 service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:03.103372 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 876/1756] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:30:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:30:03.104396 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1473697-53c7-48b0-beae-06d1010563e2 service neutron] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:03.105999 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-d1473697-53c7-48b0-beae-06d1010563e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:03.193468 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 881/1757] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:02 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:30:03.194463 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96315862-b6f9-4f5b-b9ca-7d042b2a0213 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:03.196571 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-96315862-b6f9-4f5b-b9ca-7d042b2a0213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:03.265268 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1473697-53c7-48b0-beae-06d1010563e2 service neutron] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:03.280312 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd64165-7c6d-4963-afa3-9e754abb15ba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4de590df474c8b95f2b1193f7dbcb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:03.281510 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd64165-7c6d-4963-afa3-9e754abb15ba service swift] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:03.281795 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd64165-7c6d-4963-afa3-9e754abb15ba service swift] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:03.282758 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd64165-7c6d-4963-afa3-9e754abb15ba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:03.307796 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd64165-7c6d-4963-afa3-9e754abb15ba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:03.309948 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd64165-7c6d-4963-afa3-9e754abb15ba service swift] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:03.324680 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 877/1758] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Aug 2 15:30:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 15:30:03.329176 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd64165-7c6d-4963-afa3-9e754abb15ba service swift] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:03.331363 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-0cd64165-7c6d-4963-afa3-9e754abb15ba service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:03.349480 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96315862-b6f9-4f5b-b9ca-7d042b2a0213 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:03.359992 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5baa88-e81d-45c9-a156-b8cd5b74f13d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:03.360671 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5baa88-e81d-45c9-a156-b8cd5b74f13d service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:03.365211 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5baa88-e81d-45c9-a156-b8cd5b74f13d service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:03.365571 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5baa88-e81d-45c9-a156-b8cd5b74f13d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:03.382276 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd64165-7c6d-4963-afa3-9e754abb15ba service swift] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:03.412325 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9f93a-622e-4d4a-bdef-8b82d8d216d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:03.413180 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9f93a-622e-4d4a-bdef-8b82d8d216d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:03.414839 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9f93a-622e-4d4a-bdef-8b82d8d216d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:03.416299 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9f93a-622e-4d4a-bdef-8b82d8d216d2 admin admin] PATH_INFO: `/v3/projects/e34dd106c8604e69926f06756f30424e` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:03.421701 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d9f93a-622e-4d4a-bdef-8b82d8d216d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e34dd106c8604e69926f06756f30424e)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:03.433079 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d9f93a-622e-4d4a-bdef-8b82d8d216d2 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:03.439007 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5baa88-e81d-45c9-a156-b8cd5b74f13d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:03.446746 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5baa88-e81d-45c9-a156-b8cd5b74f13d service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:03.514456 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 882/1759] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:30:03 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:30:03.522184 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c47e7-4111-45b3-a75b-13ca21b831ec None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:03.522494 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c47e7-4111-45b3-a75b-13ca21b831ec None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:03.522805 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c47e7-4111-45b3-a75b-13ca21b831ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:03.645734 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-e2d9f93a-622e-4d4a-bdef-8b82d8d216d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e34dd106c8604e69926f06756f30424e', 'request_id': 'req-e2d9f93a-622e-4d4a-bdef-8b82d8d216d2'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:03.662275 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-e2d9f93a-622e-4d4a-bdef-8b82d8d216d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e34dd106c8604e69926f06756f30424e', 'request_id': 'req-e2d9f93a-622e-4d4a-bdef-8b82d8d216d2'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:03.676570 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-d33c47e7-4111-45b3-a75b-13ca21b831ec None None] MFA Rules not processed for user `77c9a03620d04b2a9f80ec16f9738670`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:03.681722 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-e2d9f93a-622e-4d4a-bdef-8b82d8d216d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e34dd106c8604e69926f06756f30424e', 'request_id': 'req-e2d9f93a-622e-4d4a-bdef-8b82d8d216d2'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:03.684225 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:03.691545 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-d33c47e7-4111-45b3-a75b-13ca21b831ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:03.731261 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-e2d9f93a-622e-4d4a-bdef-8b82d8d216d2 admin admin] The token cache is being invalidate because project e34dd106c8604e69926f06756f30424e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80360) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:30:03.735302 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-e2d9f93a-622e-4d4a-bdef-8b82d8d216d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:03.737418 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-e2d9f93a-622e-4d4a-bdef-8b82d8d216d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:03.746240 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 878/1760] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:30:03 2022] DELETE /identity/v3/projects/e34dd106c8604e69926f06756f30424e => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:03.752457 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9f93a-622e-4d4a-bdef-8b82d8d216d2 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:03.761581 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-e2d9f93a-622e-4d4a-bdef-8b82d8d216d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:04.000525 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9f93a-622e-4d4a-bdef-8b82d8d216d2 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:04.029513 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35342f20-804b-4aee-a544-46d893a3615d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:04.030206 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35342f20-804b-4aee-a544-46d893a3615d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:04.030475 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35342f20-804b-4aee-a544-46d893a3615d admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:04.030757 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35342f20-804b-4aee-a544-46d893a3615d admin admin] PATH_INFO: `/v3/projects/b2577ee5db224e45a98206ad77d0a8b4` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:04.033942 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35342f20-804b-4aee-a544-46d893a3615d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2577ee5db224e45a98206ad77d0a8b4)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:04.035913 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35342f20-804b-4aee-a544-46d893a3615d admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:04.113982 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 883/1761] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:03 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 599 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:30:04.116072 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65660690-9025-49ab-b2a2-a87702cc5086 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:04.121050 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65660690-9025-49ab-b2a2-a87702cc5086 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:04.121635 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65660690-9025-49ab-b2a2-a87702cc5086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:04.246674 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-65660690-9025-49ab-b2a2-a87702cc5086 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:04.248204 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-65660690-9025-49ab-b2a2-a87702cc5086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:04.271625 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-35342f20-804b-4aee-a544-46d893a3615d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2577ee5db224e45a98206ad77d0a8b4', 'request_id': 'req-35342f20-804b-4aee-a544-46d893a3615d'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:04.303515 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-35342f20-804b-4aee-a544-46d893a3615d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2577ee5db224e45a98206ad77d0a8b4', 'request_id': 'req-35342f20-804b-4aee-a544-46d893a3615d'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:04.328620 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-35342f20-804b-4aee-a544-46d893a3615d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2577ee5db224e45a98206ad77d0a8b4', 'request_id': 'req-35342f20-804b-4aee-a544-46d893a3615d'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:04.388053 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-35342f20-804b-4aee-a544-46d893a3615d admin admin] The token cache is being invalidate because project b2577ee5db224e45a98206ad77d0a8b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80360) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:30:04.389550 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-35342f20-804b-4aee-a544-46d893a3615d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:04.391971 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-35342f20-804b-4aee-a544-46d893a3615d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:04.402439 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 879/1762] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:30:03 2022] DELETE /identity/v3/projects/b2577ee5db224e45a98206ad77d0a8b4 => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:04.404423 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35342f20-804b-4aee-a544-46d893a3615d admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:04.412070 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-35342f20-804b-4aee-a544-46d893a3615d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:04.493115 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:04.572661 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 884/1763] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 458 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:30:04.576074 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65660690-9025-49ab-b2a2-a87702cc5086 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:04.586805 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-65660690-9025-49ab-b2a2-a87702cc5086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:04.631926 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65660690-9025-49ab-b2a2-a87702cc5086 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:04.670846 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c37edc3-0001-4c3c-87db-ac0ad33c1ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:04.671709 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37edc3-0001-4c3c-87db-ac0ad33c1ea1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:04.671998 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37edc3-0001-4c3c-87db-ac0ad33c1ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:04.672859 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37edc3-0001-4c3c-87db-ac0ad33c1ea1 admin admin] PATH_INFO: `/v3/users/87f98dc02d1c4d4c90a281743788adfe` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:04.677025 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c37edc3-0001-4c3c-87db-ac0ad33c1ea1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87f98dc02d1c4d4c90a281743788adfe)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:04.678973 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c37edc3-0001-4c3c-87db-ac0ad33c1ea1 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:04.796873 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35342f20-804b-4aee-a544-46d893a3615d admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:04.830982 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d08864-c894-4a04-ae61-e87f2aad5a8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0865af59bf43dfa4c84213d7db53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:04.830982 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d08864-c894-4a04-ae61-e87f2aad5a8b service nova] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:04.830982 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d08864-c894-4a04-ae61-e87f2aad5a8b service nova] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:04.843912 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-0c37edc3-0001-4c3c-87db-ac0ad33c1ea1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87f98dc02d1c4d4c90a281743788adfe'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:04.849100 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d08864-c894-4a04-ae61-e87f2aad5a8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:04.862559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-a2d08864-c894-4a04-ae61-e87f2aad5a8b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:04.885731 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-0c37edc3-0001-4c3c-87db-ac0ad33c1ea1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87f98dc02d1c4d4c90a281743788adfe'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:04.893987 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-0c37edc3-0001-4c3c-87db-ac0ad33c1ea1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87f98dc02d1c4d4c90a281743788adfe'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:04.911756 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-0c37edc3-0001-4c3c-87db-ac0ad33c1ea1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87f98dc02d1c4d4c90a281743788adfe'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:04.941613 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-0c37edc3-0001-4c3c-87db-ac0ad33c1ea1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87f98dc02d1c4d4c90a281743788adfe'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:04.959599 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 885/1764] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:30:04 2022] DELETE /identity/v3/users/87f98dc02d1c4d4c90a281743788adfe => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:04.960980 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd85164-651e-484b-b621-94956343bb8e None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:04.961278 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd85164-651e-484b-b621-94956343bb8e None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:04.961566 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd85164-651e-484b-b621-94956343bb8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:04.986861 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:05.071140 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-2bd85164-651e-484b-b621-94956343bb8e None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:05.072441 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-2bd85164-651e-484b-b621-94956343bb8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:05.232227 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d08864-c894-4a04-ae61-e87f2aad5a8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:05.236017 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d08864-c894-4a04-ae61-e87f2aad5a8b service nova] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:05.304524 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 880/1765] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:30:04 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 901 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:30:05.306381 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d08864-c894-4a04-ae61-e87f2aad5a8b service nova] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:05.324655 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-a2d08864-c894-4a04-ae61-e87f2aad5a8b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:05.352278 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 886/1766] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:30:05.374812 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd85164-651e-484b-b621-94956343bb8e None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:05.376241 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d08864-c894-4a04-ae61-e87f2aad5a8b service nova] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:05.379456 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-2bd85164-651e-484b-b621-94956343bb8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:05.414982 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e086eb-86bd-4b51-bf52-07689f7f918e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:05.419390 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e086eb-86bd-4b51-bf52-07689f7f918e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:05.421491 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e086eb-86bd-4b51-bf52-07689f7f918e admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:05.422512 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e086eb-86bd-4b51-bf52-07689f7f918e admin admin] PATH_INFO: `/v3/projects/ab4f64b0357d48dca6777ca5a735642e` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:05.435086 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd85164-651e-484b-b621-94956343bb8e None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:05.436394 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e086eb-86bd-4b51-bf52-07689f7f918e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab4f64b0357d48dca6777ca5a735642e)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:05.446213 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e086eb-86bd-4b51-bf52-07689f7f918e admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:05.459861 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5116012a-3ba8-4c21-88f6-6ffc3ed79096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:05.460629 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116012a-3ba8-4c21-88f6-6ffc3ed79096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:05.461024 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116012a-3ba8-4c21-88f6-6ffc3ed79096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:05.463584 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116012a-3ba8-4c21-88f6-6ffc3ed79096 admin admin] PATH_INFO: `/v3/users/516f6f181b444d529377aa5cd7aa429d` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:05.466121 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5116012a-3ba8-4c21-88f6-6ffc3ed79096 admin admin] RBAC: Authorizing `identity:delete_user(user_id=516f6f181b444d529377aa5cd7aa429d)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:05.477835 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5116012a-3ba8-4c21-88f6-6ffc3ed79096 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:05.606387 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-5116012a-3ba8-4c21-88f6-6ffc3ed79096 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '516f6f181b444d529377aa5cd7aa429d'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:05.636280 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:05.664417 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-5116012a-3ba8-4c21-88f6-6ffc3ed79096 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '516f6f181b444d529377aa5cd7aa429d'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:05.666955 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-5116012a-3ba8-4c21-88f6-6ffc3ed79096 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '516f6f181b444d529377aa5cd7aa429d'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:05.676108 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-58e086eb-86bd-4b51-bf52-07689f7f918e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab4f64b0357d48dca6777ca5a735642e', 'request_id': 'req-58e086eb-86bd-4b51-bf52-07689f7f918e'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:05.716927 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-5116012a-3ba8-4c21-88f6-6ffc3ed79096 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '516f6f181b444d529377aa5cd7aa429d'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:05.722006 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-58e086eb-86bd-4b51-bf52-07689f7f918e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab4f64b0357d48dca6777ca5a735642e', 'request_id': 'req-58e086eb-86bd-4b51-bf52-07689f7f918e'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:05.744021 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-5116012a-3ba8-4c21-88f6-6ffc3ed79096 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '516f6f181b444d529377aa5cd7aa429d'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:05.750171 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-58e086eb-86bd-4b51-bf52-07689f7f918e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab4f64b0357d48dca6777ca5a735642e', 'request_id': 'req-58e086eb-86bd-4b51-bf52-07689f7f918e'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:05.762387 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 887/1767] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:30:05 2022] DELETE /identity/v3/users/516f6f181b444d529377aa5cd7aa429d => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:05.764431 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5116012a-3ba8-4c21-88f6-6ffc3ed79096 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:05.767565 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-5116012a-3ba8-4c21-88f6-6ffc3ed79096 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:05.782075 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-58e086eb-86bd-4b51-bf52-07689f7f918e admin admin] The token cache is being invalidate because project ab4f64b0357d48dca6777ca5a735642e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80360) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:30:05.782839 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-58e086eb-86bd-4b51-bf52-07689f7f918e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:05.785931 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-58e086eb-86bd-4b51-bf52-07689f7f918e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:05.796842 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 881/1768] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:30:05 2022] DELETE /identity/v3/projects/ab4f64b0357d48dca6777ca5a735642e => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:05.801074 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dde6b8-2c8a-4918-9943-026136d97881 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:05.802241 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dde6b8-2c8a-4918-9943-026136d97881 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:05.802774 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dde6b8-2c8a-4918-9943-026136d97881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:05.873893 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-f6dde6b8-2c8a-4918-9943-026136d97881 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:05.878936 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-f6dde6b8-2c8a-4918-9943-026136d97881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:06.010293 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5116012a-3ba8-4c21-88f6-6ffc3ed79096 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:06.027597 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b441b490-755f-4b5c-8614-7545907a09ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:06.029150 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441b490-755f-4b5c-8614-7545907a09ab admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:06.030162 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441b490-755f-4b5c-8614-7545907a09ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:06.030781 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441b490-755f-4b5c-8614-7545907a09ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:06.034186 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b441b490-755f-4b5c-8614-7545907a09ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:30:06.034690 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b441b490-755f-4b5c-8614-7545907a09ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:06.040162 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b441b490-755f-4b5c-8614-7545907a09ab admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:06.075800 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 888/1769] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 2 15:30:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:30:06.076966 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b441b490-755f-4b5c-8614-7545907a09ab admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:06.080050 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-b441b490-755f-4b5c-8614-7545907a09ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:06.121512 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 882/1770] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:30:06.124616 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dde6b8-2c8a-4918-9943-026136d97881 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:06.128352 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-f6dde6b8-2c8a-4918-9943-026136d97881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:06.161379 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b441b490-755f-4b5c-8614-7545907a09ab admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:06.190890 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dde6b8-2c8a-4918-9943-026136d97881 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:06.196072 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0db7a7-393a-448d-944e-643b50a7a91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:06.197321 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0db7a7-393a-448d-944e-643b50a7a91c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:06.198195 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0db7a7-393a-448d-944e-643b50a7a91c admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:06.199825 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0db7a7-393a-448d-944e-643b50a7a91c admin admin] PATH_INFO: `/v3/users/a6c4460f1d9344f3a95bfd1b20ff0efc` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:06.210770 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0db7a7-393a-448d-944e-643b50a7a91c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6c4460f1d9344f3a95bfd1b20ff0efc)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:06.219492 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0db7a7-393a-448d-944e-643b50a7a91c admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:06.225078 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7348f9e0-7a52-4041-b911-2813aae4bdf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:06.225865 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348f9e0-7a52-4041-b911-2813aae4bdf4 admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:06.226259 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348f9e0-7a52-4041-b911-2813aae4bdf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:06.227491 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348f9e0-7a52-4041-b911-2813aae4bdf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:06.230977 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7348f9e0-7a52-4041-b911-2813aae4bdf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:06.241588 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7348f9e0-7a52-4041-b911-2813aae4bdf4 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:06.331808 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 883/1771] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:30:06 2022] POST /identity/v3/projects => generated 363 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:30:06.334971 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7348f9e0-7a52-4041-b911-2813aae4bdf4 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:06.337976 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-7348f9e0-7a52-4041-b911-2813aae4bdf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:06.435618 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:06.492641 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-ac0db7a7-393a-448d-944e-643b50a7a91c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6c4460f1d9344f3a95bfd1b20ff0efc'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:06.534252 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-ac0db7a7-393a-448d-944e-643b50a7a91c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6c4460f1d9344f3a95bfd1b20ff0efc'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:06.535994 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-ac0db7a7-393a-448d-944e-643b50a7a91c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6c4460f1d9344f3a95bfd1b20ff0efc'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:06.565508 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-ac0db7a7-393a-448d-944e-643b50a7a91c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6c4460f1d9344f3a95bfd1b20ff0efc'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:06.581390 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-ac0db7a7-393a-448d-944e-643b50a7a91c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6c4460f1d9344f3a95bfd1b20ff0efc'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:06.614316 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 889/1772] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:30:06 2022] DELETE /identity/v3/users/a6c4460f1d9344f3a95bfd1b20ff0efc => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:06.626519 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0db7a7-393a-448d-944e-643b50a7a91c admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:06.634055 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7348f9e0-7a52-4041-b911-2813aae4bdf4 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:06.635266 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-ac0db7a7-393a-448d-944e-643b50a7a91c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:06.782151 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:06.868171 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0db7a7-393a-448d-944e-643b50a7a91c admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:06.882534 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9275e524-663e-4cc5-9501-5fb9ac78cac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:06.883339 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275e524-663e-4cc5-9501-5fb9ac78cac8 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:06.883691 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275e524-663e-4cc5-9501-5fb9ac78cac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:06.884057 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d008aa5-08bb-457c-b6e1-132b15418be6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:06.884194 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275e524-663e-4cc5-9501-5fb9ac78cac8 admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:06.884895 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9275e524-663e-4cc5-9501-5fb9ac78cac8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:06.885440 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d008aa5-08bb-457c-b6e1-132b15418be6 service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:06.885763 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d008aa5-08bb-457c-b6e1-132b15418be6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:06.886099 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d008aa5-08bb-457c-b6e1-132b15418be6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:06.892021 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9275e524-663e-4cc5-9501-5fb9ac78cac8 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:06.893703 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-7d008aa5-08bb-457c-b6e1-132b15418be6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:06.954917 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 890/1773] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:30:06 2022] POST /identity/v3/users => generated 282 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:30:06.960014 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d008aa5-08bb-457c-b6e1-132b15418be6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:06.960854 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9275e524-663e-4cc5-9501-5fb9ac78cac8 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:06.966577 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d008aa5-08bb-457c-b6e1-132b15418be6 service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:06.969307 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-9275e524-663e-4cc5-9501-5fb9ac78cac8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:07.020634 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 884/1774] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:30:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 687 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:30:07.022399 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d008aa5-08bb-457c-b6e1-132b15418be6 service neutron] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:07.027424 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9275e524-663e-4cc5-9501-5fb9ac78cac8 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:07.045064 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a3edc-7834-4b2d-9c94-6303193efdc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:07.049619 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a3edc-7834-4b2d-9c94-6303193efdc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:07.049915 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a3edc-7834-4b2d-9c94-6303193efdc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:07.050025 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d008aa5-08bb-457c-b6e1-132b15418be6 service neutron] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:07.050197 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a3edc-7834-4b2d-9c94-6303193efdc9 admin admin] PATH_INFO: `/v3/projects/8b688aa4e5a64d1f8e6fc30f2350e443` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:07.057235 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052a3edc-7834-4b2d-9c94-6303193efdc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b688aa4e5a64d1f8e6fc30f2350e443)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:07.063851 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef324cbf-fd56-4ae0-8be8-3f0894e45dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:07.064140 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef324cbf-fd56-4ae0-8be8-3f0894e45dc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:07.064430 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef324cbf-fd56-4ae0-8be8-3f0894e45dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:07.064709 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef324cbf-fd56-4ae0-8be8-3f0894e45dc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:07.065757 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef324cbf-fd56-4ae0-8be8-3f0894e45dc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:07.069234 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef324cbf-fd56-4ae0-8be8-3f0894e45dc6 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:07.072137 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052a3edc-7834-4b2d-9c94-6303193efdc9 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:07.092896 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 885/1775] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:30:07.098407 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef324cbf-fd56-4ae0-8be8-3f0894e45dc6 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:07.124634 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef324cbf-fd56-4ae0-8be8-3f0894e45dc6 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:07.139013 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae180fc-d09f-444d-8dfb-588b6b123f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:07.140211 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae180fc-d09f-444d-8dfb-588b6b123f6a admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:07.142200 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae180fc-d09f-444d-8dfb-588b6b123f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:07.144763 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae180fc-d09f-444d-8dfb-588b6b123f6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:07.145752 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae180fc-d09f-444d-8dfb-588b6b123f6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:07.153657 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae180fc-d09f-444d-8dfb-588b6b123f6a admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:07.186850 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 886/1776] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 15:30:07.193785 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae180fc-d09f-444d-8dfb-588b6b123f6a admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:07.230817 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae180fc-d09f-444d-8dfb-588b6b123f6a admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:07.246554 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12073d1-b3d5-474c-bc0a-60bd05a1a90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:07.249256 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12073d1-b3d5-474c-bc0a-60bd05a1a90a admin admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:07.252420 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12073d1-b3d5-474c-bc0a-60bd05a1a90a admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:07.253057 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12073d1-b3d5-474c-bc0a-60bd05a1a90a admin admin] PATH_INFO: `/v3/projects/4fcb8f6af59b4c039b9439aefbedcf47/users/5b7374a5754c423189ecebc59e1b7493/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:07.326272 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12073d1-b3d5-474c-bc0a-60bd05a1a90a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fcb8f6af59b4c039b9439aefbedcf47, user_id=5b7374a5754c423189ecebc59e1b7493, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:07.329986 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-052a3edc-7834-4b2d-9c94-6303193efdc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b688aa4e5a64d1f8e6fc30f2350e443', 'request_id': 'req-052a3edc-7834-4b2d-9c94-6303193efdc9'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:07.337790 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12073d1-b3d5-474c-bc0a-60bd05a1a90a admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:07.382265 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-052a3edc-7834-4b2d-9c94-6303193efdc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b688aa4e5a64d1f8e6fc30f2350e443', 'request_id': 'req-052a3edc-7834-4b2d-9c94-6303193efdc9'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:07.405890 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 887/1777] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:30:07 2022] PUT /identity/v3/projects/4fcb8f6af59b4c039b9439aefbedcf47/users/5b7374a5754c423189ecebc59e1b7493/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:07.424182 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32441428-6216-4ed4-8aac-7d6435bbc861 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:07.424513 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32441428-6216-4ed4-8aac-7d6435bbc861 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:07.424749 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32441428-6216-4ed4-8aac-7d6435bbc861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:07.428051 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-052a3edc-7834-4b2d-9c94-6303193efdc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b688aa4e5a64d1f8e6fc30f2350e443', 'request_id': 'req-052a3edc-7834-4b2d-9c94-6303193efdc9'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:07.532862 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-052a3edc-7834-4b2d-9c94-6303193efdc9 admin admin] The token cache is being invalidate because project 8b688aa4e5a64d1f8e6fc30f2350e443 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:30:07.533152 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-052a3edc-7834-4b2d-9c94-6303193efdc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:07.540557 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-052a3edc-7834-4b2d-9c94-6303193efdc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:07.544430 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-32441428-6216-4ed4-8aac-7d6435bbc861 None None] MFA Rules not processed for user `f6d1caa34f2b41bfbcc95fa58d85f004`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:07.555002 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-32441428-6216-4ed4-8aac-7d6435bbc861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:07.565454 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 891/1778] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:30:06 2022] DELETE /identity/v3/projects/8b688aa4e5a64d1f8e6fc30f2350e443 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:07.571548 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16148142-b6a3-4579-80a4-8eff38014a37 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:07.579515 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16148142-b6a3-4579-80a4-8eff38014a37 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:07.579515 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16148142-b6a3-4579-80a4-8eff38014a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:07.740968 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-16148142-b6a3-4579-80a4-8eff38014a37 None None] MFA Rules not processed for user `5b7374a5754c423189ecebc59e1b7493`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:07.749999 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-16148142-b6a3-4579-80a4-8eff38014a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:07.869572 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 888/1779] 10.222.0.65 () {58 vars in 1015 bytes} [Tue Aug 2 15:30:07 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 463 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:30:07.872538 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0facb5-07f1-40f0-9ad7-7ff91c0ca4ad None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:07.873159 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0facb5-07f1-40f0-9ad7-7ff91c0ca4ad None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:07.874076 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0facb5-07f1-40f0-9ad7-7ff91c0ca4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:07.903602 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-df0facb5-07f1-40f0-9ad7-7ff91c0ca4ad None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:07.905276 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-df0facb5-07f1-40f0-9ad7-7ff91c0ca4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:08.083903 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 892/1780] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 518 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:30:08.088266 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16148142-b6a3-4579-80a4-8eff38014a37 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:08.090853 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-16148142-b6a3-4579-80a4-8eff38014a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:08.122473 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:08.182274 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 889/1781] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:30:08.205476 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4cdd7-6ed7-4e0c-a9ef-e561b3b31fea None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:08.205769 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4cdd7-6ed7-4e0c-a9ef-e561b3b31fea None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:08.206052 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4cdd7-6ed7-4e0c-a9ef-e561b3b31fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:08.280659 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-32f4cdd7-6ed7-4e0c-a9ef-e561b3b31fea None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:08.281918 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-32f4cdd7-6ed7-4e0c-a9ef-e561b3b31fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:08.316810 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 890/1782] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:30:08.321523 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f4cdd7-6ed7-4e0c-a9ef-e561b3b31fea None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:08.362887 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f4cdd7-6ed7-4e0c-a9ef-e561b3b31fea None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:08.378077 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc8e55-3d3c-4d8c-9594-4e9c35f9b92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:08.378827 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc8e55-3d3c-4d8c-9594-4e9c35f9b92e admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:08.379239 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc8e55-3d3c-4d8c-9594-4e9c35f9b92e admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:08.379533 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc8e55-3d3c-4d8c-9594-4e9c35f9b92e admin admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:08.380381 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfc8e55-3d3c-4d8c-9594-4e9c35f9b92e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:30:08.380722 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfc8e55-3d3c-4d8c-9594-4e9c35f9b92e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:08.381972 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:08.384003 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfc8e55-3d3c-4d8c-9594-4e9c35f9b92e admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:08.427494 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 891/1783] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 2 15:30:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:30:08.432566 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc8e55-3d3c-4d8c-9594-4e9c35f9b92e admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:08.471694 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc8e55-3d3c-4d8c-9594-4e9c35f9b92e admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:08.479641 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16148142-b6a3-4579-80a4-8eff38014a37 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:08.504017 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade8562-e172-449c-b0c3-6a78b4d95cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:08.505116 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade8562-e172-449c-b0c3-6a78b4d95cb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:08.505563 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade8562-e172-449c-b0c3-6a78b4d95cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:08.505996 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade8562-e172-449c-b0c3-6a78b4d95cb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:08.507327 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ade8562-e172-449c-b0c3-6a78b4d95cb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:08.518405 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ade8562-e172-449c-b0c3-6a78b4d95cb8 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:08.518544 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c2854-d84e-4a10-80bd-fdd99fbd0500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:08.519417 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c2854-d84e-4a10-80bd-fdd99fbd0500 admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:08.519805 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c2854-d84e-4a10-80bd-fdd99fbd0500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:08.520743 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c2854-d84e-4a10-80bd-fdd99fbd0500 admin admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:08.521535 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59c2854-d84e-4a10-80bd-fdd99fbd0500 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:08.523963 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59c2854-d84e-4a10-80bd-fdd99fbd0500 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:08.587609 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 892/1784] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:30:08 2022] POST /identity/v3/projects => generated 385 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:30:08.593005 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c2854-d84e-4a10-80bd-fdd99fbd0500 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:08.601415 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 893/1785] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:30:08 2022] POST /identity/v3/projects => generated 361 bytes in 513 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:30:08.602404 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade8562-e172-449c-b0c3-6a78b4d95cb8 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:08.607452 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-8ade8562-e172-449c-b0c3-6a78b4d95cb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:08.790614 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade8562-e172-449c-b0c3-6a78b4d95cb8 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:08.801868 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acab01a-7411-40f1-b231-96e0e08889b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:08.802691 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acab01a-7411-40f1-b231-96e0e08889b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:08.802988 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acab01a-7411-40f1-b231-96e0e08889b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:08.803299 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acab01a-7411-40f1-b231-96e0e08889b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:08.813217 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c2854-d84e-4a10-80bd-fdd99fbd0500 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:08.824597 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acab01a-7411-40f1-b231-96e0e08889b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:08.826691 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acab01a-7411-40f1-b231-96e0e08889b7 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:08.854378 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 894/1786] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:30:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:30:08.855313 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acab01a-7411-40f1-b231-96e0e08889b7 service neutron] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:08.991912 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de37a67d-cb32-4d92-b75b-9f582246575f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:08.992577 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37a67d-cb32-4d92-b75b-9f582246575f admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:08.997732 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37a67d-cb32-4d92-b75b-9f582246575f admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:08.998114 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37a67d-cb32-4d92-b75b-9f582246575f admin admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:08.998872 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de37a67d-cb32-4d92-b75b-9f582246575f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:09.007317 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de37a67d-cb32-4d92-b75b-9f582246575f admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:09.089593 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 893/1787] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:30:08 2022] POST /identity/v3/users => generated 293 bytes in 497 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:30:09.091793 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6a627-141d-421f-8093-598c335991bf None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:09.092040 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6a627-141d-421f-8093-598c335991bf None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:09.092306 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6a627-141d-421f-8093-598c335991bf None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:09.093533 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acab01a-7411-40f1-b231-96e0e08889b7 service neutron] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:09.109271 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b76df1e-b954-438e-ac41-8c5364d7301f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:09.109420 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 894/1788] 10.222.0.42 () {54 vars in 912 bytes} [Tue Aug 2 15:30:09 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:30:09.110279 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6a627-141d-421f-8093-598c335991bf None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:09.110590 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76df1e-b954-438e-ac41-8c5364d7301f admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:09.112309 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76df1e-b954-438e-ac41-8c5364d7301f admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:09.112714 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76df1e-b954-438e-ac41-8c5364d7301f admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:09.114345 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b76df1e-b954-438e-ac41-8c5364d7301f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:09.114817 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-88b6a627-141d-421f-8093-598c335991bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:09.124327 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b76df1e-b954-438e-ac41-8c5364d7301f admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:09.191109 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 895/1789] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:30:08 2022] POST /identity/v3/users => generated 287 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:30:09.192056 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b76df1e-b954-438e-ac41-8c5364d7301f admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:09.193832 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6a627-141d-421f-8093-598c335991bf None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:09.207551 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11361b7-8126-4804-b141-2541cec15f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:09.207909 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11361b7-8126-4804-b141-2541cec15f89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:09.208089 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11361b7-8126-4804-b141-2541cec15f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:09.208365 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11361b7-8126-4804-b141-2541cec15f89 admin admin] PATH_INFO: `/v3/projects/e8b0328240694de5a2328a828ff69550` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:09.215087 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11361b7-8126-4804-b141-2541cec15f89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8b0328240694de5a2328a828ff69550)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:09.218667 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11361b7-8126-4804-b141-2541cec15f89 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:09.243522 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b76df1e-b954-438e-ac41-8c5364d7301f admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:09.246530 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e075078-8685-4d81-b2a4-7822677451f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:09.248102 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e075078-8685-4d81-b2a4-7822677451f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:09.248793 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e075078-8685-4d81-b2a4-7822677451f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:09.249739 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e075078-8685-4d81-b2a4-7822677451f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:09.251529 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e075078-8685-4d81-b2a4-7822677451f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:09.254391 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e075078-8685-4d81-b2a4-7822677451f3 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:09.277236 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 896/1790] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:30:09.277455 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d2b88-fd60-4582-b0cc-9a89680a6f58 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:09.278737 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d2b88-fd60-4582-b0cc-9a89680a6f58 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:09.279307 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d2b88-fd60-4582-b0cc-9a89680a6f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:09.339153 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-579d2b88-fd60-4582-b0cc-9a89680a6f58 None None] MFA Rules not processed for user `f6d1caa34f2b41bfbcc95fa58d85f004`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:09.341554 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-579d2b88-fd60-4582-b0cc-9a89680a6f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:09.357357 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 897/1791] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Aug 2 15:30:09 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:30:09.360298 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579d2b88-fd60-4582-b0cc-9a89680a6f58 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:09.373834 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:09.380814 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579d2b88-fd60-4582-b0cc-9a89680a6f58 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:09.425096 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-d11361b7-8126-4804-b141-2541cec15f89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8b0328240694de5a2328a828ff69550', 'request_id': 'req-d11361b7-8126-4804-b141-2541cec15f89'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:09.444417 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-d11361b7-8126-4804-b141-2541cec15f89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8b0328240694de5a2328a828ff69550', 'request_id': 'req-d11361b7-8126-4804-b141-2541cec15f89'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:09.460006 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-d11361b7-8126-4804-b141-2541cec15f89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8b0328240694de5a2328a828ff69550', 'request_id': 'req-d11361b7-8126-4804-b141-2541cec15f89'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:09.478106 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:09.496837 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-d11361b7-8126-4804-b141-2541cec15f89 admin admin] The token cache is being invalidate because project e8b0328240694de5a2328a828ff69550 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80360) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:30:09.512497 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-d11361b7-8126-4804-b141-2541cec15f89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:09.516437 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-d11361b7-8126-4804-b141-2541cec15f89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:09.539166 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 895/1792] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:30:09 2022] DELETE /identity/v3/projects/e8b0328240694de5a2328a828ff69550 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:09.541037 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11361b7-8126-4804-b141-2541cec15f89 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:09.543071 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-d11361b7-8126-4804-b141-2541cec15f89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:09.577358 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68763050-ddb5-45dd-a358-1af1952b0808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:09.578021 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68763050-ddb5-45dd-a358-1af1952b0808 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:09.578308 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68763050-ddb5-45dd-a358-1af1952b0808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:09.578585 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68763050-ddb5-45dd-a358-1af1952b0808 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:09.579337 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68763050-ddb5-45dd-a358-1af1952b0808 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:09.583393 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68763050-ddb5-45dd-a358-1af1952b0808 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:09.632193 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 898/1793] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:30:09.633372 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68763050-ddb5-45dd-a358-1af1952b0808 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:09.657775 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-68763050-ddb5-45dd-a358-1af1952b0808 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:09.808918 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11361b7-8126-4804-b141-2541cec15f89 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:09.834394 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e83c33c-e80b-4461-8a86-f93e11c6cc91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:09.835908 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83c33c-e80b-4461-8a86-f93e11c6cc91 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:09.836751 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83c33c-e80b-4461-8a86-f93e11c6cc91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:09.837254 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83c33c-e80b-4461-8a86-f93e11c6cc91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:09.838597 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e83c33c-e80b-4461-8a86-f93e11c6cc91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:09.846381 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e83c33c-e80b-4461-8a86-f93e11c6cc91 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:09.864870 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 896/1794] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:30:09.866459 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e83c33c-e80b-4461-8a86-f93e11c6cc91 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:09.871017 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-8e83c33c-e80b-4461-8a86-f93e11c6cc91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:09.892907 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e83c33c-e80b-4461-8a86-f93e11c6cc91 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:09.893097 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68763050-ddb5-45dd-a358-1af1952b0808 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:09.904478 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f19208-bea4-4ad4-9883-4ca92c2962ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:09.905307 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f19208-bea4-4ad4-9883-4ca92c2962ab service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:09.907875 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f19208-bea4-4ad4-9883-4ca92c2962ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:09.908383 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f19208-bea4-4ad4-9883-4ca92c2962ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:09.910354 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94c5794-192d-4cf3-9078-9f52a99f68a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:09.916881 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-22f19208-bea4-4ad4-9883-4ca92c2962ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:09.919974 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c5794-192d-4cf3-9078-9f52a99f68a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:09.920380 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c5794-192d-4cf3-9078-9f52a99f68a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:09.936067 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c5794-192d-4cf3-9078-9f52a99f68a2 admin admin] PATH_INFO: `/v3/projects/09d3ada2bad447b9bcaacd03cd2a30dd` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:09.940863 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94c5794-192d-4cf3-9078-9f52a99f68a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09d3ada2bad447b9bcaacd03cd2a30dd)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:09.945485 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f19208-bea4-4ad4-9883-4ca92c2962ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:09.946029 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94c5794-192d-4cf3-9078-9f52a99f68a2 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:09.961496 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f19208-bea4-4ad4-9883-4ca92c2962ab service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:09.984049 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 899/1795] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:30:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:30:09.986005 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f19208-bea4-4ad4-9883-4ca92c2962ab service neutron] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:09.992194 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-22f19208-bea4-4ad4-9883-4ca92c2962ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:10.033567 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f19208-bea4-4ad4-9883-4ca92c2962ab service neutron] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:10.039007 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af52c48-da61-4eba-97f7-9650d7dc413b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:10.039825 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af52c48-da61-4eba-97f7-9650d7dc413b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:10.040115 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af52c48-da61-4eba-97f7-9650d7dc413b admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:10.040395 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af52c48-da61-4eba-97f7-9650d7dc413b admin admin] PATH_INFO: `/v3/users/d23fa5fe96394d758fb6cecffba53b45` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:10.041673 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af52c48-da61-4eba-97f7-9650d7dc413b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d23fa5fe96394d758fb6cecffba53b45)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:10.044978 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af52c48-da61-4eba-97f7-9650d7dc413b admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:10.131397 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-e94c5794-192d-4cf3-9078-9f52a99f68a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09d3ada2bad447b9bcaacd03cd2a30dd', 'request_id': 'req-e94c5794-192d-4cf3-9078-9f52a99f68a2'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:10.143016 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-e94c5794-192d-4cf3-9078-9f52a99f68a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09d3ada2bad447b9bcaacd03cd2a30dd', 'request_id': 'req-e94c5794-192d-4cf3-9078-9f52a99f68a2'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:10.166197 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-e94c5794-192d-4cf3-9078-9f52a99f68a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09d3ada2bad447b9bcaacd03cd2a30dd', 'request_id': 'req-e94c5794-192d-4cf3-9078-9f52a99f68a2'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:10.171709 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-6af52c48-da61-4eba-97f7-9650d7dc413b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd23fa5fe96394d758fb6cecffba53b45'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:10.192859 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-e94c5794-192d-4cf3-9078-9f52a99f68a2 admin admin] The token cache is being invalidate because project 09d3ada2bad447b9bcaacd03cd2a30dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80360) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:30:10.193370 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-e94c5794-192d-4cf3-9078-9f52a99f68a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:10.194266 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-e94c5794-192d-4cf3-9078-9f52a99f68a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:10.200529 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 897/1796] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:30:09 2022] DELETE /identity/v3/projects/09d3ada2bad447b9bcaacd03cd2a30dd => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:10.201834 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94c5794-192d-4cf3-9078-9f52a99f68a2 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:10.208909 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-e94c5794-192d-4cf3-9078-9f52a99f68a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:10.210486 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-6af52c48-da61-4eba-97f7-9650d7dc413b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd23fa5fe96394d758fb6cecffba53b45'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:10.211579 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-6af52c48-da61-4eba-97f7-9650d7dc413b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd23fa5fe96394d758fb6cecffba53b45'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:10.227272 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-6af52c48-da61-4eba-97f7-9650d7dc413b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd23fa5fe96394d758fb6cecffba53b45'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:10.245147 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-6af52c48-da61-4eba-97f7-9650d7dc413b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd23fa5fe96394d758fb6cecffba53b45'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:10.272476 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 900/1797] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:30:09 2022] DELETE /identity/v3/users/d23fa5fe96394d758fb6cecffba53b45 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:10.272476 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af52c48-da61-4eba-97f7-9650d7dc413b admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:10.276467 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-6af52c48-da61-4eba-97f7-9650d7dc413b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:10.346304 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:10.413851 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94c5794-192d-4cf3-9078-9f52a99f68a2 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:10.435724 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:10.468510 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af52c48-da61-4eba-97f7-9650d7dc413b admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:10.493612 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034af249-b192-4506-a37a-d355fc2666f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:10.499009 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034af249-b192-4506-a37a-d355fc2666f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:10.503919 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034af249-b192-4506-a37a-d355fc2666f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:10.504412 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034af249-b192-4506-a37a-d355fc2666f7 admin admin] PATH_INFO: `/v3/projects/3cd2a0b3b0f54a6cb1bc9589416ea232/users/f00f251f323f41378e6e7f189f46498d/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:10.567269 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034af249-b192-4506-a37a-d355fc2666f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cd2a0b3b0f54a6cb1bc9589416ea232, user_id=f00f251f323f41378e6e7f189f46498d, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:10.581860 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034af249-b192-4506-a37a-d355fc2666f7 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:10.631164 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 901/1798] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:30:10 2022] PUT /identity/v3/projects/3cd2a0b3b0f54a6cb1bc9589416ea232/users/f00f251f323f41378e6e7f189f46498d/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:10.645509 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c281a70-34a5-40c4-856b-56f7600a74c8 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:10.646306 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6484c614-6975-4773-ae8f-fb78e256ac17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:10.646959 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484c614-6975-4773-ae8f-fb78e256ac17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:10.648285 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c281a70-34a5-40c4-856b-56f7600a74c8 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:10.650313 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484c614-6975-4773-ae8f-fb78e256ac17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:10.650709 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484c614-6975-4773-ae8f-fb78e256ac17 admin admin] PATH_INFO: `/v3/projects/89b7ce0bda2945c78f6944e7adb954b0/users/82fd1acdf42d4a1f88782d2cdbe6cebb/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:10.652200 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c281a70-34a5-40c4-856b-56f7600a74c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:10.703149 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6484c614-6975-4773-ae8f-fb78e256ac17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89b7ce0bda2945c78f6944e7adb954b0, user_id=82fd1acdf42d4a1f88782d2cdbe6cebb, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:10.713286 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6484c614-6975-4773-ae8f-fb78e256ac17 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:10.718037 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-2c281a70-34a5-40c4-856b-56f7600a74c8 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:10.719522 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-2c281a70-34a5-40c4-856b-56f7600a74c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:10.757755 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 898/1799] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:30:10 2022] PUT /identity/v3/projects/89b7ce0bda2945c78f6944e7adb954b0/users/82fd1acdf42d4a1f88782d2cdbe6cebb/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:10.759203 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d09299-567e-4efd-afa2-5502751151b4 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:10.759518 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d09299-567e-4efd-afa2-5502751151b4 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:10.763252 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d09299-567e-4efd-afa2-5502751151b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:10.855093 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 902/1800] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:30:10.856543 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c281a70-34a5-40c4-856b-56f7600a74c8 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:10.858170 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-2c281a70-34a5-40c4-856b-56f7600a74c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:10.875403 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-93d09299-567e-4efd-afa2-5502751151b4 None None] MFA Rules not processed for user `f00f251f323f41378e6e7f189f46498d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:10.879155 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-93d09299-567e-4efd-afa2-5502751151b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:10.902293 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c281a70-34a5-40c4-856b-56f7600a74c8 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:11.102293 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784e20e6-5703-408d-9077-6ab4713db2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:11.102921 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e20e6-5703-408d-9077-6ab4713db2fa admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:11.103205 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e20e6-5703-408d-9077-6ab4713db2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:11.103507 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e20e6-5703-408d-9077-6ab4713db2fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:11.104216 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784e20e6-5703-408d-9077-6ab4713db2fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:11.105855 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784e20e6-5703-408d-9077-6ab4713db2fa admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:11.130156 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 899/1801] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:30:11.140805 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0622e9e4-dcb6-4114-8c57-67e1f93f327f None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:11.141040 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0622e9e4-dcb6-4114-8c57-67e1f93f327f None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:11.141307 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0622e9e4-dcb6-4114-8c57-67e1f93f327f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:11.165940 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 903/1802] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:30:10 2022] GET /identity/v3/roles => generated 1420 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:30:11.174592 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784e20e6-5703-408d-9077-6ab4713db2fa admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:11.227954 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784e20e6-5703-408d-9077-6ab4713db2fa admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:11.235855 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-0622e9e4-dcb6-4114-8c57-67e1f93f327f None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:11.237118 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-0622e9e4-dcb6-4114-8c57-67e1f93f327f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:11.252206 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d8161-2c43-4e31-bb7c-eb9488e6107f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:11.254135 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d8161-2c43-4e31-bb7c-eb9488e6107f admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:11.254431 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d8161-2c43-4e31-bb7c-eb9488e6107f admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:11.254716 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d8161-2c43-4e31-bb7c-eb9488e6107f admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:11.255494 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791d8161-2c43-4e31-bb7c-eb9488e6107f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:11.282472 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791d8161-2c43-4e31-bb7c-eb9488e6107f admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:11.288052 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 900/1803] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:30:11.290478 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0622e9e4-dcb6-4114-8c57-67e1f93f327f None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:11.357289 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0622e9e4-dcb6-4114-8c57-67e1f93f327f None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:11.382154 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fd6cd8-6067-4576-8ae7-218132652b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:11.383772 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd6cd8-6067-4576-8ae7-218132652b97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:11.384514 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd6cd8-6067-4576-8ae7-218132652b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:11.385085 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd6cd8-6067-4576-8ae7-218132652b97 admin admin] PATH_INFO: `/v3/projects/89b7ce0bda2945c78f6944e7adb954b0/users/82fd1acdf42d4a1f88782d2cdbe6cebb/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:11.390400 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 904/1804] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:30:11 2022] POST /identity/v3/projects => generated 383 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:30:11.391539 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fd6cd8-6067-4576-8ae7-218132652b97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89b7ce0bda2945c78f6944e7adb954b0, user_id=82fd1acdf42d4a1f88782d2cdbe6cebb, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:11.391718 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d8161-2c43-4e31-bb7c-eb9488e6107f admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:11.402676 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fd6cd8-6067-4576-8ae7-218132652b97 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:11.437596 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 901/1805] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:30:11 2022] PUT /identity/v3/projects/89b7ce0bda2945c78f6944e7adb954b0/users/82fd1acdf42d4a1f88782d2cdbe6cebb/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:11.439539 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fd6cd8-6067-4576-8ae7-218132652b97 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:11.552244 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:11.583905 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d8161-2c43-4e31-bb7c-eb9488e6107f admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:11.625282 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:11.725811 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fd6cd8-6067-4576-8ae7-218132652b97 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:11.745705 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ea4b5-f1f0-47af-b068-5a2f62db02a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:11.747056 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ea4b5-f1f0-47af-b068-5a2f62db02a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:11.747451 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ea4b5-f1f0-47af-b068-5a2f62db02a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:11.748026 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ea4b5-f1f0-47af-b068-5a2f62db02a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:11.749597 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40ea4b5-f1f0-47af-b068-5a2f62db02a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:11.756648 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40ea4b5-f1f0-47af-b068-5a2f62db02a1 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:11.772167 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c62686-4300-461c-abcb-a71b20110f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:11.773796 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c62686-4300-461c-abcb-a71b20110f1b admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:11.774839 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c62686-4300-461c-abcb-a71b20110f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:11.775350 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c62686-4300-461c-abcb-a71b20110f1b admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:11.777452 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c62686-4300-461c-abcb-a71b20110f1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:30:11.805632 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 902/1806] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:30:11 2022] POST /identity/v3/users => generated 298 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:30:11.806979 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c21d56-33b9-4616-848f-4752fe954c60 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:11.807459 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c62686-4300-461c-abcb-a71b20110f1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:11.815334 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c21d56-33b9-4616-848f-4752fe954c60 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:11.815767 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c21d56-33b9-4616-848f-4752fe954c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:11.821060 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c62686-4300-461c-abcb-a71b20110f1b admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:11.880105 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-d6c21d56-33b9-4616-848f-4752fe954c60 None None] MFA Rules not processed for user `82fd1acdf42d4a1f88782d2cdbe6cebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:11.881456 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-d6c21d56-33b9-4616-848f-4752fe954c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:11.901741 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 905/1807] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 2 15:30:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 511 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:30:11.911685 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c62686-4300-461c-abcb-a71b20110f1b admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:11.918086 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-90c62686-4300-461c-abcb-a71b20110f1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:12.012101 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c62686-4300-461c-abcb-a71b20110f1b admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:12.032079 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d91e31-169e-45d0-b5b8-fbe388e4afa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:12.036619 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d91e31-169e-45d0-b5b8-fbe388e4afa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:12.038164 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d91e31-169e-45d0-b5b8-fbe388e4afa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:12.038395 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d91e31-169e-45d0-b5b8-fbe388e4afa9 admin admin] PATH_INFO: `/v3/projects/8893400fc01e40be80f0829e506ce414` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:12.046995 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d91e31-169e-45d0-b5b8-fbe388e4afa9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8893400fc01e40be80f0829e506ce414)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:12.057441 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d91e31-169e-45d0-b5b8-fbe388e4afa9 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:12.101322 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 903/1808] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:11 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:30:12.102396 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c21d56-33b9-4616-848f-4752fe954c60 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:12.128086 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c21d56-33b9-4616-848f-4752fe954c60 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:12.142721 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3994a42-ac36-4795-9ece-ced5a3b47005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:12.143617 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3994a42-ac36-4795-9ece-ced5a3b47005 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:12.143908 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3994a42-ac36-4795-9ece-ced5a3b47005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:12.144240 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3994a42-ac36-4795-9ece-ced5a3b47005 admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:12.145063 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3994a42-ac36-4795-9ece-ced5a3b47005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:12.147673 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3994a42-ac36-4795-9ece-ced5a3b47005 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:12.178862 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 904/1809] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:30:12 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:30:12.179867 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3994a42-ac36-4795-9ece-ced5a3b47005 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:12.203532 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3994a42-ac36-4795-9ece-ced5a3b47005 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:12.216667 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e0a857-94c2-42a9-8077-432d0f1541bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:12.218558 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e0a857-94c2-42a9-8077-432d0f1541bd admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:12.219396 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e0a857-94c2-42a9-8077-432d0f1541bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:12.220394 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e0a857-94c2-42a9-8077-432d0f1541bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:12.221195 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e0a857-94c2-42a9-8077-432d0f1541bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:12.227081 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e0a857-94c2-42a9-8077-432d0f1541bd admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:12.298186 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-a5d91e31-169e-45d0-b5b8-fbe388e4afa9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8893400fc01e40be80f0829e506ce414', 'request_id': 'req-a5d91e31-169e-45d0-b5b8-fbe388e4afa9'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:12.313884 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 905/1810] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:30:12 2022] POST /identity/v3/projects => generated 389 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:30:12.316924 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e0a857-94c2-42a9-8077-432d0f1541bd admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:12.337141 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-a5d91e31-169e-45d0-b5b8-fbe388e4afa9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8893400fc01e40be80f0829e506ce414', 'request_id': 'req-a5d91e31-169e-45d0-b5b8-fbe388e4afa9'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:12.338761 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-d9e0a857-94c2-42a9-8077-432d0f1541bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:12.378317 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-a5d91e31-169e-45d0-b5b8-fbe388e4afa9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8893400fc01e40be80f0829e506ce414', 'request_id': 'req-a5d91e31-169e-45d0-b5b8-fbe388e4afa9'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:12.413449 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-a5d91e31-169e-45d0-b5b8-fbe388e4afa9 admin admin] The token cache is being invalidate because project 8893400fc01e40be80f0829e506ce414 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:30:12.414148 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-a5d91e31-169e-45d0-b5b8-fbe388e4afa9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:12.417322 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-a5d91e31-169e-45d0-b5b8-fbe388e4afa9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:12.420735 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 906/1811] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:30:11 2022] DELETE /identity/v3/projects/8893400fc01e40be80f0829e506ce414 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:12.423297 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d91e31-169e-45d0-b5b8-fbe388e4afa9 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:12.425967 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-a5d91e31-169e-45d0-b5b8-fbe388e4afa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:12.524236 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e0a857-94c2-42a9-8077-432d0f1541bd admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:12.534458 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c565fdf6-e224-4311-8f05-46ea788c91b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:12.535567 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565fdf6-e224-4311-8f05-46ea788c91b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:12.536244 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565fdf6-e224-4311-8f05-46ea788c91b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:12.536775 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565fdf6-e224-4311-8f05-46ea788c91b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:12.540686 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-c565fdf6-e224-4311-8f05-46ea788c91b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:12.665696 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d91e31-169e-45d0-b5b8-fbe388e4afa9 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:12.724026 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:12.732126 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:12.787312 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c565fdf6-e224-4311-8f05-46ea788c91b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:12.790255 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c565fdf6-e224-4311-8f05-46ea788c91b9 service cinder] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:12.836919 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 906/1812] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:30:12 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:30:12.837897 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c565fdf6-e224-4311-8f05-46ea788c91b9 service cinder] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:12.841925 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-c565fdf6-e224-4311-8f05-46ea788c91b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:12.848775 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb51f6d-199f-4d8f-88f6-1112352e5bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:12.851477 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb51f6d-199f-4d8f-88f6-1112352e5bc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:12.851791 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb51f6d-199f-4d8f-88f6-1112352e5bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:12.854547 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb51f6d-199f-4d8f-88f6-1112352e5bc8 admin admin] PATH_INFO: `/v3/projects/5c64775e62374aa19a756a727db0b0d0/users/073f786c6a994aa992c5714c352ba621/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:12.892381 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c565fdf6-e224-4311-8f05-46ea788c91b9 service cinder] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:12.909119 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e997cc-393e-41ff-bb57-d95364ad468a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:12.909823 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e997cc-393e-41ff-bb57-d95364ad468a admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:12.910131 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e997cc-393e-41ff-bb57-d95364ad468a admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:12.910392 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e997cc-393e-41ff-bb57-d95364ad468a admin admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:12.914035 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e997cc-393e-41ff-bb57-d95364ad468a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:12.917681 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb51f6d-199f-4d8f-88f6-1112352e5bc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c64775e62374aa19a756a727db0b0d0, user_id=073f786c6a994aa992c5714c352ba621, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:12.919793 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e997cc-393e-41ff-bb57-d95364ad468a admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:12.929692 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb51f6d-199f-4d8f-88f6-1112352e5bc8 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:12.966616 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 907/1813] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:30:12 2022] PUT /identity/v3/projects/5c64775e62374aa19a756a727db0b0d0/users/073f786c6a994aa992c5714c352ba621/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:12.972310 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19517a16-9482-49cd-b6e8-33d5ba0d8ff7 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:12.972647 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19517a16-9482-49cd-b6e8-33d5ba0d8ff7 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:12.973128 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19517a16-9482-49cd-b6e8-33d5ba0d8ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:12.984098 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 907/1814] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:30:12 2022] POST /identity/v3/users => generated 295 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:30:12.988066 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c07f4-a929-4e67-b03a-b4e5444872ce None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:13.004430 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c07f4-a929-4e67-b03a-b4e5444872ce None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:13.009610 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c07f4-a929-4e67-b03a-b4e5444872ce None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:13.021230 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 908/1815] 10.222.0.42 () {54 vars in 921 bytes} [Tue Aug 2 15:30:12 2022] GET /identity => generated 270 bytes in 36 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:30:13.026470 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c07f4-a929-4e67-b03a-b4e5444872ce None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:13.027377 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-19517a16-9482-49cd-b6e8-33d5ba0d8ff7 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:13.032814 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-19517a16-9482-49cd-b6e8-33d5ba0d8ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:13.258787 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 908/1816] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:30:13.264953 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19517a16-9482-49cd-b6e8-33d5ba0d8ff7 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:13.293041 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19517a16-9482-49cd-b6e8-33d5ba0d8ff7 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:13.306925 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfd5fc8-2899-42e7-a225-6d53f1a79d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:13.309800 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd5fc8-2899-42e7-a225-6d53f1a79d96 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:13.311620 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd5fc8-2899-42e7-a225-6d53f1a79d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:13.313024 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd5fc8-2899-42e7-a225-6d53f1a79d96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:13.313906 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c07f4-a929-4e67-b03a-b4e5444872ce None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:13.324234 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfd5fc8-2899-42e7-a225-6d53f1a79d96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:13.324234 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfd5fc8-2899-42e7-a225-6d53f1a79d96 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:13.328331 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae0b930-9173-4702-bda5-a2fbc1f4cdea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:13.329472 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae0b930-9173-4702-bda5-a2fbc1f4cdea admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:13.329765 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae0b930-9173-4702-bda5-a2fbc1f4cdea admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:13.330040 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae0b930-9173-4702-bda5-a2fbc1f4cdea admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:13.334949 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae0b930-9173-4702-bda5-a2fbc1f4cdea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:13.349901 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 909/1817] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:30:13 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:30:13.351741 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0f885-ab45-4a35-bd62-e298a91cc979 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:13.352154 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0f885-ab45-4a35-bd62-e298a91cc979 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:13.352598 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0f885-ab45-4a35-bd62-e298a91cc979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:13.356893 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae0b930-9173-4702-bda5-a2fbc1f4cdea admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:13.408681 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-eae0f885-ab45-4a35-bd62-e298a91cc979 None None] MFA Rules not processed for user `4c0865af59bf43dfa4c84213d7db53c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:13.416610 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-eae0f885-ab45-4a35-bd62-e298a91cc979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:13.420152 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 909/1818] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:30:13 2022] GET /identity/v3/roles => generated 1420 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:30:13.424103 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5acf3-cb17-428b-9413-0a3fc3307106 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:13.424447 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5acf3-cb17-428b-9413-0a3fc3307106 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:13.424664 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5acf3-cb17-428b-9413-0a3fc3307106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:13.489439 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-cfd5acf3-cb17-428b-9413-0a3fc3307106 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:13.493967 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-cfd5acf3-cb17-428b-9413-0a3fc3307106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:13.526415 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 910/1819] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:30:13.529206 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5acf3-cb17-428b-9413-0a3fc3307106 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:13.554262 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5acf3-cb17-428b-9413-0a3fc3307106 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:13.566626 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b06a2ae-7596-4422-b65c-b922b8c18735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:13.567818 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06a2ae-7596-4422-b65c-b922b8c18735 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:13.569373 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06a2ae-7596-4422-b65c-b922b8c18735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:13.569734 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06a2ae-7596-4422-b65c-b922b8c18735 admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:13.571744 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b06a2ae-7596-4422-b65c-b922b8c18735 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:13.578580 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b06a2ae-7596-4422-b65c-b922b8c18735 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:13.608371 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 911/1820] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:30:13 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:30:13.609921 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd098597-86d2-479d-a986-267e431c3ba2 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:13.610485 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd098597-86d2-479d-a986-267e431c3ba2 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:13.611034 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd098597-86d2-479d-a986-267e431c3ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:13.665006 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 910/1821] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Aug 2 15:30:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:30:13.666219 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae0f885-ab45-4a35-bd62-e298a91cc979 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:13.710699 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-fd098597-86d2-479d-a986-267e431c3ba2 None None] MFA Rules not processed for user `77c9a03620d04b2a9f80ec16f9738670`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:13.730409 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-fd098597-86d2-479d-a986-267e431c3ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:13.741341 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae0f885-ab45-4a35-bd62-e298a91cc979 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:13.778591 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a63794e-1abb-4cee-a739-6e929c813998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:13.778591 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63794e-1abb-4cee-a739-6e929c813998 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:13.778865 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63794e-1abb-4cee-a739-6e929c813998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:13.779303 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63794e-1abb-4cee-a739-6e929c813998 admin admin] PATH_INFO: `/v3/projects/5c64775e62374aa19a756a727db0b0d0/users/073f786c6a994aa992c5714c352ba621/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:13.782222 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a63794e-1abb-4cee-a739-6e929c813998 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c64775e62374aa19a756a727db0b0d0, user_id=073f786c6a994aa992c5714c352ba621, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:13.810526 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a63794e-1abb-4cee-a739-6e929c813998 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:13.853855 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 911/1822] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:30:13 2022] PUT /identity/v3/projects/5c64775e62374aa19a756a727db0b0d0/users/073f786c6a994aa992c5714c352ba621/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:13.857618 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a63794e-1abb-4cee-a739-6e929c813998 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:13.900565 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:14.015120 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 912/1823] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:13 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:30:14.015120 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd098597-86d2-479d-a986-267e431c3ba2 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:14.026770 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd098597-86d2-479d-a986-267e431c3ba2 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:14.083239 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a63794e-1abb-4cee-a739-6e929c813998 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:14.089098 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:14.112280 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3834103b-e55d-4f6e-a09c-a0377c6a5cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:14.112280 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3834103b-e55d-4f6e-a09c-a0377c6a5cfd admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:14.118375 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3834103b-e55d-4f6e-a09c-a0377c6a5cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:14.118375 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3834103b-e55d-4f6e-a09c-a0377c6a5cfd admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:14.119402 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3834103b-e55d-4f6e-a09c-a0377c6a5cfd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:30:14.119873 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3834103b-e55d-4f6e-a09c-a0377c6a5cfd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:14.126876 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3834103b-e55d-4f6e-a09c-a0377c6a5cfd admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:14.162556 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f05ff3d-c917-4a3c-9ecc-b3fa08d0199d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:14.166457 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05ff3d-c917-4a3c-9ecc-b3fa08d0199d admin admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:14.167487 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05ff3d-c917-4a3c-9ecc-b3fa08d0199d admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:14.170458 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05ff3d-c917-4a3c-9ecc-b3fa08d0199d admin admin] PATH_INFO: `/v3/projects/0737ab339b4a41f4a2d89d3cc2fcf1a9/users/2b187c707faf4e1a8d0dda07191038df/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:14.238215 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f05ff3d-c917-4a3c-9ecc-b3fa08d0199d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0737ab339b4a41f4a2d89d3cc2fcf1a9, user_id=2b187c707faf4e1a8d0dda07191038df, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:14.252633 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 912/1824] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 2 15:30:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:30:14.259827 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc1437a-75b1-44a1-bd1e-bc49c8151182 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:14.260129 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc1437a-75b1-44a1-bd1e-bc49c8151182 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:14.260413 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc1437a-75b1-44a1-bd1e-bc49c8151182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:14.265575 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f05ff3d-c917-4a3c-9ecc-b3fa08d0199d admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:14.295234 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 913/1825] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:30:14 2022] PUT /identity/v3/projects/0737ab339b4a41f4a2d89d3cc2fcf1a9/users/2b187c707faf4e1a8d0dda07191038df/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:14.296317 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f05ff3d-c917-4a3c-9ecc-b3fa08d0199d admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:14.298187 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-2f05ff3d-c917-4a3c-9ecc-b3fa08d0199d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:14.336036 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-6bc1437a-75b1-44a1-bd1e-bc49c8151182 None None] MFA Rules not processed for user `073f786c6a994aa992c5714c352ba621`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:14.339119 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-6bc1437a-75b1-44a1-bd1e-bc49c8151182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:14.529414 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 913/1826] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:14 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:30:14.531098 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc1437a-75b1-44a1-bd1e-bc49c8151182 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:14.546951 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f05ff3d-c917-4a3c-9ecc-b3fa08d0199d admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:14.557827 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3828fd08-40a4-45fb-aaa6-b9bba29d1472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:14.560507 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828fd08-40a4-45fb-aaa6-b9bba29d1472 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:14.561558 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828fd08-40a4-45fb-aaa6-b9bba29d1472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:14.562580 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828fd08-40a4-45fb-aaa6-b9bba29d1472 admin admin] PATH_INFO: `/v3/users/5b7374a5754c423189ecebc59e1b7493` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:14.565935 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3828fd08-40a4-45fb-aaa6-b9bba29d1472 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b7374a5754c423189ecebc59e1b7493)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:14.578787 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc1437a-75b1-44a1-bd1e-bc49c8151182 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:14.579783 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3828fd08-40a4-45fb-aaa6-b9bba29d1472 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:14.592300 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dad17d-e973-4a1a-882c-101615dde979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:14.592951 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dad17d-e973-4a1a-882c-101615dde979 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:14.593234 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dad17d-e973-4a1a-882c-101615dde979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:14.593506 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dad17d-e973-4a1a-882c-101615dde979 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:14.596635 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dad17d-e973-4a1a-882c-101615dde979 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:14.600645 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dad17d-e973-4a1a-882c-101615dde979 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:14.737936 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 914/1827] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:30:14 2022] POST /identity/v3/projects => generated 363 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:30:14.740728 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ca884-ccda-4a40-af51-0fba938776c7 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:14.741029 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ca884-ccda-4a40-af51-0fba938776c7 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:14.743695 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ca884-ccda-4a40-af51-0fba938776c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:14.769658 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-3828fd08-40a4-45fb-aaa6-b9bba29d1472 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b7374a5754c423189ecebc59e1b7493'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:14.833377 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-3828fd08-40a4-45fb-aaa6-b9bba29d1472 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b7374a5754c423189ecebc59e1b7493'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:14.857877 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-ee6ca884-ccda-4a40-af51-0fba938776c7 None None] MFA Rules not processed for user `2b187c707faf4e1a8d0dda07191038df`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:14.860454 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-ee6ca884-ccda-4a40-af51-0fba938776c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:14.863641 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-3828fd08-40a4-45fb-aaa6-b9bba29d1472 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b7374a5754c423189ecebc59e1b7493'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:14.865019 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-3828fd08-40a4-45fb-aaa6-b9bba29d1472 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b7374a5754c423189ecebc59e1b7493'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:14.866438 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-3828fd08-40a4-45fb-aaa6-b9bba29d1472 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b7374a5754c423189ecebc59e1b7493'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:14.906980 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 914/1828] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:30:14 2022] DELETE /identity/v3/users/5b7374a5754c423189ecebc59e1b7493 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:14.909343 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3828fd08-40a4-45fb-aaa6-b9bba29d1472 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:14.915592 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-3828fd08-40a4-45fb-aaa6-b9bba29d1472 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:15.038468 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:15.040019 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:15.057258 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 915/1829] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:14 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:30:15.060768 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6ca884-ccda-4a40-af51-0fba938776c7 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:15.065715 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-ee6ca884-ccda-4a40-af51-0fba938776c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:15.079567 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3828fd08-40a4-45fb-aaa6-b9bba29d1472 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:15.094485 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f0eab4-8fca-40d7-8c58-99e5583acce2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:15.095387 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0eab4-8fca-40d7-8c58-99e5583acce2 service cinder] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:15.095714 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0eab4-8fca-40d7-8c58-99e5583acce2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:15.096177 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0eab4-8fca-40d7-8c58-99e5583acce2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:15.101787 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-f9f0eab4-8fca-40d7-8c58-99e5583acce2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:15.230159 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6ca884-ccda-4a40-af51-0fba938776c7 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:15.269721 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f0eab4-8fca-40d7-8c58-99e5583acce2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:15.271194 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f0eab4-8fca-40d7-8c58-99e5583acce2 service cinder] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:15.307366 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 915/1830] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:30:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:30:15.308511 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f0eab4-8fca-40d7-8c58-99e5583acce2 service cinder] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:15.317480 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-f9f0eab4-8fca-40d7-8c58-99e5583acce2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:15.322328 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d7cc79-eaa9-4b94-9c29-255c0c2eb8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:15.323108 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7cc79-eaa9-4b94-9c29-255c0c2eb8d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:15.323522 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7cc79-eaa9-4b94-9c29-255c0c2eb8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:15.323898 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7cc79-eaa9-4b94-9c29-255c0c2eb8d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:15.324833 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d7cc79-eaa9-4b94-9c29-255c0c2eb8d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:15.327840 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d7cc79-eaa9-4b94-9c29-255c0c2eb8d6 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:15.361190 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 916/1831] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:30:15 2022] POST /identity/v3/users => generated 282 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:30:15.363648 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518d319-e6f9-4f71-86ff-4b5ca14b832d None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:15.364046 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518d319-e6f9-4f71-86ff-4b5ca14b832d None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:15.364427 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518d319-e6f9-4f71-86ff-4b5ca14b832d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:15.386175 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-3518d319-e6f9-4f71-86ff-4b5ca14b832d None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:15.388009 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-3518d319-e6f9-4f71-86ff-4b5ca14b832d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:15.405221 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 917/1832] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:30:15.406239 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3518d319-e6f9-4f71-86ff-4b5ca14b832d None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:15.407753 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-3518d319-e6f9-4f71-86ff-4b5ca14b832d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:15.424714 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3518d319-e6f9-4f71-86ff-4b5ca14b832d None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:15.442188 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e0c150-66a5-48f6-8487-7e052a8bf7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:15.443287 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e0c150-66a5-48f6-8487-7e052a8bf7bf admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:15.443536 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e0c150-66a5-48f6-8487-7e052a8bf7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:15.445064 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e0c150-66a5-48f6-8487-7e052a8bf7bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:15.445444 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e0c150-66a5-48f6-8487-7e052a8bf7bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:15.449935 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e0c150-66a5-48f6-8487-7e052a8bf7bf admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:15.491575 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f0eab4-8fca-40d7-8c58-99e5583acce2 service cinder] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:15.499255 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234bc043-ebf1-4117-a25c-a5bc131c168a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0865af59bf43dfa4c84213d7db53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:15.499904 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234bc043-ebf1-4117-a25c-a5bc131c168a service nova] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:15.500236 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234bc043-ebf1-4117-a25c-a5bc131c168a service nova] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:15.500528 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234bc043-ebf1-4117-a25c-a5bc131c168a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:15.501262 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 918/1833] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:30:15 2022] POST /identity/v3/projects => generated 387 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:30:15.502753 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-234bc043-ebf1-4117-a25c-a5bc131c168a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:15.505271 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e0c150-66a5-48f6-8487-7e052a8bf7bf admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:15.528642 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234bc043-ebf1-4117-a25c-a5bc131c168a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:15.530271 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234bc043-ebf1-4117-a25c-a5bc131c168a service nova] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:15.556499 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 916/1834] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:30:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:30:15.557476 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234bc043-ebf1-4117-a25c-a5bc131c168a service nova] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:15.564559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-234bc043-ebf1-4117-a25c-a5bc131c168a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:15.646418 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e0c150-66a5-48f6-8487-7e052a8bf7bf admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:15.681282 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731bb358-3e76-45d8-baff-8446f0a3e9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:15.682446 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731bb358-3e76-45d8-baff-8446f0a3e9a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:15.685324 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731bb358-3e76-45d8-baff-8446f0a3e9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:15.686072 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731bb358-3e76-45d8-baff-8446f0a3e9a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:15.687000 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731bb358-3e76-45d8-baff-8446f0a3e9a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:15.688881 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731bb358-3e76-45d8-baff-8446f0a3e9a7 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:15.701683 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234bc043-ebf1-4117-a25c-a5bc131c168a service nova] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:15.718634 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 919/1835] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:30:15.719679 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731bb358-3e76-45d8-baff-8446f0a3e9a7 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:15.731339 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:15.740927 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731bb358-3e76-45d8-baff-8446f0a3e9a7 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:15.752620 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103fbbff-1dc4-4c58-8add-e2da683e214c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:15.754925 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103fbbff-1dc4-4c58-8add-e2da683e214c admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:15.755527 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103fbbff-1dc4-4c58-8add-e2da683e214c admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:15.755979 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103fbbff-1dc4-4c58-8add-e2da683e214c admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:15.757137 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103fbbff-1dc4-4c58-8add-e2da683e214c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:15.760532 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103fbbff-1dc4-4c58-8add-e2da683e214c admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:15.788293 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:15.800951 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 920/1836] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:30:15 2022] POST /identity/v3/users => generated 300 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:30:15.800951 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103fbbff-1dc4-4c58-8add-e2da683e214c admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:15.840261 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f04e1-e8e6-4d4b-bdee-f366383c2ee7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:15.841046 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f04e1-e8e6-4d4b-bdee-f366383c2ee7 service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:15.841396 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f04e1-e8e6-4d4b-bdee-f366383c2ee7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:15.841742 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f04e1-e8e6-4d4b-bdee-f366383c2ee7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:15.855431 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103fbbff-1dc4-4c58-8add-e2da683e214c admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:15.872338 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1bf6c-2cfa-4bca-bdd7-7986daf6a0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:15.872967 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1bf6c-2cfa-4bca-bdd7-7986daf6a0c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:15.873260 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1bf6c-2cfa-4bca-bdd7-7986daf6a0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:15.873375 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202f04e1-e8e6-4d4b-bdee-f366383c2ee7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:15.873538 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1bf6c-2cfa-4bca-bdd7-7986daf6a0c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:15.874303 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b1bf6c-2cfa-4bca-bdd7-7986daf6a0c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:15.875152 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202f04e1-e8e6-4d4b-bdee-f366383c2ee7 service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:15.883967 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b1bf6c-2cfa-4bca-bdd7-7986daf6a0c7 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:15.904844 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 917/1837] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:30:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:30:15.909852 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f04e1-e8e6-4d4b-bdee-f366383c2ee7 service neutron] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:15.933729 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 921/1838] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:30:15.933729 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1bf6c-2cfa-4bca-bdd7-7986daf6a0c7 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:15.947207 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f04e1-e8e6-4d4b-bdee-f366383c2ee7 service neutron] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:15.957752 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1bf6c-2cfa-4bca-bdd7-7986daf6a0c7 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:15.961188 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa80cd0c-9cb5-463d-8262-89b0df8e525c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:15.961818 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80cd0c-9cb5-463d-8262-89b0df8e525c admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:15.962096 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80cd0c-9cb5-463d-8262-89b0df8e525c admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:15.962370 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80cd0c-9cb5-463d-8262-89b0df8e525c admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:15.963066 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa80cd0c-9cb5-463d-8262-89b0df8e525c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:15.965337 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa80cd0c-9cb5-463d-8262-89b0df8e525c admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:15.974298 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce877c-21df-40e8-9239-87d763198e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:15.974986 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce877c-21df-40e8-9239-87d763198e85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:15.975303 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce877c-21df-40e8-9239-87d763198e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:15.975582 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce877c-21df-40e8-9239-87d763198e85 admin admin] PATH_INFO: `/v3/projects/3d2cd770e4ff4b1fa592cceb6656fa6b/users/efc11b252f2c40d0ad1b392e95de7280/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:15.989687 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 918/1839] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:30:15.994881 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa80cd0c-9cb5-463d-8262-89b0df8e525c admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:16.008040 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce877c-21df-40e8-9239-87d763198e85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d2cd770e4ff4b1fa592cceb6656fa6b, user_id=efc11b252f2c40d0ad1b392e95de7280, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:16.012578 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce877c-21df-40e8-9239-87d763198e85 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:16.017403 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa80cd0c-9cb5-463d-8262-89b0df8e525c admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:16.032816 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b2919-fa7a-497e-9546-da79ee15ab32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:16.033515 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b2919-fa7a-497e-9546-da79ee15ab32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:16.033791 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b2919-fa7a-497e-9546-da79ee15ab32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:16.034068 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b2919-fa7a-497e-9546-da79ee15ab32 admin admin] PATH_INFO: `/v3/projects/48bc5bf8fd93431188f799884fcac841/users/4fbef2d9c53c429c8435d645a019699b/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:16.040100 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 922/1840] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:30:15 2022] PUT /identity/v3/projects/3d2cd770e4ff4b1fa592cceb6656fa6b/users/efc11b252f2c40d0ad1b392e95de7280/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:16.053473 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf8688-7b4a-494a-9b37-230e5bee9547 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:16.053750 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf8688-7b4a-494a-9b37-230e5bee9547 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:16.054174 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf8688-7b4a-494a-9b37-230e5bee9547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:16.071260 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b2919-fa7a-497e-9546-da79ee15ab32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48bc5bf8fd93431188f799884fcac841, user_id=4fbef2d9c53c429c8435d645a019699b, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:16.080688 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b2919-fa7a-497e-9546-da79ee15ab32 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:16.117997 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 919/1841] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:30:15 2022] PUT /identity/v3/projects/48bc5bf8fd93431188f799884fcac841/users/4fbef2d9c53c429c8435d645a019699b/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:16.118960 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b2919-fa7a-497e-9546-da79ee15ab32 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:16.125591 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-79bf8688-7b4a-494a-9b37-230e5bee9547 None None] MFA Rules not processed for user `efc11b252f2c40d0ad1b392e95de7280`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:16.127107 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-79bf8688-7b4a-494a-9b37-230e5bee9547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:16.302270 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 923/1842] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:30:16.304597 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf8688-7b4a-494a-9b37-230e5bee9547 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:16.307773 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b2919-fa7a-497e-9546-da79ee15ab32 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:16.318100 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd3e06-278c-44ba-86ae-a85d79cc947e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:16.319133 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd3e06-278c-44ba-86ae-a85d79cc947e admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:16.319748 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf8688-7b4a-494a-9b37-230e5bee9547 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:16.320023 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd3e06-278c-44ba-86ae-a85d79cc947e admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:16.320445 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd3e06-278c-44ba-86ae-a85d79cc947e admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:16.322352 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fd3e06-278c-44ba-86ae-a85d79cc947e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:16.324689 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fd3e06-278c-44ba-86ae-a85d79cc947e admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:16.333165 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc2e3b-a4f3-400c-8479-fab340021525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:16.334558 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc2e3b-a4f3-400c-8479-fab340021525 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:16.334992 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc2e3b-a4f3-400c-8479-fab340021525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:16.335474 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc2e3b-a4f3-400c-8479-fab340021525 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:16.336331 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cc2e3b-a4f3-400c-8479-fab340021525 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:16.345228 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 920/1843] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:30:16 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:30:16.347078 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e9b2b-a5f8-4bf8-bfc0-4bbd622fd84f None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:16.347544 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e9b2b-a5f8-4bf8-bfc0-4bbd622fd84f None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:16.347977 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e9b2b-a5f8-4bf8-bfc0-4bbd622fd84f None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:16.349827 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 921/1844] 10.222.0.42 () {54 vars in 921 bytes} [Tue Aug 2 15:30:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:30:16.350897 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07e9b2b-a5f8-4bf8-bfc0-4bbd622fd84f None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:16.358471 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cc2e3b-a4f3-400c-8479-fab340021525 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:16.378928 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07e9b2b-a5f8-4bf8-bfc0-4bbd622fd84f None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:16.403372 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa06c733-1c85-4b2a-ae5d-5c040d09542d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:16.405272 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06c733-1c85-4b2a-ae5d-5c040d09542d admin admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:16.406640 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06c733-1c85-4b2a-ae5d-5c040d09542d admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:16.407032 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06c733-1c85-4b2a-ae5d-5c040d09542d admin admin] PATH_INFO: `/v3/projects/48bc5bf8fd93431188f799884fcac841/users/4fbef2d9c53c429c8435d645a019699b/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:16.412026 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa06c733-1c85-4b2a-ae5d-5c040d09542d admin admin] RBAC: Authorizing `identity:create_grant(project_id=48bc5bf8fd93431188f799884fcac841, user_id=4fbef2d9c53c429c8435d645a019699b, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:16.416692 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa06c733-1c85-4b2a-ae5d-5c040d09542d admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:16.432268 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 924/1845] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:30:16 2022] POST /identity/v3/projects => generated 363 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:30:16.432268 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8bfdef-b101-45a2-ae11-c5c69b3b4053 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:16.432268 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8bfdef-b101-45a2-ae11-c5c69b3b4053 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:16.432268 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8bfdef-b101-45a2-ae11-c5c69b3b4053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:16.459297 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 922/1846] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:30:16 2022] PUT /identity/v3/projects/48bc5bf8fd93431188f799884fcac841/users/4fbef2d9c53c429c8435d645a019699b/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:16.459297 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa06c733-1c85-4b2a-ae5d-5c040d09542d admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:16.468976 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-eb8bfdef-b101-45a2-ae11-c5c69b3b4053 None None] MFA Rules not processed for user `4c0865af59bf43dfa4c84213d7db53c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:16.470607 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-eb8bfdef-b101-45a2-ae11-c5c69b3b4053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:16.557249 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa06c733-1c85-4b2a-ae5d-5c040d09542d admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:16.563202 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440eb6d6-6d03-4922-8276-01cccf16ec81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:16.564163 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440eb6d6-6d03-4922-8276-01cccf16ec81 admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:16.564456 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440eb6d6-6d03-4922-8276-01cccf16ec81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:16.564733 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440eb6d6-6d03-4922-8276-01cccf16ec81 admin admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:16.565456 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440eb6d6-6d03-4922-8276-01cccf16ec81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:16.567430 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440eb6d6-6d03-4922-8276-01cccf16ec81 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:16.573328 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 925/1847] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Aug 2 15:30:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:30:16.574988 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0883a8-ce57-43ca-8b35-57fef9586740 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:16.575322 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0883a8-ce57-43ca-8b35-57fef9586740 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:16.575607 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0883a8-ce57-43ca-8b35-57fef9586740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:16.609730 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 923/1848] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:30:16 2022] POST /identity/v3/users => generated 288 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:30:16.609730 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440eb6d6-6d03-4922-8276-01cccf16ec81 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:16.610119 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-440eb6d6-6d03-4922-8276-01cccf16ec81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:16.612424 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:16.633413 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-7a0883a8-ce57-43ca-8b35-57fef9586740 None None] MFA Rules not processed for user `4fbef2d9c53c429c8435d645a019699b`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:16.634670 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-7a0883a8-ce57-43ca-8b35-57fef9586740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:16.638502 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440eb6d6-6d03-4922-8276-01cccf16ec81 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:16.645615 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567fa28f-766e-4289-b9b6-a13575ef98ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0865af59bf43dfa4c84213d7db53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:16.646311 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567fa28f-766e-4289-b9b6-a13575ef98ab service nova] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:16.646612 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567fa28f-766e-4289-b9b6-a13575ef98ab service nova] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:16.646898 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567fa28f-766e-4289-b9b6-a13575ef98ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:16.657157 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567fa28f-766e-4289-b9b6-a13575ef98ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:16.659403 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567fa28f-766e-4289-b9b6-a13575ef98ab service nova] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:16.671116 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 924/1849] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:30:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:30:16.671875 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567fa28f-766e-4289-b9b6-a13575ef98ab service nova] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:16.673224 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-567fa28f-766e-4289-b9b6-a13575ef98ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:16.682311 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:16.692701 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567fa28f-766e-4289-b9b6-a13575ef98ab service nova] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:16.699611 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71562d5d-df99-4df4-b59f-71ae542e4df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:16.700274 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71562d5d-df99-4df4-b59f-71ae542e4df4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:16.700568 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71562d5d-df99-4df4-b59f-71ae542e4df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:16.700846 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71562d5d-df99-4df4-b59f-71ae542e4df4 admin admin] PATH_INFO: `/v3/projects/4fcb8f6af59b4c039b9439aefbedcf47` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:16.702013 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71562d5d-df99-4df4-b59f-71ae542e4df4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fcb8f6af59b4c039b9439aefbedcf47)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:16.704030 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71562d5d-df99-4df4-b59f-71ae542e4df4 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:16.724000 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 926/1850] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:16 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:30:16.724000 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0883a8-ce57-43ca-8b35-57fef9586740 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:16.752821 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0883a8-ce57-43ca-8b35-57fef9586740 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:16.762482 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c96ae48-d41d-4220-a943-35f5bf13194e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:16.764784 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c96ae48-d41d-4220-a943-35f5bf13194e admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:16.765379 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c96ae48-d41d-4220-a943-35f5bf13194e admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:16.766213 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c96ae48-d41d-4220-a943-35f5bf13194e admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:16.766399 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c96ae48-d41d-4220-a943-35f5bf13194e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:16.768405 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c96ae48-d41d-4220-a943-35f5bf13194e admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:16.782129 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-71562d5d-df99-4df4-b59f-71ae542e4df4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fcb8f6af59b4c039b9439aefbedcf47', 'request_id': 'req-71562d5d-df99-4df4-b59f-71ae542e4df4'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:16.783158 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 927/1851] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:30:16 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:30:16.785255 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c96ae48-d41d-4220-a943-35f5bf13194e admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:16.791977 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-71562d5d-df99-4df4-b59f-71ae542e4df4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fcb8f6af59b4c039b9439aefbedcf47', 'request_id': 'req-71562d5d-df99-4df4-b59f-71ae542e4df4'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:16.800701 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-71562d5d-df99-4df4-b59f-71ae542e4df4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fcb8f6af59b4c039b9439aefbedcf47', 'request_id': 'req-71562d5d-df99-4df4-b59f-71ae542e4df4'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:16.818045 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-71562d5d-df99-4df4-b59f-71ae542e4df4 admin admin] The token cache is being invalidate because project 4fcb8f6af59b4c039b9439aefbedcf47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80360) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:30:16.819706 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-71562d5d-df99-4df4-b59f-71ae542e4df4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:16.819993 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-71562d5d-df99-4df4-b59f-71ae542e4df4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:16.824957 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 925/1852] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:30:16 2022] DELETE /identity/v3/projects/4fcb8f6af59b4c039b9439aefbedcf47 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:16.825875 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71562d5d-df99-4df4-b59f-71ae542e4df4 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:16.828184 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-71562d5d-df99-4df4-b59f-71ae542e4df4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:16.863399 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c96ae48-d41d-4220-a943-35f5bf13194e admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:16.899518 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71562d5d-df99-4df4-b59f-71ae542e4df4 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:16.904689 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cbe312-6ec6-425e-bea8-0207f574d94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:16.905366 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cbe312-6ec6-425e-bea8-0207f574d94c admin admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:16.905655 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cbe312-6ec6-425e-bea8-0207f574d94c admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:16.905935 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cbe312-6ec6-425e-bea8-0207f574d94c admin admin] PATH_INFO: `/v3/projects/037f1340cbc54dd3acd3dc7b9734019c/users/196a6fb8e25f4d77983addaf60167d11/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:16.916308 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92872e8d-b9c6-4171-94a6-ef15d078fa95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:16.916926 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92872e8d-b9c6-4171-94a6-ef15d078fa95 service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:16.917206 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92872e8d-b9c6-4171-94a6-ef15d078fa95 service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:16.917482 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92872e8d-b9c6-4171-94a6-ef15d078fa95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:16.920118 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-92872e8d-b9c6-4171-94a6-ef15d078fa95 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:16.921491 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cbe312-6ec6-425e-bea8-0207f574d94c admin admin] RBAC: Authorizing `identity:create_grant(project_id=037f1340cbc54dd3acd3dc7b9734019c, user_id=196a6fb8e25f4d77983addaf60167d11, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:16.924176 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cbe312-6ec6-425e-bea8-0207f574d94c admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:16.943559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 926/1853] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:30:16 2022] PUT /identity/v3/projects/037f1340cbc54dd3acd3dc7b9734019c/users/196a6fb8e25f4d77983addaf60167d11/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:16.944241 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cbe312-6ec6-425e-bea8-0207f574d94c admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:16.948038 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-c3cbe312-6ec6-425e-bea8-0207f574d94c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:16.986246 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:17.000029 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92872e8d-b9c6-4171-94a6-ef15d078fa95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:17.001682 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92872e8d-b9c6-4171-94a6-ef15d078fa95 service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:17.014071 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 928/1854] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:30:16 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:30:17.014814 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cbe312-6ec6-425e-bea8-0207f574d94c admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:17.015039 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92872e8d-b9c6-4171-94a6-ef15d078fa95 service cinder] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:17.020388 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b2af9-47ae-4bae-bd20-dc8644b9c85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:17.021114 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b2af9-47ae-4bae-bd20-dc8644b9c85a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:17.021533 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b2af9-47ae-4bae-bd20-dc8644b9c85a admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:17.021867 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b2af9-47ae-4bae-bd20-dc8644b9c85a admin admin] PATH_INFO: `/v3/users/82fd1acdf42d4a1f88782d2cdbe6cebb` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:17.023334 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971b2af9-47ae-4bae-bd20-dc8644b9c85a admin admin] RBAC: Authorizing `identity:delete_user(user_id=82fd1acdf42d4a1f88782d2cdbe6cebb)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:17.025521 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971b2af9-47ae-4bae-bd20-dc8644b9c85a admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:17.027652 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92872e8d-b9c6-4171-94a6-ef15d078fa95 service cinder] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:17.040638 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c8c7a-e623-48a2-8675-05f799bc4593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:17.040638 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c8c7a-e623-48a2-8675-05f799bc4593 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:17.040638 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c8c7a-e623-48a2-8675-05f799bc4593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:17.040638 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c8c7a-e623-48a2-8675-05f799bc4593 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:17.041465 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507c8c7a-e623-48a2-8675-05f799bc4593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:17.041465 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507c8c7a-e623-48a2-8675-05f799bc4593 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:17.058295 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:17.064258 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 929/1855] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:30:17 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:30:17.068754 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c8c7a-e623-48a2-8675-05f799bc4593 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:17.085365 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c8c7a-e623-48a2-8675-05f799bc4593 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:17.095327 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea472efe-3e87-402c-b1c4-e462c06c9115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:17.096218 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea472efe-3e87-402c-b1c4-e462c06c9115 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:17.096541 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea472efe-3e87-402c-b1c4-e462c06c9115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:17.096918 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea472efe-3e87-402c-b1c4-e462c06c9115 admin admin] PATH_INFO: `/v3/projects/037f1340cbc54dd3acd3dc7b9734019c/users/196a6fb8e25f4d77983addaf60167d11/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:17.101493 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea472efe-3e87-402c-b1c4-e462c06c9115 admin admin] RBAC: Authorizing `identity:create_grant(project_id=037f1340cbc54dd3acd3dc7b9734019c, user_id=196a6fb8e25f4d77983addaf60167d11, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:17.105531 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea472efe-3e87-402c-b1c4-e462c06c9115 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:17.118011 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-971b2af9-47ae-4bae-bd20-dc8644b9c85a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82fd1acdf42d4a1f88782d2cdbe6cebb'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:17.119837 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 930/1856] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:30:17 2022] PUT /identity/v3/projects/037f1340cbc54dd3acd3dc7b9734019c/users/196a6fb8e25f4d77983addaf60167d11/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 15:30:17.129312 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-971b2af9-47ae-4bae-bd20-dc8644b9c85a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82fd1acdf42d4a1f88782d2cdbe6cebb'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:17.136230 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d434f9e-c701-468b-8a85-f82fb994a6c1 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:17.136668 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d434f9e-c701-468b-8a85-f82fb994a6c1 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:17.137063 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d434f9e-c701-468b-8a85-f82fb994a6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:17.145061 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-971b2af9-47ae-4bae-bd20-dc8644b9c85a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82fd1acdf42d4a1f88782d2cdbe6cebb'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:17.158412 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-971b2af9-47ae-4bae-bd20-dc8644b9c85a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82fd1acdf42d4a1f88782d2cdbe6cebb'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:17.158412 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-971b2af9-47ae-4bae-bd20-dc8644b9c85a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82fd1acdf42d4a1f88782d2cdbe6cebb'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:17.178057 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 927/1857] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:30:16 2022] DELETE /identity/v3/users/82fd1acdf42d4a1f88782d2cdbe6cebb => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:17.186011 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-6d434f9e-c701-468b-8a85-f82fb994a6c1 None None] MFA Rules not processed for user `196a6fb8e25f4d77983addaf60167d11`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:17.187586 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-6d434f9e-c701-468b-8a85-f82fb994a6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:17.218794 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b2af9-47ae-4bae-bd20-dc8644b9c85a admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:17.220333 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-971b2af9-47ae-4bae-bd20-dc8644b9c85a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:17.296106 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 931/1858] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:17 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:30:17.306944 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d434f9e-c701-468b-8a85-f82fb994a6c1 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:17.308487 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-6d434f9e-c701-468b-8a85-f82fb994a6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:17.321503 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b2af9-47ae-4bae-bd20-dc8644b9c85a admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:17.327963 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf5d13c-ac83-4a56-b6ab-e821f4af723e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:17.328685 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5d13c-ac83-4a56-b6ab-e821f4af723e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:17.328979 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5d13c-ac83-4a56-b6ab-e821f4af723e admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:17.329312 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5d13c-ac83-4a56-b6ab-e821f4af723e admin admin] PATH_INFO: `/v3/users/2b187c707faf4e1a8d0dda07191038df` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:17.330535 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf5d13c-ac83-4a56-b6ab-e821f4af723e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b187c707faf4e1a8d0dda07191038df)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:17.332932 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf5d13c-ac83-4a56-b6ab-e821f4af723e admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:17.396275 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d434f9e-c701-468b-8a85-f82fb994a6c1 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:17.400139 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8061655e-87d2-48e7-b159-4ed22068504c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:17.400883 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061655e-87d2-48e7-b159-4ed22068504c service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:17.401160 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061655e-87d2-48e7-b159-4ed22068504c service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:17.401440 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061655e-87d2-48e7-b159-4ed22068504c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:17.414205 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8061655e-87d2-48e7-b159-4ed22068504c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:17.415504 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-5bf5d13c-ac83-4a56-b6ab-e821f4af723e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b187c707faf4e1a8d0dda07191038df'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:17.415830 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8061655e-87d2-48e7-b159-4ed22068504c service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:17.423629 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-5bf5d13c-ac83-4a56-b6ab-e821f4af723e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b187c707faf4e1a8d0dda07191038df'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:17.428611 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 932/1859] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:30:17 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 15:30:17.447988 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-5bf5d13c-ac83-4a56-b6ab-e821f4af723e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b187c707faf4e1a8d0dda07191038df'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:17.448844 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-5bf5d13c-ac83-4a56-b6ab-e821f4af723e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b187c707faf4e1a8d0dda07191038df'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:17.450136 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-5bf5d13c-ac83-4a56-b6ab-e821f4af723e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b187c707faf4e1a8d0dda07191038df'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:17.476879 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 928/1860] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:30:17 2022] DELETE /identity/v3/users/2b187c707faf4e1a8d0dda07191038df => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 15:30:17.477661 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8fbaa-233f-42e9-a3d0-648ba2a28843 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:17.477960 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8fbaa-233f-42e9-a3d0-648ba2a28843 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:17.478241 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8fbaa-233f-42e9-a3d0-648ba2a28843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:17.505254 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-07e8fbaa-233f-42e9-a3d0-648ba2a28843 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:17.506664 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-07e8fbaa-233f-42e9-a3d0-648ba2a28843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:17.523813 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf5d13c-ac83-4a56-b6ab-e821f4af723e admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:17.525271 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-5bf5d13c-ac83-4a56-b6ab-e821f4af723e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:17.536735 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:17.576634 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:17.602301 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 933/1861] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:30:17.608269 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf5d13c-ac83-4a56-b6ab-e821f4af723e admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:17.610465 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e8fbaa-233f-42e9-a3d0-648ba2a28843 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:17.612184 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-07e8fbaa-233f-42e9-a3d0-648ba2a28843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:17.612622 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d630763-deee-4a5f-9e86-362f447a3e10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:17.613265 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d630763-deee-4a5f-9e86-362f447a3e10 service cinder] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:17.613556 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d630763-deee-4a5f-9e86-362f447a3e10 service cinder] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:17.613826 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d630763-deee-4a5f-9e86-362f447a3e10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:17.615739 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-9d630763-deee-4a5f-9e86-362f447a3e10 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:17.677984 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e8fbaa-233f-42e9-a3d0-648ba2a28843 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:17.692377 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6454bc-5cb9-4214-b71f-04c806e79872 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:17.693017 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6454bc-5cb9-4214-b71f-04c806e79872 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:17.693288 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6454bc-5cb9-4214-b71f-04c806e79872 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:17.693562 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6454bc-5cb9-4214-b71f-04c806e79872 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:17.697945 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d630763-deee-4a5f-9e86-362f447a3e10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:17.699457 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d630763-deee-4a5f-9e86-362f447a3e10 service cinder] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:17.715632 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 929/1862] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:30:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 15:30:17.727685 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6454bc-5cb9-4214-b71f-04c806e79872 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:17.729202 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6454bc-5cb9-4214-b71f-04c806e79872 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:17.734052 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d630763-deee-4a5f-9e86-362f447a3e10 service cinder] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:17.739484 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-9d630763-deee-4a5f-9e86-362f447a3e10 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:17.743856 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 934/1863] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:30:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:30:17.780186 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d630763-deee-4a5f-9e86-362f447a3e10 service cinder] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:17.797661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f46c0-f158-483d-a8f1-5b60de7a2ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:17.798457 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f46c0-f158-483d-a8f1-5b60de7a2ae2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:17.799034 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f46c0-f158-483d-a8f1-5b60de7a2ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:17.799412 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f46c0-f158-483d-a8f1-5b60de7a2ae2 admin admin] PATH_INFO: `/v3/projects/89b7ce0bda2945c78f6944e7adb954b0` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:17.800833 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722f46c0-f158-483d-a8f1-5b60de7a2ae2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89b7ce0bda2945c78f6944e7adb954b0)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:17.803708 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722f46c0-f158-483d-a8f1-5b60de7a2ae2 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:17.877468 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-722f46c0-f158-483d-a8f1-5b60de7a2ae2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89b7ce0bda2945c78f6944e7adb954b0', 'request_id': 'req-722f46c0-f158-483d-a8f1-5b60de7a2ae2'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:17.885927 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-722f46c0-f158-483d-a8f1-5b60de7a2ae2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89b7ce0bda2945c78f6944e7adb954b0', 'request_id': 'req-722f46c0-f158-483d-a8f1-5b60de7a2ae2'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:17.894961 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-722f46c0-f158-483d-a8f1-5b60de7a2ae2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89b7ce0bda2945c78f6944e7adb954b0', 'request_id': 'req-722f46c0-f158-483d-a8f1-5b60de7a2ae2'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:17.909742 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-722f46c0-f158-483d-a8f1-5b60de7a2ae2 admin admin] The token cache is being invalidate because project 89b7ce0bda2945c78f6944e7adb954b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80360) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:30:17.909990 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-722f46c0-f158-483d-a8f1-5b60de7a2ae2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:17.911121 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-722f46c0-f158-483d-a8f1-5b60de7a2ae2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:17.913067 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 930/1864] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:30:17 2022] DELETE /identity/v3/projects/89b7ce0bda2945c78f6944e7adb954b0 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:17.921405 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56653d4-ad6c-418c-accf-f5955021064f None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:17.921405 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56653d4-ad6c-418c-accf-f5955021064f None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:17.921405 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56653d4-ad6c-418c-accf-f5955021064f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:17.947029 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-b56653d4-ad6c-418c-accf-f5955021064f None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:17.948792 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-b56653d4-ad6c-418c-accf-f5955021064f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:18.026022 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 935/1865] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:30:18.037471 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e122884-7f09-40f9-92dc-23d21341d465 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:18.037471 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e122884-7f09-40f9-92dc-23d21341d465 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:18.037471 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e122884-7f09-40f9-92dc-23d21341d465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:18.057657 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-9e122884-7f09-40f9-92dc-23d21341d465 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:18.058886 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-9e122884-7f09-40f9-92dc-23d21341d465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:18.071291 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 931/1866] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:30:18.072719 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56653d4-ad6c-418c-accf-f5955021064f None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:18.089210 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e122884-7f09-40f9-92dc-23d21341d465 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:18.091314 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-9e122884-7f09-40f9-92dc-23d21341d465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:18.101779 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56653d4-ad6c-418c-accf-f5955021064f None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:18.118115 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15338d99-5ac9-42f0-8f98-4fb80aa0fa1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:18.121222 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e122884-7f09-40f9-92dc-23d21341d465 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:18.122353 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15338d99-5ac9-42f0-8f98-4fb80aa0fa1d admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:18.122639 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15338d99-5ac9-42f0-8f98-4fb80aa0fa1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:18.122907 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15338d99-5ac9-42f0-8f98-4fb80aa0fa1d admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:18.124187 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15338d99-5ac9-42f0-8f98-4fb80aa0fa1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:30:18.124500 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15338d99-5ac9-42f0-8f98-4fb80aa0fa1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:18.126161 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15338d99-5ac9-42f0-8f98-4fb80aa0fa1d admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:18.148411 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d5149-50a6-4314-8bf4-078601783312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:18.152232 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d5149-50a6-4314-8bf4-078601783312 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:18.155376 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d5149-50a6-4314-8bf4-078601783312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:18.155701 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d5149-50a6-4314-8bf4-078601783312 admin admin] PATH_INFO: `/v3/projects/0737ab339b4a41f4a2d89d3cc2fcf1a9` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:18.159685 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2d5149-50a6-4314-8bf4-078601783312 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0737ab339b4a41f4a2d89d3cc2fcf1a9)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:18.161712 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2d5149-50a6-4314-8bf4-078601783312 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:18.175753 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 936/1867] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 2 15:30:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:30:18.176693 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15338d99-5ac9-42f0-8f98-4fb80aa0fa1d admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:18.195027 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15338d99-5ac9-42f0-8f98-4fb80aa0fa1d admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:18.205025 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7daf08e-47ba-4853-abd9-eef729f09574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:18.205660 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7daf08e-47ba-4853-abd9-eef729f09574 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:18.205944 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7daf08e-47ba-4853-abd9-eef729f09574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:18.206222 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7daf08e-47ba-4853-abd9-eef729f09574 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:18.206889 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7daf08e-47ba-4853-abd9-eef729f09574 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:18.219242 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7daf08e-47ba-4853-abd9-eef729f09574 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:18.230438 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:18.258384 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-5d2d5149-50a6-4314-8bf4-078601783312 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0737ab339b4a41f4a2d89d3cc2fcf1a9', 'request_id': 'req-5d2d5149-50a6-4314-8bf4-078601783312'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:18.271268 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 937/1868] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:30:18 2022] POST /identity/v3/projects => generated 367 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:30:18.275316 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7daf08e-47ba-4853-abd9-eef729f09574 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:18.282032 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-5d2d5149-50a6-4314-8bf4-078601783312 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0737ab339b4a41f4a2d89d3cc2fcf1a9', 'request_id': 'req-5d2d5149-50a6-4314-8bf4-078601783312'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:18.302351 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-5d2d5149-50a6-4314-8bf4-078601783312 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0737ab339b4a41f4a2d89d3cc2fcf1a9', 'request_id': 'req-5d2d5149-50a6-4314-8bf4-078601783312'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:18.368439 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-5d2d5149-50a6-4314-8bf4-078601783312 admin admin] The token cache is being invalidate because project 0737ab339b4a41f4a2d89d3cc2fcf1a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80360) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:30:18.368697 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-5d2d5149-50a6-4314-8bf4-078601783312 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:18.380338 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-5d2d5149-50a6-4314-8bf4-078601783312 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:18.382185 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 932/1869] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:30:18 2022] DELETE /identity/v3/projects/0737ab339b4a41f4a2d89d3cc2fcf1a9 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 15:30:18.386263 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d5149-50a6-4314-8bf4-078601783312 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:18.388286 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-5d2d5149-50a6-4314-8bf4-078601783312 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:18.424270 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7daf08e-47ba-4853-abd9-eef729f09574 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:18.432074 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bacb4e-373a-47af-ae68-4e427e484d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:18.432720 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bacb4e-373a-47af-ae68-4e427e484d5b admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:18.432971 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bacb4e-373a-47af-ae68-4e427e484d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:18.433241 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bacb4e-373a-47af-ae68-4e427e484d5b admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:18.434546 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bacb4e-373a-47af-ae68-4e427e484d5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:18.436837 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bacb4e-373a-47af-ae68-4e427e484d5b admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:18.464384 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:18.497707 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 938/1870] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:30:18 2022] POST /identity/v3/users => generated 284 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:30:18.498643 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bacb4e-373a-47af-ae68-4e427e484d5b admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:18.500375 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-75bacb4e-373a-47af-ae68-4e427e484d5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:18.514996 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bacb4e-373a-47af-ae68-4e427e484d5b admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:18.523846 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c476ef8-4107-4965-a616-6cbce87643a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:18.524680 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c476ef8-4107-4965-a616-6cbce87643a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:18.525074 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c476ef8-4107-4965-a616-6cbce87643a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:18.525597 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c476ef8-4107-4965-a616-6cbce87643a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:18.527743 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c476ef8-4107-4965-a616-6cbce87643a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:18.532563 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c476ef8-4107-4965-a616-6cbce87643a5 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:18.553785 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 939/1871] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:30:18.559429 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d5149-50a6-4314-8bf4-078601783312 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:18.562734 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c476ef8-4107-4965-a616-6cbce87643a5 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:18.583162 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c476ef8-4107-4965-a616-6cbce87643a5 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:18.588721 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb092a3-8fe4-41de-8f0a-f8b925e3bb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:18.589641 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb092a3-8fe4-41de-8f0a-f8b925e3bb4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:18.590073 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb092a3-8fe4-41de-8f0a-f8b925e3bb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:18.591091 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb092a3-8fe4-41de-8f0a-f8b925e3bb4a admin admin] PATH_INFO: `/v3/users/4fbef2d9c53c429c8435d645a019699b` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:18.593231 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253f6882-6186-4466-9a0a-46b356e0c820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:18.594074 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f6882-6186-4466-9a0a-46b356e0c820 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:18.594337 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb092a3-8fe4-41de-8f0a-f8b925e3bb4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fbef2d9c53c429c8435d645a019699b)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:18.594804 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f6882-6186-4466-9a0a-46b356e0c820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:18.596396 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f6882-6186-4466-9a0a-46b356e0c820 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:18.598507 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253f6882-6186-4466-9a0a-46b356e0c820 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:18.599175 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb092a3-8fe4-41de-8f0a-f8b925e3bb4a admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:18.602469 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253f6882-6186-4466-9a0a-46b356e0c820 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:18.665360 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 940/1872] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:30:18.677158 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253f6882-6186-4466-9a0a-46b356e0c820 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:18.693732 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-7fb092a3-8fe4-41de-8f0a-f8b925e3bb4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fbef2d9c53c429c8435d645a019699b'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:18.694316 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253f6882-6186-4466-9a0a-46b356e0c820 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:18.699287 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f34f1-d10a-444d-8f5b-abd77e6cd1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:18.700283 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f34f1-d10a-444d-8f5b-abd77e6cd1f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:18.700757 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f34f1-d10a-444d-8f5b-abd77e6cd1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:18.701135 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f34f1-d10a-444d-8f5b-abd77e6cd1f5 admin admin] PATH_INFO: `/v3/projects/23c6286b8c4048f8847f875d80988d58/users/cb1671f30d224f1fae3bff706d1b663e/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:18.705414 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-7fb092a3-8fe4-41de-8f0a-f8b925e3bb4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fbef2d9c53c429c8435d645a019699b'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:18.728707 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-7fb092a3-8fe4-41de-8f0a-f8b925e3bb4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fbef2d9c53c429c8435d645a019699b'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:18.733994 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-7fb092a3-8fe4-41de-8f0a-f8b925e3bb4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fbef2d9c53c429c8435d645a019699b'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:18.734924 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-7fb092a3-8fe4-41de-8f0a-f8b925e3bb4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fbef2d9c53c429c8435d645a019699b'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:18.739888 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013f34f1-d10a-444d-8f5b-abd77e6cd1f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23c6286b8c4048f8847f875d80988d58, user_id=cb1671f30d224f1fae3bff706d1b663e, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:18.743014 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013f34f1-d10a-444d-8f5b-abd77e6cd1f5 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:18.769957 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 941/1873] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:30:18 2022] PUT /identity/v3/projects/23c6286b8c4048f8847f875d80988d58/users/cb1671f30d224f1fae3bff706d1b663e/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:18.781219 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81040699-3805-41cd-9ce8-eeeb691cedb2 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:18.781755 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81040699-3805-41cd-9ce8-eeeb691cedb2 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:18.782267 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81040699-3805-41cd-9ce8-eeeb691cedb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:18.835021 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-81040699-3805-41cd-9ce8-eeeb691cedb2 None None] MFA Rules not processed for user `cb1671f30d224f1fae3bff706d1b663e`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:18.841374 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-81040699-3805-41cd-9ce8-eeeb691cedb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:18.844196 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 933/1874] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:30:18 2022] DELETE /identity/v3/users/4fbef2d9c53c429c8435d645a019699b => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:19.066344 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 942/1875] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:30:19.069668 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb092a3-8fe4-41de-8f0a-f8b925e3bb4a admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:19.071242 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-7fb092a3-8fe4-41de-8f0a-f8b925e3bb4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:19.220897 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:19.351645 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb092a3-8fe4-41de-8f0a-f8b925e3bb4a admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:19.380107 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe27b0d-7813-4495-b5ee-13ecbfa5362d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:19.381063 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe27b0d-7813-4495-b5ee-13ecbfa5362d admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:19.381807 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe27b0d-7813-4495-b5ee-13ecbfa5362d admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:19.382456 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe27b0d-7813-4495-b5ee-13ecbfa5362d admin admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:19.383419 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe27b0d-7813-4495-b5ee-13ecbfa5362d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:19.386198 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe27b0d-7813-4495-b5ee-13ecbfa5362d admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:19.460286 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 934/1876] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:30:19 2022] POST /identity/v3/projects => generated 369 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:30:19.464385 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81040699-3805-41cd-9ce8-eeeb691cedb2 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:19.496236 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81040699-3805-41cd-9ce8-eeeb691cedb2 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:19.607384 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e8fc7-e933-4987-8c24-c767240987d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:19.608037 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e8fc7-e933-4987-8c24-c767240987d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:19.608320 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e8fc7-e933-4987-8c24-c767240987d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:19.608601 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e8fc7-e933-4987-8c24-c767240987d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:19.609280 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e8fc7-e933-4987-8c24-c767240987d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:19.611243 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e8fc7-e933-4987-8c24-c767240987d9 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:19.665614 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 943/1877] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:30:19 2022] POST /identity/v3/users => generated 291 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:30:19.671134 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe27b0d-7813-4495-b5ee-13ecbfa5362d admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:19.685830 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe27b0d-7813-4495-b5ee-13ecbfa5362d admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:19.694104 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f2b08-ba6a-4850-81a6-94d36664e684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:19.697304 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f2b08-ba6a-4850-81a6-94d36664e684 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:19.697592 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f2b08-ba6a-4850-81a6-94d36664e684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:19.697870 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f2b08-ba6a-4850-81a6-94d36664e684 admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:19.698758 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2f2b08-ba6a-4850-81a6-94d36664e684 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:19.700471 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2f2b08-ba6a-4850-81a6-94d36664e684 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:19.716118 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 935/1878] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:30:19 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:30:19.723092 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e8fc7-e933-4987-8c24-c767240987d9 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:19.741231 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e8fc7-e933-4987-8c24-c767240987d9 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:19.747168 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5314a69-8250-491b-9754-83c911f713b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:19.748559 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5314a69-8250-491b-9754-83c911f713b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:19.748559 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5314a69-8250-491b-9754-83c911f713b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:19.749093 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5314a69-8250-491b-9754-83c911f713b9 admin admin] PATH_INFO: `/v3/projects/ace45547333a43a7ae789c6c6076ec40/users/b47d6dcd320842b69d752617db068938/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:19.811330 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5314a69-8250-491b-9754-83c911f713b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ace45547333a43a7ae789c6c6076ec40, user_id=b47d6dcd320842b69d752617db068938, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:19.829582 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5314a69-8250-491b-9754-83c911f713b9 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:19.861422 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f2b08-ba6a-4850-81a6-94d36664e684 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:19.864580 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-9c2f2b08-ba6a-4850-81a6-94d36664e684 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:19.868479 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 944/1879] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:30:19 2022] PUT /identity/v3/projects/ace45547333a43a7ae789c6c6076ec40/users/b47d6dcd320842b69d752617db068938/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:19.872789 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5314a69-8250-491b-9754-83c911f713b9 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:19.884884 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:19.904429 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f2b08-ba6a-4850-81a6-94d36664e684 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:20.022158 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5314a69-8250-491b-9754-83c911f713b9 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:20.029922 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b38e36d-d4e5-44ce-b5c3-8dbbe79f5aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:20.031127 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b38e36d-d4e5-44ce-b5c3-8dbbe79f5aad admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:20.031589 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b38e36d-d4e5-44ce-b5c3-8dbbe79f5aad admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:20.038520 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b38e36d-d4e5-44ce-b5c3-8dbbe79f5aad admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:20.043151 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6751abdc-d490-4804-891c-8b47c8e370a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:20.045184 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6751abdc-d490-4804-891c-8b47c8e370a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:20.045467 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6751abdc-d490-4804-891c-8b47c8e370a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:20.045732 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6751abdc-d490-4804-891c-8b47c8e370a8 admin admin] PATH_INFO: `/v3/projects/48bc5bf8fd93431188f799884fcac841` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:20.045948 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b38e36d-d4e5-44ce-b5c3-8dbbe79f5aad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:20.048338 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6751abdc-d490-4804-891c-8b47c8e370a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48bc5bf8fd93431188f799884fcac841)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:20.050136 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6751abdc-d490-4804-891c-8b47c8e370a8 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:20.056619 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b38e36d-d4e5-44ce-b5c3-8dbbe79f5aad admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:20.079984 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 945/1880] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:30:19 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:30:20.084670 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b38e36d-d4e5-44ce-b5c3-8dbbe79f5aad admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:20.118346 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b38e36d-d4e5-44ce-b5c3-8dbbe79f5aad admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:20.130117 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe4004-9090-4664-bf0e-cca31d286461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:20.131959 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe4004-9090-4664-bf0e-cca31d286461 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:20.132389 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe4004-9090-4664-bf0e-cca31d286461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:20.132724 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe4004-9090-4664-bf0e-cca31d286461 admin admin] PATH_INFO: `/v3/projects/ace45547333a43a7ae789c6c6076ec40/users/b47d6dcd320842b69d752617db068938/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:20.136509 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbe4004-9090-4664-bf0e-cca31d286461 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ace45547333a43a7ae789c6c6076ec40, user_id=b47d6dcd320842b69d752617db068938, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:20.141384 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbe4004-9090-4664-bf0e-cca31d286461 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:20.174485 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-6751abdc-d490-4804-891c-8b47c8e370a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48bc5bf8fd93431188f799884fcac841', 'request_id': 'req-6751abdc-d490-4804-891c-8b47c8e370a8'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:20.180882 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 946/1881] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:30:20 2022] PUT /identity/v3/projects/ace45547333a43a7ae789c6c6076ec40/users/b47d6dcd320842b69d752617db068938/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:20.188115 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-6751abdc-d490-4804-891c-8b47c8e370a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48bc5bf8fd93431188f799884fcac841', 'request_id': 'req-6751abdc-d490-4804-891c-8b47c8e370a8'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:20.192731 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26bd737-5ba7-432f-8ace-6cdd4dd0d086 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:20.193018 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26bd737-5ba7-432f-8ace-6cdd4dd0d086 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:20.193449 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26bd737-5ba7-432f-8ace-6cdd4dd0d086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:20.200889 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-6751abdc-d490-4804-891c-8b47c8e370a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48bc5bf8fd93431188f799884fcac841', 'request_id': 'req-6751abdc-d490-4804-891c-8b47c8e370a8'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:20.212903 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-6751abdc-d490-4804-891c-8b47c8e370a8 admin admin] The token cache is being invalidate because project 48bc5bf8fd93431188f799884fcac841 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80360) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:30:20.213207 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-6751abdc-d490-4804-891c-8b47c8e370a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:20.213922 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-6751abdc-d490-4804-891c-8b47c8e370a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:20.216386 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 936/1882] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:30:19 2022] DELETE /identity/v3/projects/48bc5bf8fd93431188f799884fcac841 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:20.220844 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23fbe21-3fac-40c5-b3d5-fa426488ef2d None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:20.221080 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23fbe21-3fac-40c5-b3d5-fa426488ef2d None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:20.221359 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23fbe21-3fac-40c5-b3d5-fa426488ef2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:20.225665 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-a26bd737-5ba7-432f-8ace-6cdd4dd0d086 None None] MFA Rules not processed for user `b47d6dcd320842b69d752617db068938`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:20.227060 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-a26bd737-5ba7-432f-8ace-6cdd4dd0d086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:20.241973 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-c23fbe21-3fac-40c5-b3d5-fa426488ef2d None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:20.244019 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-c23fbe21-3fac-40c5-b3d5-fa426488ef2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:20.301246 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:20.359767 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 937/1883] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:30:20.368958 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a876d9-c6c9-40f7-b6f5-a0b8f7808219 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:20.369468 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a876d9-c6c9-40f7-b6f5-a0b8f7808219 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:20.369846 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a876d9-c6c9-40f7-b6f5-a0b8f7808219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:20.380339 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 947/1884] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:20 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:30:20.397758 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-64a876d9-c6c9-40f7-b6f5-a0b8f7808219 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:20.399137 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-64a876d9-c6c9-40f7-b6f5-a0b8f7808219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:20.406119 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26bd737-5ba7-432f-8ace-6cdd4dd0d086 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:20.407472 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-a26bd737-5ba7-432f-8ace-6cdd4dd0d086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:20.418304 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 938/1885] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:30:20.424485 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a876d9-c6c9-40f7-b6f5-a0b8f7808219 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:20.442849 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a876d9-c6c9-40f7-b6f5-a0b8f7808219 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:20.460957 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d7232b-1879-4f2f-8999-aeac1da7b66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:20.461684 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7232b-1879-4f2f-8999-aeac1da7b66b admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:20.461974 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7232b-1879-4f2f-8999-aeac1da7b66b admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:20.462256 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7232b-1879-4f2f-8999-aeac1da7b66b admin admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:20.462978 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d7232b-1879-4f2f-8999-aeac1da7b66b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:30:20.463519 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d7232b-1879-4f2f-8999-aeac1da7b66b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:20.466673 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d7232b-1879-4f2f-8999-aeac1da7b66b admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:20.487276 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 939/1886] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 2 15:30:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:30:20.491290 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d7232b-1879-4f2f-8999-aeac1da7b66b admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:20.505207 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d7232b-1879-4f2f-8999-aeac1da7b66b admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:20.510620 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75fd180-8d20-4c04-91e9-33ea63da3d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:20.511657 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75fd180-8d20-4c04-91e9-33ea63da3d81 admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:20.512521 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75fd180-8d20-4c04-91e9-33ea63da3d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:20.512856 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75fd180-8d20-4c04-91e9-33ea63da3d81 admin admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:20.513532 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75fd180-8d20-4c04-91e9-33ea63da3d81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:20.516040 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75fd180-8d20-4c04-91e9-33ea63da3d81 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:20.532374 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26bd737-5ba7-432f-8ace-6cdd4dd0d086 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:20.537092 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ddd077-e4d7-49c0-8849-bc0c076e64db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:20.537726 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ddd077-e4d7-49c0-8849-bc0c076e64db service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:20.538620 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ddd077-e4d7-49c0-8849-bc0c076e64db service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:20.538620 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ddd077-e4d7-49c0-8849-bc0c076e64db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:20.549771 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ddd077-e4d7-49c0-8849-bc0c076e64db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:20.551184 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ddd077-e4d7-49c0-8849-bc0c076e64db service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:20.563069 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 940/1887] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:30:20 2022] POST /identity/v3/projects => generated 383 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 15:30:20.564155 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75fd180-8d20-4c04-91e9-33ea63da3d81 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:20.576572 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 948/1888] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:30:20 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:30:20.650558 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75fd180-8d20-4c04-91e9-33ea63da3d81 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:20.655284 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bec5d8-66af-41cd-96f1-63acf1ad87d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:20.655910 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bec5d8-66af-41cd-96f1-63acf1ad87d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:20.656334 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bec5d8-66af-41cd-96f1-63acf1ad87d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:20.656518 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bec5d8-66af-41cd-96f1-63acf1ad87d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:20.657116 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bec5d8-66af-41cd-96f1-63acf1ad87d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:20.659012 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bec5d8-66af-41cd-96f1-63acf1ad87d0 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:20.687501 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 941/1889] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:30:20 2022] POST /identity/v3/users => generated 292 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:30:20.688532 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ddd077-e4d7-49c0-8849-bc0c076e64db service cinder] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:20.700171 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ddd077-e4d7-49c0-8849-bc0c076e64db service cinder] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:20.704892 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195127e6-d58e-4c24-bc5b-c0120c046dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:20.705500 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195127e6-d58e-4c24-bc5b-c0120c046dba admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:20.705791 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195127e6-d58e-4c24-bc5b-c0120c046dba admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:20.706074 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195127e6-d58e-4c24-bc5b-c0120c046dba admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:20.706761 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195127e6-d58e-4c24-bc5b-c0120c046dba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:20.708405 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195127e6-d58e-4c24-bc5b-c0120c046dba admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:20.720518 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 949/1890] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:30:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 15:30:20.724934 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bec5d8-66af-41cd-96f1-63acf1ad87d0 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:20.738093 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bec5d8-66af-41cd-96f1-63acf1ad87d0 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:20.743193 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a0b9ee-d2de-48b5-bee1-3f9b12cda6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:20.744001 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0b9ee-d2de-48b5-bee1-3f9b12cda6e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:20.744289 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0b9ee-d2de-48b5-bee1-3f9b12cda6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:20.744565 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0b9ee-d2de-48b5-bee1-3f9b12cda6e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:20.745260 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a0b9ee-d2de-48b5-bee1-3f9b12cda6e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:20.747458 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a0b9ee-d2de-48b5-bee1-3f9b12cda6e3 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:20.759615 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 942/1891] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:30:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:30:20.763653 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195127e6-d58e-4c24-bc5b-c0120c046dba admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:20.769547 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:20.777244 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195127e6-d58e-4c24-bc5b-c0120c046dba admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:20.795206 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc23dd65-53e4-4c05-9fca-f316591351f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:20.795996 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc23dd65-53e4-4c05-9fca-f316591351f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:20.796360 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc23dd65-53e4-4c05-9fca-f316591351f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:20.796760 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc23dd65-53e4-4c05-9fca-f316591351f1 admin admin] PATH_INFO: `/v3/projects/261d3fa95c7e4508a44a3e0fc2d3c2da/users/435ce89d492948b284ee6adc482d6d99/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:20.819137 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc23dd65-53e4-4c05-9fca-f316591351f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=261d3fa95c7e4508a44a3e0fc2d3c2da, user_id=435ce89d492948b284ee6adc482d6d99, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:20.822045 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc23dd65-53e4-4c05-9fca-f316591351f1 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:20.843301 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 950/1892] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:30:20 2022] PUT /identity/v3/projects/261d3fa95c7e4508a44a3e0fc2d3c2da/users/435ce89d492948b284ee6adc482d6d99/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:20.850295 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0755ab99-6d87-4d07-989a-cda0331e2ca2 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:20.850681 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0755ab99-6d87-4d07-989a-cda0331e2ca2 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:20.851034 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0755ab99-6d87-4d07-989a-cda0331e2ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:20.888012 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-0755ab99-6d87-4d07-989a-cda0331e2ca2 None None] MFA Rules not processed for user `435ce89d492948b284ee6adc482d6d99`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:20.889531 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-0755ab99-6d87-4d07-989a-cda0331e2ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:20.984583 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 943/1893] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:30:20.995559 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc23dd65-53e4-4c05-9fca-f316591351f1 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:21.055824 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc23dd65-53e4-4c05-9fca-f316591351f1 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:21.061136 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b122bd-5d57-4d99-b375-ca69589bcacc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:21.061797 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b122bd-5d57-4d99-b375-ca69589bcacc service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:21.062062 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b122bd-5d57-4d99-b375-ca69589bcacc service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:21.062344 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b122bd-5d57-4d99-b375-ca69589bcacc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:21.076526 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b122bd-5d57-4d99-b375-ca69589bcacc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:21.078202 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b122bd-5d57-4d99-b375-ca69589bcacc service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:21.088188 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 951/1894] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:30:20 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:30:21.108970 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0755ab99-6d87-4d07-989a-cda0331e2ca2 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:21.122137 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:21.187849 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0755ab99-6d87-4d07-989a-cda0331e2ca2 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:21.198101 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b907cd-bade-4cbd-91f6-000e5dd4e618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:21.198880 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b907cd-bade-4cbd-91f6-000e5dd4e618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:21.199884 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b907cd-bade-4cbd-91f6-000e5dd4e618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:21.200222 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b907cd-bade-4cbd-91f6-000e5dd4e618 admin admin] PATH_INFO: `/v3/users/435ce89d492948b284ee6adc482d6d99` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:21.201695 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b907cd-bade-4cbd-91f6-000e5dd4e618 admin admin] RBAC: Authorizing `identity:delete_user(user_id=435ce89d492948b284ee6adc482d6d99)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:21.205714 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b907cd-bade-4cbd-91f6-000e5dd4e618 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:21.257411 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-90b907cd-bade-4cbd-91f6-000e5dd4e618 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '435ce89d492948b284ee6adc482d6d99'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:21.267488 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-90b907cd-bade-4cbd-91f6-000e5dd4e618 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '435ce89d492948b284ee6adc482d6d99'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:21.283348 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-90b907cd-bade-4cbd-91f6-000e5dd4e618 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '435ce89d492948b284ee6adc482d6d99'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:21.284083 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-90b907cd-bade-4cbd-91f6-000e5dd4e618 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '435ce89d492948b284ee6adc482d6d99'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:21.284684 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-90b907cd-bade-4cbd-91f6-000e5dd4e618 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '435ce89d492948b284ee6adc482d6d99'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:21.299575 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 944/1895] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:30:21 2022] DELETE /identity/v3/users/435ce89d492948b284ee6adc482d6d99 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 15:30:21.304158 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e45ff-aafa-4ea4-ae32-fdd79290ab34 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:21.304382 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e45ff-aafa-4ea4-ae32-fdd79290ab34 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:21.304837 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e45ff-aafa-4ea4-ae32-fdd79290ab34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:21.323774 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-e68e45ff-aafa-4ea4-ae32-fdd79290ab34 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:21.325519 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-e68e45ff-aafa-4ea4-ae32-fdd79290ab34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:21.394424 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 952/1896] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:30:21.404841 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b907cd-bade-4cbd-91f6-000e5dd4e618 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:21.406312 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-90b907cd-bade-4cbd-91f6-000e5dd4e618 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:21.506042 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b907cd-bade-4cbd-91f6-000e5dd4e618 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:21.513852 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f55ce-19ca-41cd-919f-6a58bd3a8b89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:21.514625 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f55ce-19ca-41cd-919f-6a58bd3a8b89 service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:21.515622 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f55ce-19ca-41cd-919f-6a58bd3a8b89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:21.515622 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f55ce-19ca-41cd-919f-6a58bd3a8b89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:21.548304 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871f55ce-19ca-41cd-919f-6a58bd3a8b89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:21.550399 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871f55ce-19ca-41cd-919f-6a58bd3a8b89 service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:21.562935 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 945/1897] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:30:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:30:22.232668 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e45ff-aafa-4ea4-ae32-fdd79290ab34 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:22.234784 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-e68e45ff-aafa-4ea4-ae32-fdd79290ab34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:22.252147 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e45ff-aafa-4ea4-ae32-fdd79290ab34 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:22.256883 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c296f5f-842d-4912-a4dd-523ee137097c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:22.258823 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c296f5f-842d-4912-a4dd-523ee137097c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:22.259322 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c296f5f-842d-4912-a4dd-523ee137097c admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:22.261567 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c296f5f-842d-4912-a4dd-523ee137097c admin admin] PATH_INFO: `/v3/projects/261d3fa95c7e4508a44a3e0fc2d3c2da` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:22.263200 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c296f5f-842d-4912-a4dd-523ee137097c admin admin] RBAC: Authorizing `identity:delete_project(project_id=261d3fa95c7e4508a44a3e0fc2d3c2da)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:22.265694 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c296f5f-842d-4912-a4dd-523ee137097c admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:22.330914 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-6c296f5f-842d-4912-a4dd-523ee137097c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '261d3fa95c7e4508a44a3e0fc2d3c2da', 'request_id': 'req-6c296f5f-842d-4912-a4dd-523ee137097c'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:22.337004 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f55ce-19ca-41cd-919f-6a58bd3a8b89 service neutron] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:22.338856 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-871f55ce-19ca-41cd-919f-6a58bd3a8b89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:22.341870 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-6c296f5f-842d-4912-a4dd-523ee137097c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '261d3fa95c7e4508a44a3e0fc2d3c2da', 'request_id': 'req-6c296f5f-842d-4912-a4dd-523ee137097c'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:22.348814 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-6c296f5f-842d-4912-a4dd-523ee137097c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '261d3fa95c7e4508a44a3e0fc2d3c2da', 'request_id': 'req-6c296f5f-842d-4912-a4dd-523ee137097c'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:22.358089 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f55ce-19ca-41cd-919f-6a58bd3a8b89 service neutron] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:22.360340 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-6c296f5f-842d-4912-a4dd-523ee137097c admin admin] The token cache is being invalidate because project 261d3fa95c7e4508a44a3e0fc2d3c2da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:30:22.360808 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-6c296f5f-842d-4912-a4dd-523ee137097c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:22.361482 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-6c296f5f-842d-4912-a4dd-523ee137097c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:22.366516 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 953/1898] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:30:22 2022] DELETE /identity/v3/projects/261d3fa95c7e4508a44a3e0fc2d3c2da => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:22.368904 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca22087-2a0c-464e-a63e-cb85b75918a4 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:22.369289 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca22087-2a0c-464e-a63e-cb85b75918a4 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:22.369581 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca22087-2a0c-464e-a63e-cb85b75918a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:22.381750 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:22.403256 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-8ca22087-2a0c-464e-a63e-cb85b75918a4 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:22.403614 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-8ca22087-2a0c-464e-a63e-cb85b75918a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:22.417838 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:22.460487 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a46e490-efac-4762-a1b4-bb983db0e5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:22.461154 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46e490-efac-4762-a1b4-bb983db0e5e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:22.461439 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46e490-efac-4762-a1b4-bb983db0e5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:22.461863 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46e490-efac-4762-a1b4-bb983db0e5e3 admin admin] PATH_INFO: `/v3/users/efc11b252f2c40d0ad1b392e95de7280` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:22.463067 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a46e490-efac-4762-a1b4-bb983db0e5e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efc11b252f2c40d0ad1b392e95de7280)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:22.467589 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a46e490-efac-4762-a1b4-bb983db0e5e3 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:22.495672 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 954/1899] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:30:22.504151 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b377a5-1a3b-4d40-aa49-c5ddcc5e8d30 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:22.504870 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b377a5-1a3b-4d40-aa49-c5ddcc5e8d30 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:22.505016 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b377a5-1a3b-4d40-aa49-c5ddcc5e8d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:22.531836 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-91b377a5-1a3b-4d40-aa49-c5ddcc5e8d30 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:22.533067 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-91b377a5-1a3b-4d40-aa49-c5ddcc5e8d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:22.550384 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 955/1900] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:30:22.550716 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-7a46e490-efac-4762-a1b4-bb983db0e5e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efc11b252f2c40d0ad1b392e95de7280'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:22.552093 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b377a5-1a3b-4d40-aa49-c5ddcc5e8d30 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:22.564161 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b377a5-1a3b-4d40-aa49-c5ddcc5e8d30 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:22.569918 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1adc9e8-57ea-4e1d-bd15-25bd445d9404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:22.570803 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1adc9e8-57ea-4e1d-bd15-25bd445d9404 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:22.571152 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1adc9e8-57ea-4e1d-bd15-25bd445d9404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:22.571532 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1adc9e8-57ea-4e1d-bd15-25bd445d9404 admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:22.572085 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-7a46e490-efac-4762-a1b4-bb983db0e5e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efc11b252f2c40d0ad1b392e95de7280'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:22.572861 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1adc9e8-57ea-4e1d-bd15-25bd445d9404 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:30:22.573240 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1adc9e8-57ea-4e1d-bd15-25bd445d9404 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:22.575006 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1adc9e8-57ea-4e1d-bd15-25bd445d9404 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:22.590089 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 956/1901] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 2 15:30:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:30:22.594079 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1adc9e8-57ea-4e1d-bd15-25bd445d9404 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:22.594370 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-7a46e490-efac-4762-a1b4-bb983db0e5e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efc11b252f2c40d0ad1b392e95de7280'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:22.596486 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-7a46e490-efac-4762-a1b4-bb983db0e5e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efc11b252f2c40d0ad1b392e95de7280'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:22.597117 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-7a46e490-efac-4762-a1b4-bb983db0e5e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efc11b252f2c40d0ad1b392e95de7280'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:22.607501 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1adc9e8-57ea-4e1d-bd15-25bd445d9404 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:22.614942 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 946/1902] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:30:22 2022] DELETE /identity/v3/users/efc11b252f2c40d0ad1b392e95de7280 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:22.621254 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29217a7e-fe34-412b-814a-fccfc38e1545 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:22.622352 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29217a7e-fe34-412b-814a-fccfc38e1545 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:22.622532 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29217a7e-fe34-412b-814a-fccfc38e1545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:22.624736 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b3274-7043-4d00-86ae-5e32560773a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:22.626047 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b3274-7043-4d00-86ae-5e32560773a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:22.626332 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b3274-7043-4d00-86ae-5e32560773a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:22.626775 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b3274-7043-4d00-86ae-5e32560773a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:22.627502 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b3274-7043-4d00-86ae-5e32560773a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:22.629830 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b3274-7043-4d00-86ae-5e32560773a6 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:22.645608 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-29217a7e-fe34-412b-814a-fccfc38e1545 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:22.646873 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-29217a7e-fe34-412b-814a-fccfc38e1545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:22.677188 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 957/1903] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:30:22 2022] POST /identity/v3/projects => generated 377 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:30:22.682634 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b3274-7043-4d00-86ae-5e32560773a6 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:22.686080 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-709b3274-7043-4d00-86ae-5e32560773a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:22.776271 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 947/1904] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:30:22.780712 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29217a7e-fe34-412b-814a-fccfc38e1545 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:22.782163 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-29217a7e-fe34-412b-814a-fccfc38e1545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:22.802218 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29217a7e-fe34-412b-814a-fccfc38e1545 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:22.834123 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b3274-7043-4d00-86ae-5e32560773a6 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:22.849652 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c536a-8889-4287-af0d-53cbf936a7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:22.850232 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c536a-8889-4287-af0d-53cbf936a7e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:22.850517 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c536a-8889-4287-af0d-53cbf936a7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:22.850792 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c536a-8889-4287-af0d-53cbf936a7e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:22.851696 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c536a-8889-4287-af0d-53cbf936a7e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:22.853875 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c536a-8889-4287-af0d-53cbf936a7e5 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:22.901578 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 958/1905] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:30:22 2022] POST /identity/v3/users => generated 289 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:30:22.903307 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c536a-8889-4287-af0d-53cbf936a7e5 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:22.908106 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-ef9c536a-8889-4287-af0d-53cbf936a7e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:22.923115 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:22.948571 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c28a348-611c-4f7d-bd11-d2c26062859c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:22.949546 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c28a348-611c-4f7d-bd11-d2c26062859c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:22.949841 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c28a348-611c-4f7d-bd11-d2c26062859c admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:22.950127 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c28a348-611c-4f7d-bd11-d2c26062859c admin admin] PATH_INFO: `/v3/users/cb1671f30d224f1fae3bff706d1b663e` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:22.953715 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c28a348-611c-4f7d-bd11-d2c26062859c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb1671f30d224f1fae3bff706d1b663e)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:22.955889 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c28a348-611c-4f7d-bd11-d2c26062859c admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:23.079165 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c536a-8889-4287-af0d-53cbf936a7e5 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:23.080600 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-8c28a348-611c-4f7d-bd11-d2c26062859c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb1671f30d224f1fae3bff706d1b663e'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:23.095376 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67775894-0f72-4688-8336-fae2709e43ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:23.099752 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67775894-0f72-4688-8336-fae2709e43ad service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:23.100403 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67775894-0f72-4688-8336-fae2709e43ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:23.101587 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67775894-0f72-4688-8336-fae2709e43ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:23.106508 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-8c28a348-611c-4f7d-bd11-d2c26062859c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb1671f30d224f1fae3bff706d1b663e'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:23.130523 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:23.148285 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67775894-0f72-4688-8336-fae2709e43ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:23.148881 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67775894-0f72-4688-8336-fae2709e43ad service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:23.166685 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-8c28a348-611c-4f7d-bd11-d2c26062859c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb1671f30d224f1fae3bff706d1b663e'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:23.170401 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-8c28a348-611c-4f7d-bd11-d2c26062859c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb1671f30d224f1fae3bff706d1b663e'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:23.172218 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-8c28a348-611c-4f7d-bd11-d2c26062859c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb1671f30d224f1fae3bff706d1b663e'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:23.186025 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 959/1906] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:30:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:30:23.190443 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67775894-0f72-4688-8336-fae2709e43ad service neutron] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:23.206110 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 948/1907] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:30:22 2022] DELETE /identity/v3/users/cb1671f30d224f1fae3bff706d1b663e => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:23.215728 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1ebd8-fc73-4079-aae9-49cab2cf716c None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:23.217744 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1ebd8-fc73-4079-aae9-49cab2cf716c None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:23.218104 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1ebd8-fc73-4079-aae9-49cab2cf716c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:23.224357 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67775894-0f72-4688-8336-fae2709e43ad service neutron] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:23.244748 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-94b1ebd8-fc73-4079-aae9-49cab2cf716c None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:23.259593 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-94b1ebd8-fc73-4079-aae9-49cab2cf716c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:23.351639 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b1f97c-20bd-408a-bd06-1e556408e368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:23.352418 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1f97c-20bd-408a-bd06-1e556408e368 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:23.352710 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1f97c-20bd-408a-bd06-1e556408e368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:23.352992 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1f97c-20bd-408a-bd06-1e556408e368 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:23.353746 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b1f97c-20bd-408a-bd06-1e556408e368 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:23.356251 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b1f97c-20bd-408a-bd06-1e556408e368 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:23.383647 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 960/1908] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:30:23.384050 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 949/1909] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:30:23.384637 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b1f97c-20bd-408a-bd06-1e556408e368 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:23.386464 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-45b1f97c-20bd-408a-bd06-1e556408e368 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:23.402682 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b1f97c-20bd-408a-bd06-1e556408e368 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:23.407758 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78098b36-70c7-437d-9f46-6043e855e667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:23.408232 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78098b36-70c7-437d-9f46-6043e855e667 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:23.408570 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78098b36-70c7-437d-9f46-6043e855e667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:23.408998 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78098b36-70c7-437d-9f46-6043e855e667 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:23.409960 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78098b36-70c7-437d-9f46-6043e855e667 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:23.412229 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78098b36-70c7-437d-9f46-6043e855e667 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:23.415791 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b1ebd8-fc73-4079-aae9-49cab2cf716c None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:23.420323 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-94b1ebd8-fc73-4079-aae9-49cab2cf716c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:23.435524 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 961/1910] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:30:23.436587 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78098b36-70c7-437d-9f46-6043e855e667 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:23.467977 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78098b36-70c7-437d-9f46-6043e855e667 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:23.478691 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a1c7b-0753-4515-a31a-9ba9037727d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:23.479873 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a1c7b-0753-4515-a31a-9ba9037727d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:23.480339 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a1c7b-0753-4515-a31a-9ba9037727d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:23.480667 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a1c7b-0753-4515-a31a-9ba9037727d5 admin admin] PATH_INFO: `/v3/projects/324d13a723aa4d3a987c5541d25d529f/users/7adf2f9bcec046fd900437422bc7e7c9/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:23.502206 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836a1c7b-0753-4515-a31a-9ba9037727d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=324d13a723aa4d3a987c5541d25d529f, user_id=7adf2f9bcec046fd900437422bc7e7c9, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:23.505474 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836a1c7b-0753-4515-a31a-9ba9037727d5 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:23.521983 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b1ebd8-fc73-4079-aae9-49cab2cf716c None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:23.524853 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 962/1911] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:30:23 2022] PUT /identity/v3/projects/324d13a723aa4d3a987c5541d25d529f/users/7adf2f9bcec046fd900437422bc7e7c9/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:23.538464 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb0b57-b3cc-4951-bf30-6e35957983e8 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:23.539992 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb0b57-b3cc-4951-bf30-6e35957983e8 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:23.540474 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb0b57-b3cc-4951-bf30-6e35957983e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:23.580190 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-a9bb0b57-b3cc-4951-bf30-6e35957983e8 None None] MFA Rules not processed for user `7adf2f9bcec046fd900437422bc7e7c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:23.581611 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-a9bb0b57-b3cc-4951-bf30-6e35957983e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:23.591298 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:23.643946 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef982e7a-705c-4663-81d8-13eaf8298c60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:23.644820 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef982e7a-705c-4663-81d8-13eaf8298c60 service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:23.645187 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef982e7a-705c-4663-81d8-13eaf8298c60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:23.645561 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef982e7a-705c-4663-81d8-13eaf8298c60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:23.743270 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 963/1912] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:30:23.744388 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb0b57-b3cc-4951-bf30-6e35957983e8 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:23.749839 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-a9bb0b57-b3cc-4951-bf30-6e35957983e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:23.783640 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef982e7a-705c-4663-81d8-13eaf8298c60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:23.785428 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef982e7a-705c-4663-81d8-13eaf8298c60 service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:23.802075 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 950/1913] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:30:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:30:23.802870 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef982e7a-705c-4663-81d8-13eaf8298c60 service neutron] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:23.804391 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-ef982e7a-705c-4663-81d8-13eaf8298c60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:23.827351 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:23.862240 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb0b57-b3cc-4951-bf30-6e35957983e8 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:23.868973 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2b7ce-86e1-4a61-bdda-53f00c651234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:23.870194 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2b7ce-86e1-4a61-bdda-53f00c651234 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:23.871235 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2b7ce-86e1-4a61-bdda-53f00c651234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:23.871235 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2b7ce-86e1-4a61-bdda-53f00c651234 admin admin] PATH_INFO: `/v3/projects/3d2cd770e4ff4b1fa592cceb6656fa6b` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:23.872385 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a2b7ce-86e1-4a61-bdda-53f00c651234 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d2cd770e4ff4b1fa592cceb6656fa6b)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:23.874891 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a2b7ce-86e1-4a61-bdda-53f00c651234 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:23.899519 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef982e7a-705c-4663-81d8-13eaf8298c60 service neutron] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:23.904390 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838f88c1-741c-4dbb-9bbd-96a40697e045 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:23.908000 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f88c1-741c-4dbb-9bbd-96a40697e045 service cinder] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:23.908290 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f88c1-741c-4dbb-9bbd-96a40697e045 service cinder] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:23.909007 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f88c1-741c-4dbb-9bbd-96a40697e045 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:23.924036 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838f88c1-741c-4dbb-9bbd-96a40697e045 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:23.926357 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838f88c1-741c-4dbb-9bbd-96a40697e045 service cinder] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:23.937325 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-e1a2b7ce-86e1-4a61-bdda-53f00c651234 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d2cd770e4ff4b1fa592cceb6656fa6b', 'request_id': 'req-e1a2b7ce-86e1-4a61-bdda-53f00c651234'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:23.942660 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 951/1914] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:30:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:30:23.948988 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-e1a2b7ce-86e1-4a61-bdda-53f00c651234 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d2cd770e4ff4b1fa592cceb6656fa6b', 'request_id': 'req-e1a2b7ce-86e1-4a61-bdda-53f00c651234'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:23.957731 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-e1a2b7ce-86e1-4a61-bdda-53f00c651234 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d2cd770e4ff4b1fa592cceb6656fa6b', 'request_id': 'req-e1a2b7ce-86e1-4a61-bdda-53f00c651234'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:23.971102 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-e1a2b7ce-86e1-4a61-bdda-53f00c651234 admin admin] The token cache is being invalidate because project 3d2cd770e4ff4b1fa592cceb6656fa6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:30:23.971440 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-e1a2b7ce-86e1-4a61-bdda-53f00c651234 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:23.972265 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-e1a2b7ce-86e1-4a61-bdda-53f00c651234 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:23.974030 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 964/1915] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:30:23 2022] DELETE /identity/v3/projects/3d2cd770e4ff4b1fa592cceb6656fa6b => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:23.980685 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838f88c1-741c-4dbb-9bbd-96a40697e045 service cinder] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:23.993251 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838f88c1-741c-4dbb-9bbd-96a40697e045 service cinder] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:24.068935 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ee3564-8d9e-453b-9308-e985bc7e00df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:24.069840 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee3564-8d9e-453b-9308-e985bc7e00df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:24.070290 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee3564-8d9e-453b-9308-e985bc7e00df admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:24.070633 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee3564-8d9e-453b-9308-e985bc7e00df admin admin] PATH_INFO: `/v3/users/196a6fb8e25f4d77983addaf60167d11` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:24.071936 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ee3564-8d9e-453b-9308-e985bc7e00df admin admin] RBAC: Authorizing `identity:delete_user(user_id=196a6fb8e25f4d77983addaf60167d11)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:24.073941 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ee3564-8d9e-453b-9308-e985bc7e00df admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:24.109823 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:24.149200 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-13ee3564-8d9e-453b-9308-e985bc7e00df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '196a6fb8e25f4d77983addaf60167d11'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:24.164461 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-13ee3564-8d9e-453b-9308-e985bc7e00df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '196a6fb8e25f4d77983addaf60167d11'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:24.227503 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-13ee3564-8d9e-453b-9308-e985bc7e00df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '196a6fb8e25f4d77983addaf60167d11'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:24.229661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-13ee3564-8d9e-453b-9308-e985bc7e00df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '196a6fb8e25f4d77983addaf60167d11'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:24.231032 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-13ee3564-8d9e-453b-9308-e985bc7e00df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '196a6fb8e25f4d77983addaf60167d11'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:24.234958 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2b7ce-86e1-4a61-bdda-53f00c651234 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:24.236648 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-e1a2b7ce-86e1-4a61-bdda-53f00c651234 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:24.253130 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 952/1916] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:30:23 2022] DELETE /identity/v3/users/196a6fb8e25f4d77983addaf60167d11 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:24.366967 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2b7ce-86e1-4a61-bdda-53f00c651234 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:24.459192 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087d258c-0dd6-40d0-8ad3-397964dd3594 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:24.460299 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d258c-0dd6-40d0-8ad3-397964dd3594 service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:24.460795 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d258c-0dd6-40d0-8ad3-397964dd3594 service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:24.461532 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d258c-0dd6-40d0-8ad3-397964dd3594 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:24.469570 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-087d258c-0dd6-40d0-8ad3-397964dd3594 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:24.567829 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:24.601580 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087d258c-0dd6-40d0-8ad3-397964dd3594 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:24.603989 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087d258c-0dd6-40d0-8ad3-397964dd3594 service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:24.617583 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 965/1917] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:30:24 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 15:30:25.416087 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ee3564-8d9e-453b-9308-e985bc7e00df admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:25.419852 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-13ee3564-8d9e-453b-9308-e985bc7e00df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:25.600297 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ee3564-8d9e-453b-9308-e985bc7e00df admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:25.605085 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd48a48-8090-41cc-9937-d9883960c7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:25.620443 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd48a48-8090-41cc-9937-d9883960c7f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:25.620793 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd48a48-8090-41cc-9937-d9883960c7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:25.621007 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd48a48-8090-41cc-9937-d9883960c7f4 admin admin] PATH_INFO: `/v3/projects/23c6286b8c4048f8847f875d80988d58` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:25.625338 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd48a48-8090-41cc-9937-d9883960c7f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23c6286b8c4048f8847f875d80988d58)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:25.628289 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd48a48-8090-41cc-9937-d9883960c7f4 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:25.687484 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087d258c-0dd6-40d0-8ad3-397964dd3594 service cinder] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:25.689412 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-087d258c-0dd6-40d0-8ad3-397964dd3594 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:25.710345 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087d258c-0dd6-40d0-8ad3-397964dd3594 service cinder] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:25.753311 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-7cd48a48-8090-41cc-9937-d9883960c7f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23c6286b8c4048f8847f875d80988d58', 'request_id': 'req-7cd48a48-8090-41cc-9937-d9883960c7f4'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:25.770911 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-7cd48a48-8090-41cc-9937-d9883960c7f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23c6286b8c4048f8847f875d80988d58', 'request_id': 'req-7cd48a48-8090-41cc-9937-d9883960c7f4'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:25.796598 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-7cd48a48-8090-41cc-9937-d9883960c7f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23c6286b8c4048f8847f875d80988d58', 'request_id': 'req-7cd48a48-8090-41cc-9937-d9883960c7f4'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:25.807902 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21361a59-a29e-49f6-9482-4478bab19837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:25.811636 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21361a59-a29e-49f6-9482-4478bab19837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:25.811922 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21361a59-a29e-49f6-9482-4478bab19837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:25.812268 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21361a59-a29e-49f6-9482-4478bab19837 admin admin] PATH_INFO: `/v3/projects/037f1340cbc54dd3acd3dc7b9734019c` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:25.814369 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21361a59-a29e-49f6-9482-4478bab19837 admin admin] RBAC: Authorizing `identity:delete_project(project_id=037f1340cbc54dd3acd3dc7b9734019c)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:25.817346 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21361a59-a29e-49f6-9482-4478bab19837 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:25.822727 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-7cd48a48-8090-41cc-9937-d9883960c7f4 admin admin] The token cache is being invalidate because project 23c6286b8c4048f8847f875d80988d58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80360) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:30:25.823689 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-7cd48a48-8090-41cc-9937-d9883960c7f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:25.827123 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-7cd48a48-8090-41cc-9937-d9883960c7f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:25.835108 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 953/1918] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:30:25 2022] DELETE /identity/v3/projects/23c6286b8c4048f8847f875d80988d58 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 15:30:25.839323 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd48a48-8090-41cc-9937-d9883960c7f4 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:25.846442 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-7cd48a48-8090-41cc-9937-d9883960c7f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:25.910516 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd48a48-8090-41cc-9937-d9883960c7f4 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:25.921421 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-21361a59-a29e-49f6-9482-4478bab19837 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '037f1340cbc54dd3acd3dc7b9734019c', 'request_id': 'req-21361a59-a29e-49f6-9482-4478bab19837'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:25.941287 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-21361a59-a29e-49f6-9482-4478bab19837 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '037f1340cbc54dd3acd3dc7b9734019c', 'request_id': 'req-21361a59-a29e-49f6-9482-4478bab19837'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:25.955122 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-21361a59-a29e-49f6-9482-4478bab19837 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '037f1340cbc54dd3acd3dc7b9734019c', 'request_id': 'req-21361a59-a29e-49f6-9482-4478bab19837'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:25.981968 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:25.994415 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-21361a59-a29e-49f6-9482-4478bab19837 admin admin] The token cache is being invalidate because project 037f1340cbc54dd3acd3dc7b9734019c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:30:25.994698 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-21361a59-a29e-49f6-9482-4478bab19837 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:25.995571 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-21361a59-a29e-49f6-9482-4478bab19837 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:25.999126 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 966/1919] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:30:25 2022] DELETE /identity/v3/projects/037f1340cbc54dd3acd3dc7b9734019c => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:26.004927 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a7629-1ea1-45fb-972d-b435bb809eff None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:26.005371 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a7629-1ea1-45fb-972d-b435bb809eff None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:26.007464 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a7629-1ea1-45fb-972d-b435bb809eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:26.047508 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-660a7629-1ea1-45fb-972d-b435bb809eff None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:26.047986 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4c2049-796f-4364-ba9d-1fbb5fa76531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:26.049081 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c2049-796f-4364-ba9d-1fbb5fa76531 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:26.049495 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c2049-796f-4364-ba9d-1fbb5fa76531 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:26.049902 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c2049-796f-4364-ba9d-1fbb5fa76531 admin admin] PATH_INFO: `/v3/users/b47d6dcd320842b69d752617db068938` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:26.050016 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-660a7629-1ea1-45fb-972d-b435bb809eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:26.051825 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4c2049-796f-4364-ba9d-1fbb5fa76531 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b47d6dcd320842b69d752617db068938)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:26.055424 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4c2049-796f-4364-ba9d-1fbb5fa76531 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:26.067676 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 967/1920] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:30:26.071167 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c99c22-d065-4f45-8863-b7a6205ab093 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:26.075185 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c99c22-d065-4f45-8863-b7a6205ab093 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:26.075623 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c99c22-d065-4f45-8863-b7a6205ab093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:26.109695 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-91c99c22-d065-4f45-8863-b7a6205ab093 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:26.111115 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-91c99c22-d065-4f45-8863-b7a6205ab093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:26.124000 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 968/1921] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:30:26.130358 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c99c22-d065-4f45-8863-b7a6205ab093 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:26.139105 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-2d4c2049-796f-4364-ba9d-1fbb5fa76531 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b47d6dcd320842b69d752617db068938'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:26.155568 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c99c22-d065-4f45-8863-b7a6205ab093 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:26.165258 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14db383-32f3-4e92-b74f-950b30875f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:26.165900 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14db383-32f3-4e92-b74f-950b30875f2f admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:26.166178 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14db383-32f3-4e92-b74f-950b30875f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:26.166506 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14db383-32f3-4e92-b74f-950b30875f2f admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:26.167319 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14db383-32f3-4e92-b74f-950b30875f2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:30:26.167538 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14db383-32f3-4e92-b74f-950b30875f2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:26.173447 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14db383-32f3-4e92-b74f-950b30875f2f admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:26.196318 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-2d4c2049-796f-4364-ba9d-1fbb5fa76531 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b47d6dcd320842b69d752617db068938'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:26.224887 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 969/1922] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 2 15:30:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:30:26.224887 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14db383-32f3-4e92-b74f-950b30875f2f admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:26.237605 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-2d4c2049-796f-4364-ba9d-1fbb5fa76531 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b47d6dcd320842b69d752617db068938'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:26.243082 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-2d4c2049-796f-4364-ba9d-1fbb5fa76531 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b47d6dcd320842b69d752617db068938'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:26.243952 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-2d4c2049-796f-4364-ba9d-1fbb5fa76531 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b47d6dcd320842b69d752617db068938'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:26.244713 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14db383-32f3-4e92-b74f-950b30875f2f admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:26.258960 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace95831-aeea-4f50-9517-cdc10e799bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:26.259761 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace95831-aeea-4f50-9517-cdc10e799bba admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:26.260047 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace95831-aeea-4f50-9517-cdc10e799bba admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:26.261623 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace95831-aeea-4f50-9517-cdc10e799bba admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:26.262751 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace95831-aeea-4f50-9517-cdc10e799bba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:26.270677 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 954/1923] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:30:25 2022] DELETE /identity/v3/users/b47d6dcd320842b69d752617db068938 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:26.272598 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace95831-aeea-4f50-9517-cdc10e799bba admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:26.331562 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 970/1924] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:30:26 2022] POST /identity/v3/projects => generated 401 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:30:26.332381 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4c2049-796f-4364-ba9d-1fbb5fa76531 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:26.333840 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-2d4c2049-796f-4364-ba9d-1fbb5fa76531 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:26.485935 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4c2049-796f-4364-ba9d-1fbb5fa76531 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:26.570049 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:26.583944 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ac5855-b651-4947-8582-0c5fc0ee9c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:26.584600 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac5855-b651-4947-8582-0c5fc0ee9c6a admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:26.584887 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac5855-b651-4947-8582-0c5fc0ee9c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:26.585173 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac5855-b651-4947-8582-0c5fc0ee9c6a admin admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:26.585835 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ac5855-b651-4947-8582-0c5fc0ee9c6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:26.588401 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ac5855-b651-4947-8582-0c5fc0ee9c6a admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:26.653089 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 955/1925] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:30:26 2022] POST /identity/v3/users => generated 301 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 15:30:26.657381 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace95831-aeea-4f50-9517-cdc10e799bba admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:26.675317 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace95831-aeea-4f50-9517-cdc10e799bba admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:26.690266 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951e8c49-8af4-4a51-9f16-f0b25c84e85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:26.691028 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e8c49-8af4-4a51-9f16-f0b25c84e85d admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:26.692065 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e8c49-8af4-4a51-9f16-f0b25c84e85d admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:26.692065 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e8c49-8af4-4a51-9f16-f0b25c84e85d admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:26.693400 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951e8c49-8af4-4a51-9f16-f0b25c84e85d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:26.699514 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951e8c49-8af4-4a51-9f16-f0b25c84e85d admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:26.720361 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 971/1926] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:30:26 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:30:26.724647 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ac5855-b651-4947-8582-0c5fc0ee9c6a admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:26.742771 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ac5855-b651-4947-8582-0c5fc0ee9c6a admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:26.750919 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4df467-99b2-4b86-88d7-25b168002d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:26.751688 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4df467-99b2-4b86-88d7-25b168002d1e admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:26.752239 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4df467-99b2-4b86-88d7-25b168002d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:26.752576 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4df467-99b2-4b86-88d7-25b168002d1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:26.753274 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4df467-99b2-4b86-88d7-25b168002d1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:26.755110 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4df467-99b2-4b86-88d7-25b168002d1e admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:26.767777 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 956/1927] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:30:26 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 15:30:26.771669 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951e8c49-8af4-4a51-9f16-f0b25c84e85d admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:26.784560 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951e8c49-8af4-4a51-9f16-f0b25c84e85d admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:26.791311 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc7113d-975d-4ba6-888d-5f80a50c8652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:26.792141 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7113d-975d-4ba6-888d-5f80a50c8652 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:26.792527 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7113d-975d-4ba6-888d-5f80a50c8652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:26.792930 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7113d-975d-4ba6-888d-5f80a50c8652 admin admin] PATH_INFO: `/v3/projects/fd7207fe712f4e9abf6ab7d3f64f1b20/users/6c85ac1f595143e48dae9067746cf8a8/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:26.809600 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:26.818263 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc7113d-975d-4ba6-888d-5f80a50c8652 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd7207fe712f4e9abf6ab7d3f64f1b20, user_id=6c85ac1f595143e48dae9067746cf8a8, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:26.823516 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc7113d-975d-4ba6-888d-5f80a50c8652 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:26.847809 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 972/1928] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:30:26 2022] PUT /identity/v3/projects/fd7207fe712f4e9abf6ab7d3f64f1b20/users/6c85ac1f595143e48dae9067746cf8a8/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:26.858082 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae4b30d-856f-4d2f-b263-09655db4dbdd None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:26.858382 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae4b30d-856f-4d2f-b263-09655db4dbdd None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:26.859060 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae4b30d-856f-4d2f-b263-09655db4dbdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:26.893512 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-9ae4b30d-856f-4d2f-b263-09655db4dbdd None None] MFA Rules not processed for user `6c85ac1f595143e48dae9067746cf8a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:26.895311 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-9ae4b30d-856f-4d2f-b263-09655db4dbdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:26.978237 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 957/1929] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:26 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:30:26.985306 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc7113d-975d-4ba6-888d-5f80a50c8652 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:27.069078 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc7113d-975d-4ba6-888d-5f80a50c8652 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:27.073801 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a67934-4d0d-44de-8181-2e0b460785f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:27.074452 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a67934-4d0d-44de-8181-2e0b460785f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:27.074733 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a67934-4d0d-44de-8181-2e0b460785f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:27.075003 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a67934-4d0d-44de-8181-2e0b460785f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:27.075707 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a67934-4d0d-44de-8181-2e0b460785f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:27.077672 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a67934-4d0d-44de-8181-2e0b460785f4 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:27.109668 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 973/1930] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:30:26 2022] POST /identity/v3/projects => generated 401 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 15:30:27.113958 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae4b30d-856f-4d2f-b263-09655db4dbdd None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:27.129846 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae4b30d-856f-4d2f-b263-09655db4dbdd None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:27.235245 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb5e418-7903-42e2-8ecb-376446e9943e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:27.235245 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5e418-7903-42e2-8ecb-376446e9943e admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:27.235245 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5e418-7903-42e2-8ecb-376446e9943e admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:27.235245 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5e418-7903-42e2-8ecb-376446e9943e admin admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:27.235666 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb5e418-7903-42e2-8ecb-376446e9943e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:27.235666 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb5e418-7903-42e2-8ecb-376446e9943e admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:27.276479 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a67934-4d0d-44de-8181-2e0b460785f4 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:27.283494 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 958/1931] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:30:27 2022] POST /identity/v3/users => generated 307 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:30:27.292161 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a67934-4d0d-44de-8181-2e0b460785f4 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:27.299946 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c385b1-71b8-4039-94d3-021359d00834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:27.301368 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c385b1-71b8-4039-94d3-021359d00834 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:27.301833 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c385b1-71b8-4039-94d3-021359d00834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:27.302113 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c385b1-71b8-4039-94d3-021359d00834 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:27.303429 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c385b1-71b8-4039-94d3-021359d00834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:27.305168 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c385b1-71b8-4039-94d3-021359d00834 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:27.322945 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 974/1932] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:30:27.324114 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb5e418-7903-42e2-8ecb-376446e9943e admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:27.336951 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb5e418-7903-42e2-8ecb-376446e9943e admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:27.345078 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ffa8b9-1b6b-4524-8472-86dd4c92d234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:27.345803 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffa8b9-1b6b-4524-8472-86dd4c92d234 admin admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:27.346089 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffa8b9-1b6b-4524-8472-86dd4c92d234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:27.346375 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffa8b9-1b6b-4524-8472-86dd4c92d234 admin admin] PATH_INFO: `/v3/projects/6dbec6000d8e498ba3c28d074ae241d6/users/3b223a988ccf407bb0797d6c7861e7f1/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:27.370455 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ffa8b9-1b6b-4524-8472-86dd4c92d234 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dbec6000d8e498ba3c28d074ae241d6, user_id=3b223a988ccf407bb0797d6c7861e7f1, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:27.373366 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ffa8b9-1b6b-4524-8472-86dd4c92d234 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:27.380704 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c385b1-71b8-4039-94d3-021359d00834 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:27.382969 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-f3c385b1-71b8-4039-94d3-021359d00834 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:27.400123 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 959/1933] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:30:27 2022] PUT /identity/v3/projects/6dbec6000d8e498ba3c28d074ae241d6/users/3b223a988ccf407bb0797d6c7861e7f1/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:27.400631 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c385b1-71b8-4039-94d3-021359d00834 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:27.401618 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ffa8b9-1b6b-4524-8472-86dd4c92d234 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:27.460619 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:27.471319 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7908142d-4920-4aa1-86e5-6845c729193e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:27.471982 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908142d-4920-4aa1-86e5-6845c729193e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:27.472273 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908142d-4920-4aa1-86e5-6845c729193e admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:27.473050 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908142d-4920-4aa1-86e5-6845c729193e admin admin] PATH_INFO: `/v3/projects/ace45547333a43a7ae789c6c6076ec40` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:27.474446 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7908142d-4920-4aa1-86e5-6845c729193e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ace45547333a43a7ae789c6c6076ec40)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:27.476428 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7908142d-4920-4aa1-86e5-6845c729193e admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:27.501265 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ffa8b9-1b6b-4524-8472-86dd4c92d234 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:27.506424 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a0c48f-f0a9-452a-b9b1-5b868cc771eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:27.507109 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0c48f-f0a9-452a-b9b1-5b868cc771eb admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:27.507485 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0c48f-f0a9-452a-b9b1-5b868cc771eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:27.507763 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0c48f-f0a9-452a-b9b1-5b868cc771eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:27.508468 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a0c48f-f0a9-452a-b9b1-5b868cc771eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:27.510095 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a0c48f-f0a9-452a-b9b1-5b868cc771eb admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:27.524892 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 960/1934] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 15:30:27.526439 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a0c48f-f0a9-452a-b9b1-5b868cc771eb admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:27.543960 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a0c48f-f0a9-452a-b9b1-5b868cc771eb admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:27.544187 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-7908142d-4920-4aa1-86e5-6845c729193e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ace45547333a43a7ae789c6c6076ec40', 'request_id': 'req-7908142d-4920-4aa1-86e5-6845c729193e'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:27.558099 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-7908142d-4920-4aa1-86e5-6845c729193e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ace45547333a43a7ae789c6c6076ec40', 'request_id': 'req-7908142d-4920-4aa1-86e5-6845c729193e'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:27.565234 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-7908142d-4920-4aa1-86e5-6845c729193e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ace45547333a43a7ae789c6c6076ec40', 'request_id': 'req-7908142d-4920-4aa1-86e5-6845c729193e'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:27.569455 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:27.581096 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-7908142d-4920-4aa1-86e5-6845c729193e admin admin] The token cache is being invalidate because project ace45547333a43a7ae789c6c6076ec40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:30:27.581895 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-7908142d-4920-4aa1-86e5-6845c729193e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:27.583129 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-7908142d-4920-4aa1-86e5-6845c729193e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:27.585731 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 975/1935] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:30:27 2022] DELETE /identity/v3/projects/ace45547333a43a7ae789c6c6076ec40 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:27.592366 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6abf27-3361-44dc-ae1a-131c6d9e36f2 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:27.597607 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6abf27-3361-44dc-ae1a-131c6d9e36f2 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:27.597607 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6abf27-3361-44dc-ae1a-131c6d9e36f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:27.617880 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-fc6abf27-3361-44dc-ae1a-131c6d9e36f2 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:27.619925 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-fc6abf27-3361-44dc-ae1a-131c6d9e36f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:27.630086 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79657fff-9d34-4624-a3cb-ff7002e5c5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:27.631070 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79657fff-9d34-4624-a3cb-ff7002e5c5c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:27.631298 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79657fff-9d34-4624-a3cb-ff7002e5c5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:27.631748 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79657fff-9d34-4624-a3cb-ff7002e5c5c6 admin admin] PATH_INFO: `/v3/projects/6dbec6000d8e498ba3c28d074ae241d6/users/3b223a988ccf407bb0797d6c7861e7f1/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:27.634945 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79657fff-9d34-4624-a3cb-ff7002e5c5c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dbec6000d8e498ba3c28d074ae241d6, user_id=3b223a988ccf407bb0797d6c7861e7f1, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:27.638850 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79657fff-9d34-4624-a3cb-ff7002e5c5c6 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:27.667750 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 961/1936] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:30:27 2022] PUT /identity/v3/projects/6dbec6000d8e498ba3c28d074ae241d6/users/3b223a988ccf407bb0797d6c7861e7f1/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:27.681343 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678a023-1b11-40db-9887-06332ea2b1cf None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:27.681768 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678a023-1b11-40db-9887-06332ea2b1cf None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:27.682128 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678a023-1b11-40db-9887-06332ea2b1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:27.711373 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 976/1937] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:30:27.718698 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ecf3d5-efaa-494f-9a04-774cde47ef5c None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:27.718990 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ecf3d5-efaa-494f-9a04-774cde47ef5c None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:27.719298 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ecf3d5-efaa-494f-9a04-774cde47ef5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:27.719765 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-4678a023-1b11-40db-9887-06332ea2b1cf None None] MFA Rules not processed for user `3b223a988ccf407bb0797d6c7861e7f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:27.721664 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-4678a023-1b11-40db-9887-06332ea2b1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:27.772733 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-76ecf3d5-efaa-494f-9a04-774cde47ef5c None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:27.774373 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-76ecf3d5-efaa-494f-9a04-774cde47ef5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:27.830329 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 962/1938] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:27 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:30:27.844024 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4678a023-1b11-40db-9887-06332ea2b1cf None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:27.846312 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-4678a023-1b11-40db-9887-06332ea2b1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:27.863257 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 977/1939] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:30:27.867513 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ecf3d5-efaa-494f-9a04-774cde47ef5c None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:27.886105 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ecf3d5-efaa-494f-9a04-774cde47ef5c None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:27.896624 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74cf8b7-c3b7-4d42-8eff-931f414abb06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:27.898618 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74cf8b7-c3b7-4d42-8eff-931f414abb06 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:27.898618 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74cf8b7-c3b7-4d42-8eff-931f414abb06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:27.898618 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74cf8b7-c3b7-4d42-8eff-931f414abb06 admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:27.898618 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74cf8b7-c3b7-4d42-8eff-931f414abb06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:30:27.899132 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74cf8b7-c3b7-4d42-8eff-931f414abb06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:27.900956 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74cf8b7-c3b7-4d42-8eff-931f414abb06 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:27.918707 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 978/1940] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 2 15:30:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:30:27.919956 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74cf8b7-c3b7-4d42-8eff-931f414abb06 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:27.930836 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74cf8b7-c3b7-4d42-8eff-931f414abb06 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:27.936604 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a134c70f-02ac-4b1a-83fe-6d0b72ff93c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:27.937240 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134c70f-02ac-4b1a-83fe-6d0b72ff93c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:27.937525 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134c70f-02ac-4b1a-83fe-6d0b72ff93c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:27.937803 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134c70f-02ac-4b1a-83fe-6d0b72ff93c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:27.938684 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a134c70f-02ac-4b1a-83fe-6d0b72ff93c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:27.940703 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a134c70f-02ac-4b1a-83fe-6d0b72ff93c0 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:27.941240 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:27.962923 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4678a023-1b11-40db-9887-06332ea2b1cf None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:27.968050 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9276114-b3d2-429f-b71b-4a38caa425fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:27.968876 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9276114-b3d2-429f-b71b-4a38caa425fb service cinder] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:27.969598 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9276114-b3d2-429f-b71b-4a38caa425fb service cinder] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:27.969881 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9276114-b3d2-429f-b71b-4a38caa425fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:27.985899 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 979/1941] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:30:27 2022] POST /identity/v3/projects => generated 407 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:30:27.986129 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9276114-b3d2-429f-b71b-4a38caa425fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:27.987146 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9276114-b3d2-429f-b71b-4a38caa425fb service cinder] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:27.989200 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a134c70f-02ac-4b1a-83fe-6d0b72ff93c0 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:28.013809 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 963/1942] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:30:27 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 15:30:28.069819 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a134c70f-02ac-4b1a-83fe-6d0b72ff93c0 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:28.075517 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d6fb7-8257-47ce-9184-b75da64f8434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:28.076139 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d6fb7-8257-47ce-9184-b75da64f8434 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:28.076420 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d6fb7-8257-47ce-9184-b75da64f8434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:28.076848 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d6fb7-8257-47ce-9184-b75da64f8434 admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:28.077511 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160d6fb7-8257-47ce-9184-b75da64f8434 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:28.079515 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160d6fb7-8257-47ce-9184-b75da64f8434 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:28.088211 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:28.095289 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9276114-b3d2-429f-b71b-4a38caa425fb service cinder] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:28.106892 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 980/1943] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:30:27 2022] POST /identity/v3/users => generated 304 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:30:28.107689 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9276114-b3d2-429f-b71b-4a38caa425fb service cinder] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:28.110880 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d6fb7-8257-47ce-9184-b75da64f8434 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:28.122473 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d6fb7-8257-47ce-9184-b75da64f8434 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:28.128861 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f273e24-5e0b-497b-bd0c-ee1ea87fe6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:28.129487 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f273e24-5e0b-497b-bd0c-ee1ea87fe6ed admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:28.129771 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f273e24-5e0b-497b-bd0c-ee1ea87fe6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:28.130044 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f273e24-5e0b-497b-bd0c-ee1ea87fe6ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:28.130767 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f273e24-5e0b-497b-bd0c-ee1ea87fe6ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:28.132478 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f273e24-5e0b-497b-bd0c-ee1ea87fe6ed admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:28.146423 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 981/1944] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:30:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 15:30:28.152099 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f273e24-5e0b-497b-bd0c-ee1ea87fe6ed admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:28.168290 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f273e24-5e0b-497b-bd0c-ee1ea87fe6ed admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:28.169424 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b9811a-cecb-49e6-ab83-54d97c188e96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:28.170318 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b9811a-cecb-49e6-ab83-54d97c188e96 service cinder] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:28.170602 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b9811a-cecb-49e6-ab83-54d97c188e96 service cinder] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:28.170879 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b9811a-cecb-49e6-ab83-54d97c188e96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:28.172679 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-e0b9811a-cecb-49e6-ab83-54d97c188e96 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:28.173431 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e8187f-c419-4d4d-8b40-38f053b58400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:28.174067 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e8187f-c419-4d4d-8b40-38f053b58400 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:28.174338 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e8187f-c419-4d4d-8b40-38f053b58400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:28.174691 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e8187f-c419-4d4d-8b40-38f053b58400 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:28.175346 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e8187f-c419-4d4d-8b40-38f053b58400 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:28.177195 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e8187f-c419-4d4d-8b40-38f053b58400 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:28.193442 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 982/1945] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:30:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:30:28.195084 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e8187f-c419-4d4d-8b40-38f053b58400 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:28.209344 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e8187f-c419-4d4d-8b40-38f053b58400 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:28.216177 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c6ce61-3dc8-4d06-a1a3-91234bbc7b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:28.216917 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6ce61-3dc8-4d06-a1a3-91234bbc7b01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:28.217201 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6ce61-3dc8-4d06-a1a3-91234bbc7b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:28.217482 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6ce61-3dc8-4d06-a1a3-91234bbc7b01 admin admin] PATH_INFO: `/v3/projects/fdf13a96519e4ab28ca1a04e0f383404/users/f0d58e9105b34ad496436dbf1cbec630/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:28.233734 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c6ce61-3dc8-4d06-a1a3-91234bbc7b01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdf13a96519e4ab28ca1a04e0f383404, user_id=f0d58e9105b34ad496436dbf1cbec630, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:28.236576 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c6ce61-3dc8-4d06-a1a3-91234bbc7b01 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:28.245018 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b9811a-cecb-49e6-ab83-54d97c188e96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:28.247151 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b9811a-cecb-49e6-ab83-54d97c188e96 service cinder] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:28.256180 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 983/1946] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:30:28 2022] PUT /identity/v3/projects/fdf13a96519e4ab28ca1a04e0f383404/users/f0d58e9105b34ad496436dbf1cbec630/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:28.265102 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 964/1947] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:30:28 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:30:28.268096 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0939f7-b706-4d10-89a9-03d0f8eb30a9 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:28.268390 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0939f7-b706-4d10-89a9-03d0f8eb30a9 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:28.268672 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0939f7-b706-4d10-89a9-03d0f8eb30a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:28.301906 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-7a0939f7-b706-4d10-89a9-03d0f8eb30a9 None None] MFA Rules not processed for user `f0d58e9105b34ad496436dbf1cbec630`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:28.305543 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-7a0939f7-b706-4d10-89a9-03d0f8eb30a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:28.399965 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 984/1948] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:28 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:30:28.404867 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b9811a-cecb-49e6-ab83-54d97c188e96 service cinder] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:28.418132 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b9811a-cecb-49e6-ab83-54d97c188e96 service cinder] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:28.522161 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d8bde0-1b02-4220-9bd6-7eb0ad475dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:28.523193 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8bde0-1b02-4220-9bd6-7eb0ad475dec admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:28.523764 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8bde0-1b02-4220-9bd6-7eb0ad475dec admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:28.524119 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8bde0-1b02-4220-9bd6-7eb0ad475dec admin admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:28.525150 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d8bde0-1b02-4220-9bd6-7eb0ad475dec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:28.527645 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d8bde0-1b02-4220-9bd6-7eb0ad475dec admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:28.583619 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 965/1949] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:30:28 2022] POST /identity/v3/projects => generated 409 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:30:28.588170 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0939f7-b706-4d10-89a9-03d0f8eb30a9 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:28.603264 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0939f7-b706-4d10-89a9-03d0f8eb30a9 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:28.674051 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e1fbc-d9d1-459e-9914-07d3f0fb28e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:28.674710 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e1fbc-d9d1-459e-9914-07d3f0fb28e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:28.675022 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e1fbc-d9d1-459e-9914-07d3f0fb28e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:28.675331 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e1fbc-d9d1-459e-9914-07d3f0fb28e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:28.676001 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e1fbc-d9d1-459e-9914-07d3f0fb28e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:28.677992 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e1fbc-d9d1-459e-9914-07d3f0fb28e8 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:28.700597 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 985/1950] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:30:28 2022] POST /identity/v3/users => generated 311 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:30:28.704810 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d8bde0-1b02-4220-9bd6-7eb0ad475dec admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:28.715847 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d8bde0-1b02-4220-9bd6-7eb0ad475dec admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:28.721822 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbc89e9-f153-499a-8622-44c499f3b031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:28.723426 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc89e9-f153-499a-8622-44c499f3b031 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:28.723831 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc89e9-f153-499a-8622-44c499f3b031 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:28.724126 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc89e9-f153-499a-8622-44c499f3b031 admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:28.725906 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbc89e9-f153-499a-8622-44c499f3b031 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:28.726740 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbc89e9-f153-499a-8622-44c499f3b031 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:28.741875 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 966/1951] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:30:28 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 15:30:28.747289 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e1fbc-d9d1-459e-9914-07d3f0fb28e8 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:28.799941 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e1fbc-d9d1-459e-9914-07d3f0fb28e8 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:28.819713 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6039433e-9d6a-4c79-82c7-c6f5eca39bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:28.821048 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039433e-9d6a-4c79-82c7-c6f5eca39bf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:28.821330 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039433e-9d6a-4c79-82c7-c6f5eca39bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:28.821607 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039433e-9d6a-4c79-82c7-c6f5eca39bf8 admin admin] PATH_INFO: `/v3/projects/f4cfad2e66354483801d753015b11493/users/6e07509f3573424991898bc4125f2c68/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:28.862374 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6039433e-9d6a-4c79-82c7-c6f5eca39bf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4cfad2e66354483801d753015b11493, user_id=6e07509f3573424991898bc4125f2c68, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:28.865121 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6039433e-9d6a-4c79-82c7-c6f5eca39bf8 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:28.884036 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:28.901907 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 986/1952] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:30:28 2022] PUT /identity/v3/projects/f4cfad2e66354483801d753015b11493/users/6e07509f3573424991898bc4125f2c68/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 15:30:28.905165 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbc89e9-f153-499a-8622-44c499f3b031 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:28.925893 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbc89e9-f153-499a-8622-44c499f3b031 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:28.969143 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:29.100711 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233023bc-91a6-4997-99d3-5474bf929a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:29.101510 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233023bc-91a6-4997-99d3-5474bf929a7a admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:29.101896 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233023bc-91a6-4997-99d3-5474bf929a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:29.102277 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233023bc-91a6-4997-99d3-5474bf929a7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:29.105008 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233023bc-91a6-4997-99d3-5474bf929a7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:29.110253 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233023bc-91a6-4997-99d3-5474bf929a7a admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:29.142730 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 967/1953] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:30:28 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:30:29.152833 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6039433e-9d6a-4c79-82c7-c6f5eca39bf8 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:29.168095 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6039433e-9d6a-4c79-82c7-c6f5eca39bf8 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:29.184842 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b392792-77e0-4fe9-a31c-cfde41238e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:29.185567 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b392792-77e0-4fe9-a31c-cfde41238e46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:29.187680 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b392792-77e0-4fe9-a31c-cfde41238e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:29.187680 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b392792-77e0-4fe9-a31c-cfde41238e46 admin admin] PATH_INFO: `/v3/projects/f4cfad2e66354483801d753015b11493/users/6e07509f3573424991898bc4125f2c68/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:29.192937 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b392792-77e0-4fe9-a31c-cfde41238e46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4cfad2e66354483801d753015b11493, user_id=6e07509f3573424991898bc4125f2c68, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:29.198714 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b392792-77e0-4fe9-a31c-cfde41238e46 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:29.230309 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 987/1954] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:30:29 2022] PUT /identity/v3/projects/f4cfad2e66354483801d753015b11493/users/6e07509f3573424991898bc4125f2c68/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:29.242486 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a8da0f-d8ea-420f-985a-9d33ee79a940 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:29.243000 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a8da0f-d8ea-420f-985a-9d33ee79a940 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:29.243410 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a8da0f-d8ea-420f-985a-9d33ee79a940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:29.296882 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-d7a8da0f-d8ea-420f-985a-9d33ee79a940 None None] MFA Rules not processed for user `6e07509f3573424991898bc4125f2c68`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:29.299917 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-d7a8da0f-d8ea-420f-985a-9d33ee79a940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:29.443018 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 968/1955] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:29 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:30:29.452907 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b392792-77e0-4fe9-a31c-cfde41238e46 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:29.454684 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-5b392792-77e0-4fe9-a31c-cfde41238e46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:29.540821 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b392792-77e0-4fe9-a31c-cfde41238e46 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:29.548593 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f13214-769f-4276-9b95-ad80b801b6f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:29.549242 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f13214-769f-4276-9b95-ad80b801b6f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:29.549527 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f13214-769f-4276-9b95-ad80b801b6f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:29.549807 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f13214-769f-4276-9b95-ad80b801b6f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:29.561152 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f13214-769f-4276-9b95-ad80b801b6f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:29.562752 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f13214-769f-4276-9b95-ad80b801b6f2 service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:29.574101 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 988/1956] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:30:29 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 15:30:29.932696 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a8da0f-d8ea-420f-985a-9d33ee79a940 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:29.954377 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a8da0f-d8ea-420f-985a-9d33ee79a940 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:29.960073 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ecde8-7e4a-4fb6-8eb6-d668e1990c47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:29.964265 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ecde8-7e4a-4fb6-8eb6-d668e1990c47 service cinder] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:29.964827 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ecde8-7e4a-4fb6-8eb6-d668e1990c47 service cinder] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:29.965635 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ecde8-7e4a-4fb6-8eb6-d668e1990c47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:30.077882 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4ecde8-7e4a-4fb6-8eb6-d668e1990c47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:30.086008 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4ecde8-7e4a-4fb6-8eb6-d668e1990c47 service cinder] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:30.109980 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 969/1957] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:30:29 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:30:34.044374 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf1a08-8705-4afc-84b3-a5bb3b27616f None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:34.045306 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf1a08-8705-4afc-84b3-a5bb3b27616f None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:34.045306 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf1a08-8705-4afc-84b3-a5bb3b27616f None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:34.046747 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 989/1958] 10.222.0.42 () {54 vars in 921 bytes} [Tue Aug 2 15:30:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:30:34.057249 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901518a-266a-4445-9d0d-56ed36e73764 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:34.057790 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901518a-266a-4445-9d0d-56ed36e73764 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:34.058026 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901518a-266a-4445-9d0d-56ed36e73764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:34.082959 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-5901518a-266a-4445-9d0d-56ed36e73764 None None] MFA Rules not processed for user `4c0865af59bf43dfa4c84213d7db53c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:34.084448 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-5901518a-266a-4445-9d0d-56ed36e73764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:34.124797 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:34.180407 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 970/1959] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Aug 2 15:30:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:30:34.193547 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf1a08-8705-4afc-84b3-a5bb3b27616f None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:34.197070 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-5faf1a08-8705-4afc-84b3-a5bb3b27616f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:34.217574 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf1a08-8705-4afc-84b3-a5bb3b27616f None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:34.222947 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7cabfe-a60c-4111-848d-212a75559d64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0865af59bf43dfa4c84213d7db53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:34.223587 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7cabfe-a60c-4111-848d-212a75559d64 service nova] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:34.223865 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7cabfe-a60c-4111-848d-212a75559d64 service nova] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:34.224137 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7cabfe-a60c-4111-848d-212a75559d64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:34.240787 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7cabfe-a60c-4111-848d-212a75559d64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:34.242408 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7cabfe-a60c-4111-848d-212a75559d64 service nova] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:34.253412 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 990/1960] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:30:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:30:37.996380 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5901518a-266a-4445-9d0d-56ed36e73764 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:37.998507 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-5901518a-266a-4445-9d0d-56ed36e73764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:38.075330 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5901518a-266a-4445-9d0d-56ed36e73764 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:38.080877 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c406885d-e483-45ef-a264-2a9933391a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:38.081535 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406885d-e483-45ef-a264-2a9933391a61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:38.081817 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406885d-e483-45ef-a264-2a9933391a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:38.082093 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406885d-e483-45ef-a264-2a9933391a61 admin admin] PATH_INFO: `/v3/users/6c85ac1f595143e48dae9067746cf8a8` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:38.083337 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c406885d-e483-45ef-a264-2a9933391a61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c85ac1f595143e48dae9067746cf8a8)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:38.085280 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c406885d-e483-45ef-a264-2a9933391a61 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:38.148806 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-c406885d-e483-45ef-a264-2a9933391a61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c85ac1f595143e48dae9067746cf8a8'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:38.161917 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-c406885d-e483-45ef-a264-2a9933391a61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c85ac1f595143e48dae9067746cf8a8'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:38.177791 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-c406885d-e483-45ef-a264-2a9933391a61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c85ac1f595143e48dae9067746cf8a8'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:38.179458 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-c406885d-e483-45ef-a264-2a9933391a61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c85ac1f595143e48dae9067746cf8a8'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:38.180507 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-c406885d-e483-45ef-a264-2a9933391a61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c85ac1f595143e48dae9067746cf8a8'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:38.201448 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 971/1961] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:30:37 2022] DELETE /identity/v3/users/6c85ac1f595143e48dae9067746cf8a8 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 15:30:38.206664 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177637ab-22fd-4356-b7e6-2fa36f913ffe None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:38.206664 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177637ab-22fd-4356-b7e6-2fa36f913ffe None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:38.207836 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177637ab-22fd-4356-b7e6-2fa36f913ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:38.234301 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-177637ab-22fd-4356-b7e6-2fa36f913ffe None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:38.235990 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-177637ab-22fd-4356-b7e6-2fa36f913ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:38.286757 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c406885d-e483-45ef-a264-2a9933391a61 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:38.288246 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-c406885d-e483-45ef-a264-2a9933391a61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:38.353187 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 991/1962] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:30:38.380822 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177637ab-22fd-4356-b7e6-2fa36f913ffe None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:38.386089 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-177637ab-22fd-4356-b7e6-2fa36f913ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:38.403661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:38.442479 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c406885d-e483-45ef-a264-2a9933391a61 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:38.451605 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b4b8e8-05c0-4bc6-9573-6eaefaab2721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:38.471775 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b4b8e8-05c0-4bc6-9573-6eaefaab2721 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:38.471775 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b4b8e8-05c0-4bc6-9573-6eaefaab2721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:38.471775 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b4b8e8-05c0-4bc6-9573-6eaefaab2721 admin admin] PATH_INFO: `/v3/users/f00f251f323f41378e6e7f189f46498d` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:38.471775 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b4b8e8-05c0-4bc6-9573-6eaefaab2721 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f00f251f323f41378e6e7f189f46498d)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:38.471775 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b4b8e8-05c0-4bc6-9573-6eaefaab2721 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:38.493258 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177637ab-22fd-4356-b7e6-2fa36f913ffe None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:38.508156 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fef44fa-ef7f-45d0-a14f-46a48fb66818 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:38.509580 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef44fa-ef7f-45d0-a14f-46a48fb66818 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:38.510946 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef44fa-ef7f-45d0-a14f-46a48fb66818 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:38.514297 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef44fa-ef7f-45d0-a14f-46a48fb66818 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:38.545599 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fef44fa-ef7f-45d0-a14f-46a48fb66818 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:38.549017 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fef44fa-ef7f-45d0-a14f-46a48fb66818 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:38.572687 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 992/1963] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:30:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 15:30:38.617538 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-a9b4b8e8-05c0-4bc6-9573-6eaefaab2721 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f00f251f323f41378e6e7f189f46498d'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:38.636430 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-a9b4b8e8-05c0-4bc6-9573-6eaefaab2721 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f00f251f323f41378e6e7f189f46498d'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:38.700317 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-a9b4b8e8-05c0-4bc6-9573-6eaefaab2721 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f00f251f323f41378e6e7f189f46498d'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:38.702628 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-a9b4b8e8-05c0-4bc6-9573-6eaefaab2721 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f00f251f323f41378e6e7f189f46498d'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:38.706009 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-a9b4b8e8-05c0-4bc6-9573-6eaefaab2721 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f00f251f323f41378e6e7f189f46498d'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:38.779688 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 972/1964] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:30:38 2022] DELETE /identity/v3/users/f00f251f323f41378e6e7f189f46498d => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:38.784170 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23c482-4898-4267-b450-e5e4f13045dd None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:38.784723 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23c482-4898-4267-b450-e5e4f13045dd None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:38.785158 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23c482-4898-4267-b450-e5e4f13045dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:38.881898 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-7f23c482-4898-4267-b450-e5e4f13045dd None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:38.884985 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-7f23c482-4898-4267-b450-e5e4f13045dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:38.952369 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:39.178601 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 993/1965] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:30:39.232907 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b4b8e8-05c0-4bc6-9573-6eaefaab2721 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:39.234330 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-a9b4b8e8-05c0-4bc6-9573-6eaefaab2721 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:39.368394 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f23c482-4898-4267-b450-e5e4f13045dd None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:39.370529 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-7f23c482-4898-4267-b450-e5e4f13045dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:39.404944 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b4b8e8-05c0-4bc6-9573-6eaefaab2721 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:39.409689 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12901e4-02c1-424b-85c1-91f4bb01b024 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:39.411290 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12901e4-02c1-424b-85c1-91f4bb01b024 service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:39.411527 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12901e4-02c1-424b-85c1-91f4bb01b024 service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:39.412028 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12901e4-02c1-424b-85c1-91f4bb01b024 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:39.425467 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12901e4-02c1-424b-85c1-91f4bb01b024 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:39.425663 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f23c482-4898-4267-b450-e5e4f13045dd None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:39.427245 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12901e4-02c1-424b-85c1-91f4bb01b024 service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:39.434262 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92d4b10-0cfc-42b5-96e5-5b0ebf897627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:39.435853 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d4b10-0cfc-42b5-96e5-5b0ebf897627 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:39.436117 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d4b10-0cfc-42b5-96e5-5b0ebf897627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:39.436474 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d4b10-0cfc-42b5-96e5-5b0ebf897627 admin admin] PATH_INFO: `/v3/projects/fd7207fe712f4e9abf6ab7d3f64f1b20` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:39.455375 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 973/1966] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:30:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 15:30:39.456596 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92d4b10-0cfc-42b5-96e5-5b0ebf897627 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd7207fe712f4e9abf6ab7d3f64f1b20)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:39.459738 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92d4b10-0cfc-42b5-96e5-5b0ebf897627 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:39.577070 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-c92d4b10-0cfc-42b5-96e5-5b0ebf897627 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd7207fe712f4e9abf6ab7d3f64f1b20', 'request_id': 'req-c92d4b10-0cfc-42b5-96e5-5b0ebf897627'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:39.599101 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-c92d4b10-0cfc-42b5-96e5-5b0ebf897627 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd7207fe712f4e9abf6ab7d3f64f1b20', 'request_id': 'req-c92d4b10-0cfc-42b5-96e5-5b0ebf897627'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:39.611507 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-c92d4b10-0cfc-42b5-96e5-5b0ebf897627 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd7207fe712f4e9abf6ab7d3f64f1b20', 'request_id': 'req-c92d4b10-0cfc-42b5-96e5-5b0ebf897627'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:39.631960 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-c92d4b10-0cfc-42b5-96e5-5b0ebf897627 admin admin] The token cache is being invalidate because project fd7207fe712f4e9abf6ab7d3f64f1b20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:30:39.632567 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-c92d4b10-0cfc-42b5-96e5-5b0ebf897627 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:39.634583 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-c92d4b10-0cfc-42b5-96e5-5b0ebf897627 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:39.640379 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 994/1967] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:30:39 2022] DELETE /identity/v3/projects/fd7207fe712f4e9abf6ab7d3f64f1b20 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 15:30:39.642104 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12901e4-02c1-424b-85c1-91f4bb01b024 service neutron] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:39.659990 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12901e4-02c1-424b-85c1-91f4bb01b024 service neutron] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:39.786094 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fd1749-f1fb-432d-8f74-a4169472a688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:39.788047 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd1749-f1fb-432d-8f74-a4169472a688 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:39.788779 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd1749-f1fb-432d-8f74-a4169472a688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:39.789240 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd1749-f1fb-432d-8f74-a4169472a688 admin admin] PATH_INFO: `/v3/users/3b223a988ccf407bb0797d6c7861e7f1` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:39.790916 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fd1749-f1fb-432d-8f74-a4169472a688 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b223a988ccf407bb0797d6c7861e7f1)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:39.793677 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fd1749-f1fb-432d-8f74-a4169472a688 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:39.820952 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:39.879179 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-69fd1749-f1fb-432d-8f74-a4169472a688 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b223a988ccf407bb0797d6c7861e7f1'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:39.910875 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-69fd1749-f1fb-432d-8f74-a4169472a688 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b223a988ccf407bb0797d6c7861e7f1'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:39.931180 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-69fd1749-f1fb-432d-8f74-a4169472a688 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b223a988ccf407bb0797d6c7861e7f1'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:39.932376 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-69fd1749-f1fb-432d-8f74-a4169472a688 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b223a988ccf407bb0797d6c7861e7f1'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:39.933329 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-69fd1749-f1fb-432d-8f74-a4169472a688 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b223a988ccf407bb0797d6c7861e7f1'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:39.956266 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 974/1968] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:30:39 2022] DELETE /identity/v3/users/3b223a988ccf407bb0797d6c7861e7f1 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:40.141322 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92d4b10-0cfc-42b5-96e5-5b0ebf897627 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:40.142852 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-c92d4b10-0cfc-42b5-96e5-5b0ebf897627 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:40.171847 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92d4b10-0cfc-42b5-96e5-5b0ebf897627 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:40.250786 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ca5f7-d60c-49b4-a92d-ca256422ac17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:40.251497 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ca5f7-d60c-49b4-a92d-ca256422ac17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:40.251781 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ca5f7-d60c-49b4-a92d-ca256422ac17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:40.252554 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ca5f7-d60c-49b4-a92d-ca256422ac17 admin admin] PATH_INFO: `/v3/projects/3cd2a0b3b0f54a6cb1bc9589416ea232` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:40.254150 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667ca5f7-d60c-49b4-a92d-ca256422ac17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cd2a0b3b0f54a6cb1bc9589416ea232)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:40.256123 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667ca5f7-d60c-49b4-a92d-ca256422ac17 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:40.300721 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fd1749-f1fb-432d-8f74-a4169472a688 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:40.302146 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-69fd1749-f1fb-432d-8f74-a4169472a688 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:40.319254 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:40.320687 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fd1749-f1fb-432d-8f74-a4169472a688 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:40.329101 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-667ca5f7-d60c-49b4-a92d-ca256422ac17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cd2a0b3b0f54a6cb1bc9589416ea232', 'request_id': 'req-667ca5f7-d60c-49b4-a92d-ca256422ac17'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:40.341777 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-667ca5f7-d60c-49b4-a92d-ca256422ac17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cd2a0b3b0f54a6cb1bc9589416ea232', 'request_id': 'req-667ca5f7-d60c-49b4-a92d-ca256422ac17'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:40.356737 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-667ca5f7-d60c-49b4-a92d-ca256422ac17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cd2a0b3b0f54a6cb1bc9589416ea232', 'request_id': 'req-667ca5f7-d60c-49b4-a92d-ca256422ac17'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:40.372263 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-667ca5f7-d60c-49b4-a92d-ca256422ac17 admin admin] The token cache is being invalidate because project 3cd2a0b3b0f54a6cb1bc9589416ea232 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:30:40.372873 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-667ca5f7-d60c-49b4-a92d-ca256422ac17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:40.375925 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-667ca5f7-d60c-49b4-a92d-ca256422ac17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:40.378805 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 995/1969] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:30:40 2022] DELETE /identity/v3/projects/3cd2a0b3b0f54a6cb1bc9589416ea232 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:40.382699 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ca5f7-d60c-49b4-a92d-ca256422ac17 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:40.385017 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-667ca5f7-d60c-49b4-a92d-ca256422ac17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:40.414112 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee67bb9-7532-4813-bbdd-9aec602bfac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:40.415321 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee67bb9-7532-4813-bbdd-9aec602bfac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:40.415609 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee67bb9-7532-4813-bbdd-9aec602bfac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:40.415887 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee67bb9-7532-4813-bbdd-9aec602bfac5 admin admin] PATH_INFO: `/v3/projects/6dbec6000d8e498ba3c28d074ae241d6` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:40.418786 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee67bb9-7532-4813-bbdd-9aec602bfac5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dbec6000d8e498ba3c28d074ae241d6)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:40.425146 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee67bb9-7532-4813-bbdd-9aec602bfac5 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:40.474751 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ca5f7-d60c-49b4-a92d-ca256422ac17 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:40.487641 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-fee67bb9-7532-4813-bbdd-9aec602bfac5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dbec6000d8e498ba3c28d074ae241d6', 'request_id': 'req-fee67bb9-7532-4813-bbdd-9aec602bfac5'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:40.499571 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-fee67bb9-7532-4813-bbdd-9aec602bfac5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dbec6000d8e498ba3c28d074ae241d6', 'request_id': 'req-fee67bb9-7532-4813-bbdd-9aec602bfac5'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:40.506548 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-fee67bb9-7532-4813-bbdd-9aec602bfac5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dbec6000d8e498ba3c28d074ae241d6', 'request_id': 'req-fee67bb9-7532-4813-bbdd-9aec602bfac5'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:40.519579 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-fee67bb9-7532-4813-bbdd-9aec602bfac5 admin admin] The token cache is being invalidate because project 6dbec6000d8e498ba3c28d074ae241d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80360) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:30:40.519869 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-fee67bb9-7532-4813-bbdd-9aec602bfac5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:40.520537 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-fee67bb9-7532-4813-bbdd-9aec602bfac5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:40.523383 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 975/1970] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:30:40 2022] DELETE /identity/v3/projects/6dbec6000d8e498ba3c28d074ae241d6 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:40.528860 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa9bdb-3966-4c05-8081-5926d99782fd None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:40.529795 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa9bdb-3966-4c05-8081-5926d99782fd None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:40.530093 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa9bdb-3966-4c05-8081-5926d99782fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:40.560783 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fdd5a7-d2da-4129-86bf-3e1e9acb6444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:40.561989 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fdd5a7-d2da-4129-86bf-3e1e9acb6444 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:40.562621 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fdd5a7-d2da-4129-86bf-3e1e9acb6444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:40.563116 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fdd5a7-d2da-4129-86bf-3e1e9acb6444 admin admin] PATH_INFO: `/v3/users/073f786c6a994aa992c5714c352ba621` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:40.563601 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-61fa9bdb-3966-4c05-8081-5926d99782fd None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:40.564843 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-61fa9bdb-3966-4c05-8081-5926d99782fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:40.567098 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fdd5a7-d2da-4129-86bf-3e1e9acb6444 admin admin] RBAC: Authorizing `identity:delete_user(user_id=073f786c6a994aa992c5714c352ba621)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:40.569486 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fdd5a7-d2da-4129-86bf-3e1e9acb6444 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:40.579278 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 976/1971] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:30:40.581657 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f3627-f7b6-4d82-b367-a85f1878483d None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:40.581948 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f3627-f7b6-4d82-b367-a85f1878483d None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:40.582234 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f3627-f7b6-4d82-b367-a85f1878483d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:40.619247 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-5d7f3627-f7b6-4d82-b367-a85f1878483d None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:40.620636 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-5d7f3627-f7b6-4d82-b367-a85f1878483d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:40.630994 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 977/1972] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:30:40.634970 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f3627-f7b6-4d82-b367-a85f1878483d None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:40.641298 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-d2fdd5a7-d2da-4129-86bf-3e1e9acb6444 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '073f786c6a994aa992c5714c352ba621'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:40.645756 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f3627-f7b6-4d82-b367-a85f1878483d None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:40.653782 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93228143-138d-4d42-bd60-6291ffd91c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:40.654885 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93228143-138d-4d42-bd60-6291ffd91c9e admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:40.655445 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93228143-138d-4d42-bd60-6291ffd91c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:40.655932 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93228143-138d-4d42-bd60-6291ffd91c9e admin admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:40.656201 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-d2fdd5a7-d2da-4129-86bf-3e1e9acb6444 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '073f786c6a994aa992c5714c352ba621'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:40.657436 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93228143-138d-4d42-bd60-6291ffd91c9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:30:40.657578 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-d2fdd5a7-d2da-4129-86bf-3e1e9acb6444 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '073f786c6a994aa992c5714c352ba621'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:40.657670 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93228143-138d-4d42-bd60-6291ffd91c9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:40.665405 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93228143-138d-4d42-bd60-6291ffd91c9e admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:40.667404 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:40.678552 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-d2fdd5a7-d2da-4129-86bf-3e1e9acb6444 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '073f786c6a994aa992c5714c352ba621'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:40.686127 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 978/1973] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 2 15:30:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:30:40.688978 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93228143-138d-4d42-bd60-6291ffd91c9e admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:40.691622 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-d2fdd5a7-d2da-4129-86bf-3e1e9acb6444 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '073f786c6a994aa992c5714c352ba621'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:40.692514 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-93228143-138d-4d42-bd60-6291ffd91c9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:40.694007 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:40.702524 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 996/1974] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:30:40 2022] DELETE /identity/v3/users/073f786c6a994aa992c5714c352ba621 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:40.720197 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93228143-138d-4d42-bd60-6291ffd91c9e admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:40.796974 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2840197-8ca5-4a52-81dd-fdceda1fc4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:40.797619 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2840197-8ca5-4a52-81dd-fdceda1fc4f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:40.797901 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2840197-8ca5-4a52-81dd-fdceda1fc4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:40.798216 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2840197-8ca5-4a52-81dd-fdceda1fc4f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:40.798879 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2840197-8ca5-4a52-81dd-fdceda1fc4f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:40.801479 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2840197-8ca5-4a52-81dd-fdceda1fc4f4 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:40.858260 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 979/1975] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:30:40 2022] POST /identity/v3/projects => generated 379 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:30:40.859233 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fdd5a7-d2da-4129-86bf-3e1e9acb6444 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:40.869920 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fdd5a7-d2da-4129-86bf-3e1e9acb6444 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:40.991931 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec4a3b3-b3ba-4e15-aeb5-636973afa6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:40.993587 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4a3b3-b3ba-4e15-aeb5-636973afa6b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:40.994065 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4a3b3-b3ba-4e15-aeb5-636973afa6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:40.994725 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4a3b3-b3ba-4e15-aeb5-636973afa6b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:40.996317 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec4a3b3-b3ba-4e15-aeb5-636973afa6b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:41.000820 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec4a3b3-b3ba-4e15-aeb5-636973afa6b4 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:41.028823 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 997/1976] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:30:40 2022] POST /identity/v3/users => generated 290 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 15:30:41.034149 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2840197-8ca5-4a52-81dd-fdceda1fc4f4 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:41.057635 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2840197-8ca5-4a52-81dd-fdceda1fc4f4 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:41.065394 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1c42a6-d334-40fd-83a8-5bfd5379c5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:41.066175 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c42a6-d334-40fd-83a8-5bfd5379c5da admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:41.066533 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c42a6-d334-40fd-83a8-5bfd5379c5da admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:41.066863 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c42a6-d334-40fd-83a8-5bfd5379c5da admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:41.067713 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1c42a6-d334-40fd-83a8-5bfd5379c5da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:41.069607 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1c42a6-d334-40fd-83a8-5bfd5379c5da admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:41.091283 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 980/1977] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:30:41.096127 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec4a3b3-b3ba-4e15-aeb5-636973afa6b4 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:41.111265 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1c42a6-d334-40fd-83a8-5bfd5379c5da admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:41.112858 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec4a3b3-b3ba-4e15-aeb5-636973afa6b4 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:41.113214 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-9e1c42a6-d334-40fd-83a8-5bfd5379c5da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:41.121665 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4cf811-10ad-4a15-bd89-bf0ddd4fe9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:41.122623 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4cf811-10ad-4a15-bd89-bf0ddd4fe9db admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:41.122919 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4cf811-10ad-4a15-bd89-bf0ddd4fe9db admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:41.123007 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4cf811-10ad-4a15-bd89-bf0ddd4fe9db admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:41.124003 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4cf811-10ad-4a15-bd89-bf0ddd4fe9db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:41.139417 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4cf811-10ad-4a15-bd89-bf0ddd4fe9db admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:41.146163 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1c42a6-d334-40fd-83a8-5bfd5379c5da admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:41.158521 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2751eb-c8e0-4b71-b174-340ea6637d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:41.158521 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2751eb-c8e0-4b71-b174-340ea6637d65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:41.158521 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2751eb-c8e0-4b71-b174-340ea6637d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:41.158972 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2751eb-c8e0-4b71-b174-340ea6637d65 admin admin] PATH_INFO: `/v3/projects/5c64775e62374aa19a756a727db0b0d0` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:41.162909 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2751eb-c8e0-4b71-b174-340ea6637d65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c64775e62374aa19a756a727db0b0d0)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:41.165250 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2751eb-c8e0-4b71-b174-340ea6637d65 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:41.169405 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 998/1978] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:30:41.177526 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4cf811-10ad-4a15-bd89-bf0ddd4fe9db admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:41.193821 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4cf811-10ad-4a15-bd89-bf0ddd4fe9db admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:41.207660 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c74b0-8049-4076-bb8b-2cb10067a8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:41.208532 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c74b0-8049-4076-bb8b-2cb10067a8cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:41.208879 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c74b0-8049-4076-bb8b-2cb10067a8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:41.209160 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c74b0-8049-4076-bb8b-2cb10067a8cf admin admin] PATH_INFO: `/v3/projects/0cee194132cb4f098f731e723877a217/users/9233698e6d004ebea58dedc0bce39515/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:41.232678 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-3f2751eb-c8e0-4b71-b174-340ea6637d65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c64775e62374aa19a756a727db0b0d0', 'request_id': 'req-3f2751eb-c8e0-4b71-b174-340ea6637d65'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:41.236187 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562c74b0-8049-4076-bb8b-2cb10067a8cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cee194132cb4f098f731e723877a217, user_id=9233698e6d004ebea58dedc0bce39515, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:41.239713 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562c74b0-8049-4076-bb8b-2cb10067a8cf admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:41.243442 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-3f2751eb-c8e0-4b71-b174-340ea6637d65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c64775e62374aa19a756a727db0b0d0', 'request_id': 'req-3f2751eb-c8e0-4b71-b174-340ea6637d65'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:41.251912 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-3f2751eb-c8e0-4b71-b174-340ea6637d65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c64775e62374aa19a756a727db0b0d0', 'request_id': 'req-3f2751eb-c8e0-4b71-b174-340ea6637d65'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:41.254843 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 999/1979] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:30:41 2022] PUT /identity/v3/projects/0cee194132cb4f098f731e723877a217/users/9233698e6d004ebea58dedc0bce39515/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 15:30:41.267181 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a489a-8d1b-428c-888d-c1224b3c75a8 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:41.267767 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a489a-8d1b-428c-888d-c1224b3c75a8 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:41.268120 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a489a-8d1b-428c-888d-c1224b3c75a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:41.269392 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-3f2751eb-c8e0-4b71-b174-340ea6637d65 admin admin] The token cache is being invalidate because project 5c64775e62374aa19a756a727db0b0d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80360) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:30:41.269720 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-3f2751eb-c8e0-4b71-b174-340ea6637d65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:41.270401 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-3f2751eb-c8e0-4b71-b174-340ea6637d65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:41.271996 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 981/1980] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:30:41 2022] DELETE /identity/v3/projects/5c64775e62374aa19a756a727db0b0d0 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 15:30:41.278516 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805050d3-d1bc-4582-b449-b06ba3b3678c None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:41.278807 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805050d3-d1bc-4582-b449-b06ba3b3678c None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:41.279085 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805050d3-d1bc-4582-b449-b06ba3b3678c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:41.300782 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-805050d3-d1bc-4582-b449-b06ba3b3678c None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:41.302315 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-805050d3-d1bc-4582-b449-b06ba3b3678c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:41.307977 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-b38a489a-8d1b-428c-888d-c1224b3c75a8 None None] MFA Rules not processed for user `9233698e6d004ebea58dedc0bce39515`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:41.309235 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-b38a489a-8d1b-428c-888d-c1224b3c75a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:41.359150 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:41.380587 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 982/1981] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:30:41.383901 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1000/1982] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:30:41.389013 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805050d3-d1bc-4582-b449-b06ba3b3678c None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:41.390401 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-805050d3-d1bc-4582-b449-b06ba3b3678c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:41.393792 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b677fa4-144a-4132-bde2-d56f83bdf02d None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:41.394164 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b677fa4-144a-4132-bde2-d56f83bdf02d None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:41.394982 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b677fa4-144a-4132-bde2-d56f83bdf02d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:41.403509 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805050d3-d1bc-4582-b449-b06ba3b3678c None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:41.408736 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418852a5-5e82-4276-a84a-0b1757cda08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:41.409511 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418852a5-5e82-4276-a84a-0b1757cda08d admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:41.409807 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418852a5-5e82-4276-a84a-0b1757cda08d admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:41.410086 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418852a5-5e82-4276-a84a-0b1757cda08d admin admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:41.410983 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418852a5-5e82-4276-a84a-0b1757cda08d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:41.412935 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418852a5-5e82-4276-a84a-0b1757cda08d admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:41.415775 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-3b677fa4-144a-4132-bde2-d56f83bdf02d None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:41.417000 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-3b677fa4-144a-4132-bde2-d56f83bdf02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:41.443302 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1001/1983] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:30:41.445498 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b677fa4-144a-4132-bde2-d56f83bdf02d None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:41.456950 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b677fa4-144a-4132-bde2-d56f83bdf02d None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:41.467030 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1527b982-f501-4eda-9656-cf9bd8ea538e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:41.467927 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527b982-f501-4eda-9656-cf9bd8ea538e admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:41.468386 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527b982-f501-4eda-9656-cf9bd8ea538e admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:41.469175 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527b982-f501-4eda-9656-cf9bd8ea538e admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:41.471163 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1527b982-f501-4eda-9656-cf9bd8ea538e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:30:41.471563 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1527b982-f501-4eda-9656-cf9bd8ea538e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:41.474028 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1527b982-f501-4eda-9656-cf9bd8ea538e admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:41.492155 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1002/1984] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 2 15:30:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:30:41.496881 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1527b982-f501-4eda-9656-cf9bd8ea538e admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:41.501992 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 983/1985] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:30:41 2022] POST /identity/v3/projects => generated 379 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:30:41.505966 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418852a5-5e82-4276-a84a-0b1757cda08d admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:41.517975 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1527b982-f501-4eda-9656-cf9bd8ea538e admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:41.547526 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:41.619145 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418852a5-5e82-4276-a84a-0b1757cda08d admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:41.626046 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33dcd3c-2d9d-4cb0-99c6-8a0ae15968d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:41.627022 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33dcd3c-2d9d-4cb0-99c6-8a0ae15968d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:41.627539 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33dcd3c-2d9d-4cb0-99c6-8a0ae15968d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:41.628204 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33dcd3c-2d9d-4cb0-99c6-8a0ae15968d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:41.629083 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33dcd3c-2d9d-4cb0-99c6-8a0ae15968d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:41.631311 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33dcd3c-2d9d-4cb0-99c6-8a0ae15968d8 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:41.641861 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ca235-159f-4e68-9b01-ad2006b5c8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:41.643056 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ca235-159f-4e68-9b01-ad2006b5c8d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:41.643372 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ca235-159f-4e68-9b01-ad2006b5c8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:41.644846 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ca235-159f-4e68-9b01-ad2006b5c8d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:41.646717 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841ca235-159f-4e68-9b01-ad2006b5c8d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:41.655872 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841ca235-159f-4e68-9b01-ad2006b5c8d8 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:41.690233 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 984/1986] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:30:41 2022] POST /identity/v3/users => generated 290 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 15:30:41.694155 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33dcd3c-2d9d-4cb0-99c6-8a0ae15968d8 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:41.742626 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33dcd3c-2d9d-4cb0-99c6-8a0ae15968d8 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:41.750269 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d25bd-1497-47c2-8114-4669660f2de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:41.751453 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d25bd-1497-47c2-8114-4669660f2de4 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:41.751964 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d25bd-1497-47c2-8114-4669660f2de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:41.752673 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d25bd-1497-47c2-8114-4669660f2de4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:41.753624 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569d25bd-1497-47c2-8114-4669660f2de4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:41.755554 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569d25bd-1497-47c2-8114-4669660f2de4 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:41.765219 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1003/1987] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:30:41 2022] POST /identity/v3/projects => generated 383 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:30:41.768916 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ca235-159f-4e68-9b01-ad2006b5c8d8 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:41.772258 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 985/1988] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:30:41.778090 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d25bd-1497-47c2-8114-4669660f2de4 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:41.797409 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d25bd-1497-47c2-8114-4669660f2de4 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:41.899299 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ca235-159f-4e68-9b01-ad2006b5c8d8 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:41.915762 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa42451-7d52-485b-8283-e302faceb81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:41.916606 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa42451-7d52-485b-8283-e302faceb81f admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:41.917034 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa42451-7d52-485b-8283-e302faceb81f admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:41.917556 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa42451-7d52-485b-8283-e302faceb81f admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:41.921949 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa42451-7d52-485b-8283-e302faceb81f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:41.925621 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa42451-7d52-485b-8283-e302faceb81f admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:41.936042 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09359bb-ba4b-41e2-9368-e2c2be791c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:41.939889 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09359bb-ba4b-41e2-9368-e2c2be791c6f admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:41.939889 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09359bb-ba4b-41e2-9368-e2c2be791c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:41.939889 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09359bb-ba4b-41e2-9368-e2c2be791c6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:41.942970 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09359bb-ba4b-41e2-9368-e2c2be791c6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:41.948069 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09359bb-ba4b-41e2-9368-e2c2be791c6f admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:41.975318 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 986/1989] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:30:41.978428 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09359bb-ba4b-41e2-9368-e2c2be791c6f admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:41.982196 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1004/1990] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:30:41 2022] POST /identity/v3/users => generated 292 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 15:30:41.986330 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa42451-7d52-485b-8283-e302faceb81f admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:42.008255 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa42451-7d52-485b-8283-e302faceb81f admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:42.013769 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09359bb-ba4b-41e2-9368-e2c2be791c6f admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:42.026377 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d0883-2279-481a-a477-3981a28fbc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:42.027866 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d0883-2279-481a-a477-3981a28fbc35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:42.029994 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d0883-2279-481a-a477-3981a28fbc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:42.030313 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d0883-2279-481a-a477-3981a28fbc35 admin admin] PATH_INFO: `/v3/projects/9cb88fe896ca4964a7173c9426bffb54/users/43c5954a1c44426685c478af47b8b2db/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:42.045492 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcbfaf6-40ab-4e69-9596-0a38e18271ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:42.046156 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcbfaf6-40ab-4e69-9596-0a38e18271ca admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:42.046438 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcbfaf6-40ab-4e69-9596-0a38e18271ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:42.046710 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcbfaf6-40ab-4e69-9596-0a38e18271ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:42.056896 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcbfaf6-40ab-4e69-9596-0a38e18271ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:42.057347 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551d0883-2279-481a-a477-3981a28fbc35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cb88fe896ca4964a7173c9426bffb54, user_id=43c5954a1c44426685c478af47b8b2db, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:42.061942 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551d0883-2279-481a-a477-3981a28fbc35 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:42.074532 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcbfaf6-40ab-4e69-9596-0a38e18271ca admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:42.098304 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 987/1991] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:30:41 2022] PUT /identity/v3/projects/9cb88fe896ca4964a7173c9426bffb54/users/43c5954a1c44426685c478af47b8b2db/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:42.111120 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250ce2e-b59c-492f-96ee-423f2471e567 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:42.111120 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250ce2e-b59c-492f-96ee-423f2471e567 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:42.111417 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250ce2e-b59c-492f-96ee-423f2471e567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:42.114619 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1005/1992] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:30:42.115928 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcbfaf6-40ab-4e69-9596-0a38e18271ca admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:42.139540 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcbfaf6-40ab-4e69-9596-0a38e18271ca admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:42.195189 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-2250ce2e-b59c-492f-96ee-423f2471e567 None None] MFA Rules not processed for user `43c5954a1c44426685c478af47b8b2db`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:42.196443 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-2250ce2e-b59c-492f-96ee-423f2471e567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:42.221361 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:42.289547 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a066715-5e80-4f31-b491-f7e6d56c002f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:42.290453 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a066715-5e80-4f31-b491-f7e6d56c002f admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:42.291091 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a066715-5e80-4f31-b491-f7e6d56c002f admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:42.291584 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a066715-5e80-4f31-b491-f7e6d56c002f admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:42.292925 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a066715-5e80-4f31-b491-f7e6d56c002f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:42.294977 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a066715-5e80-4f31-b491-f7e6d56c002f admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:42.329728 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 988/1993] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:30:42.335455 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2250ce2e-b59c-492f-96ee-423f2471e567 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:42.341065 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1006/1994] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:30:42.344514 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a066715-5e80-4f31-b491-f7e6d56c002f admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:42.352611 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2250ce2e-b59c-492f-96ee-423f2471e567 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:42.367715 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f55ccb-2990-4d5e-8046-13b9aae82928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:42.369808 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a066715-5e80-4f31-b491-f7e6d56c002f admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:42.370516 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f55ccb-2990-4d5e-8046-13b9aae82928 admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:42.371452 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f55ccb-2990-4d5e-8046-13b9aae82928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:42.371784 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f55ccb-2990-4d5e-8046-13b9aae82928 admin admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:42.372486 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f55ccb-2990-4d5e-8046-13b9aae82928 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:42.374415 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f55ccb-2990-4d5e-8046-13b9aae82928 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:42.388735 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630cf432-9d84-4b11-93b3-862e45ca7e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:42.388735 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630cf432-9d84-4b11-93b3-862e45ca7e21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:42.388735 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630cf432-9d84-4b11-93b3-862e45ca7e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:42.389437 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630cf432-9d84-4b11-93b3-862e45ca7e21 admin admin] PATH_INFO: `/v3/projects/0153139ee74f499589c8ba5940c83fa8/users/41bfd2b93aff4d2ab2e2f465881a90a3/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:42.431061 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630cf432-9d84-4b11-93b3-862e45ca7e21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0153139ee74f499589c8ba5940c83fa8, user_id=41bfd2b93aff4d2ab2e2f465881a90a3, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:42.441232 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630cf432-9d84-4b11-93b3-862e45ca7e21 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:42.462634 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:42.470437 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1007/1995] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:30:42 2022] PUT /identity/v3/projects/0153139ee74f499589c8ba5940c83fa8/users/41bfd2b93aff4d2ab2e2f465881a90a3/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:42.481771 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 989/1996] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:30:42 2022] POST /identity/v3/projects => generated 379 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:30:42.486317 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbffac1-25a7-4bb0-b5fb-615368621ff5 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:42.486811 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbffac1-25a7-4bb0-b5fb-615368621ff5 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:42.487275 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbffac1-25a7-4bb0-b5fb-615368621ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:42.488029 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f55ccb-2990-4d5e-8046-13b9aae82928 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:42.550100 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-6fbffac1-25a7-4bb0-b5fb-615368621ff5 None None] MFA Rules not processed for user `41bfd2b93aff4d2ab2e2f465881a90a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:42.551982 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-6fbffac1-25a7-4bb0-b5fb-615368621ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:42.682171 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f55ccb-2990-4d5e-8046-13b9aae82928 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:42.757731 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1008/1997] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:30:42.791359 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbffac1-25a7-4bb0-b5fb-615368621ff5 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:42.794368 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-6fbffac1-25a7-4bb0-b5fb-615368621ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:42.816897 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3472f8c3-679c-4495-a704-26d7d76eec78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:42.817662 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472f8c3-679c-4495-a704-26d7d76eec78 admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:42.818116 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472f8c3-679c-4495-a704-26d7d76eec78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:42.819317 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472f8c3-679c-4495-a704-26d7d76eec78 admin admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:42.819496 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3472f8c3-679c-4495-a704-26d7d76eec78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:42.822452 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3472f8c3-679c-4495-a704-26d7d76eec78 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:42.873309 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 990/1998] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:30:42 2022] POST /identity/v3/users => generated 296 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:30:42.878734 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3472f8c3-679c-4495-a704-26d7d76eec78 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:42.895325 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3472f8c3-679c-4495-a704-26d7d76eec78 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:42.906648 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699b38e8-1123-4a26-b0d0-156d8087df8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:42.907348 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b38e8-1123-4a26-b0d0-156d8087df8d admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:42.907737 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b38e8-1123-4a26-b0d0-156d8087df8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:42.908110 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b38e8-1123-4a26-b0d0-156d8087df8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:42.911031 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699b38e8-1123-4a26-b0d0-156d8087df8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:42.913256 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699b38e8-1123-4a26-b0d0-156d8087df8d admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:42.938275 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 991/1999] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:30:42.942620 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699b38e8-1123-4a26-b0d0-156d8087df8d admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:42.947161 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbffac1-25a7-4bb0-b5fb-615368621ff5 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:42.952040 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24503bf5-51ba-4c93-aecc-3378e349e83e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:42.953052 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24503bf5-51ba-4c93-aecc-3378e349e83e service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:42.953492 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24503bf5-51ba-4c93-aecc-3378e349e83e service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:42.955853 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24503bf5-51ba-4c93-aecc-3378e349e83e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:42.961803 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699b38e8-1123-4a26-b0d0-156d8087df8d admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:42.967579 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3609f2e1-0734-4d9e-a15d-942d41914736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:42.968378 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3609f2e1-0734-4d9e-a15d-942d41914736 admin admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:42.968500 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24503bf5-51ba-4c93-aecc-3378e349e83e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:42.968788 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3609f2e1-0734-4d9e-a15d-942d41914736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:42.969270 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3609f2e1-0734-4d9e-a15d-942d41914736 admin admin] PATH_INFO: `/v3/projects/71e308d1e9c442ae9a51bbf20df6df9b/users/b31f45e7559f4dbda38f840476281fb6/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:42.970618 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24503bf5-51ba-4c93-aecc-3378e349e83e service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:42.985802 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:42.990561 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3609f2e1-0734-4d9e-a15d-942d41914736 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71e308d1e9c442ae9a51bbf20df6df9b, user_id=b31f45e7559f4dbda38f840476281fb6, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:42.994231 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1009/2000] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:30:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:30:42.994391 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3609f2e1-0734-4d9e-a15d-942d41914736 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:43.016319 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 992/2001] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:30:42 2022] PUT /identity/v3/projects/71e308d1e9c442ae9a51bbf20df6df9b/users/b31f45e7559f4dbda38f840476281fb6/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:43.020437 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24503bf5-51ba-4c93-aecc-3378e349e83e service cinder] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:43.035795 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24503bf5-51ba-4c93-aecc-3378e349e83e service cinder] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:43.164505 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc1296f-25ee-4575-8259-a1968a6dec32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:43.165657 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc1296f-25ee-4575-8259-a1968a6dec32 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:43.168331 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc1296f-25ee-4575-8259-a1968a6dec32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:43.168616 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc1296f-25ee-4575-8259-a1968a6dec32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:43.170519 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc1296f-25ee-4575-8259-a1968a6dec32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:43.171320 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc1296f-25ee-4575-8259-a1968a6dec32 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:43.182756 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1010/2002] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:30:43.187282 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3609f2e1-0734-4d9e-a15d-942d41914736 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:43.207901 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3609f2e1-0734-4d9e-a15d-942d41914736 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:43.214979 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d192b5e-c086-4ce0-8932-f7bbff5a0ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:43.215821 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d192b5e-c086-4ce0-8932-f7bbff5a0ac6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:43.216202 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d192b5e-c086-4ce0-8932-f7bbff5a0ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:43.216877 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d192b5e-c086-4ce0-8932-f7bbff5a0ac6 admin admin] PATH_INFO: `/v3/projects/71e308d1e9c442ae9a51bbf20df6df9b/users/b31f45e7559f4dbda38f840476281fb6/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:43.219072 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d192b5e-c086-4ce0-8932-f7bbff5a0ac6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71e308d1e9c442ae9a51bbf20df6df9b, user_id=b31f45e7559f4dbda38f840476281fb6, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:43.222364 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d192b5e-c086-4ce0-8932-f7bbff5a0ac6 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:43.243148 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 993/2003] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:30:43 2022] PUT /identity/v3/projects/71e308d1e9c442ae9a51bbf20df6df9b/users/b31f45e7559f4dbda38f840476281fb6/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:43.253842 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce754d-0ef0-4161-93d3-a520c69ea103 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:43.254137 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce754d-0ef0-4161-93d3-a520c69ea103 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:43.254405 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce754d-0ef0-4161-93d3-a520c69ea103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:43.291557 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-2bce754d-0ef0-4161-93d3-a520c69ea103 None None] MFA Rules not processed for user `b31f45e7559f4dbda38f840476281fb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:43.293308 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-2bce754d-0ef0-4161-93d3-a520c69ea103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:43.312724 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:43.417258 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1011/2004] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:43 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:30:43.491301 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d192b5e-c086-4ce0-8932-f7bbff5a0ac6 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:43.568232 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d192b5e-c086-4ce0-8932-f7bbff5a0ac6 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:43.574523 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e682d0-18c9-49ed-a88e-2dcbbb038dbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:43.575326 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e682d0-18c9-49ed-a88e-2dcbbb038dbb service cinder] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:43.575635 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e682d0-18c9-49ed-a88e-2dcbbb038dbb service cinder] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:43.575868 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e682d0-18c9-49ed-a88e-2dcbbb038dbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:43.588556 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e682d0-18c9-49ed-a88e-2dcbbb038dbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:43.590743 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e682d0-18c9-49ed-a88e-2dcbbb038dbb service cinder] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:43.605038 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 994/2005] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:30:43 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:30:43.685397 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce754d-0ef0-4161-93d3-a520c69ea103 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:43.686453 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-2bce754d-0ef0-4161-93d3-a520c69ea103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:43.698417 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce754d-0ef0-4161-93d3-a520c69ea103 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:43.702765 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8873b9-6b19-4454-a7ef-0efd9881ecf7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:43.703405 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8873b9-6b19-4454-a7ef-0efd9881ecf7 service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:43.703685 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8873b9-6b19-4454-a7ef-0efd9881ecf7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:43.703947 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8873b9-6b19-4454-a7ef-0efd9881ecf7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:43.785134 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8873b9-6b19-4454-a7ef-0efd9881ecf7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:43.786649 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8873b9-6b19-4454-a7ef-0efd9881ecf7 service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:43.801050 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1012/2006] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:30:43 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:30:43.872324 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e682d0-18c9-49ed-a88e-2dcbbb038dbb service cinder] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:43.873959 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-36e682d0-18c9-49ed-a88e-2dcbbb038dbb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:44.026595 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e682d0-18c9-49ed-a88e-2dcbbb038dbb service cinder] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:44.047117 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed6ba8-5040-4005-bdcd-507d94b848a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:44.047117 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed6ba8-5040-4005-bdcd-507d94b848a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:44.047117 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed6ba8-5040-4005-bdcd-507d94b848a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:44.047117 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed6ba8-5040-4005-bdcd-507d94b848a7 admin admin] PATH_INFO: `/v3/users/e6ea47e912d4485ca03aa5a90b48a606` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:44.047672 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ed6ba8-5040-4005-bdcd-507d94b848a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6ea47e912d4485ca03aa5a90b48a606)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:44.048970 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ed6ba8-5040-4005-bdcd-507d94b848a7 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:44.109927 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-20ed6ba8-5040-4005-bdcd-507d94b848a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6ea47e912d4485ca03aa5a90b48a606'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:44.120066 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-20ed6ba8-5040-4005-bdcd-507d94b848a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6ea47e912d4485ca03aa5a90b48a606'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:44.137866 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-20ed6ba8-5040-4005-bdcd-507d94b848a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6ea47e912d4485ca03aa5a90b48a606'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:44.138993 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-20ed6ba8-5040-4005-bdcd-507d94b848a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6ea47e912d4485ca03aa5a90b48a606'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:44.140130 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-20ed6ba8-5040-4005-bdcd-507d94b848a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6ea47e912d4485ca03aa5a90b48a606'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:44.164185 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:44.168581 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 995/2007] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:30:43 2022] DELETE /identity/v3/users/e6ea47e912d4485ca03aa5a90b48a606 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 15:30:44.174567 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fcd965-54db-4027-a838-bb4f68689c15 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:44.174567 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fcd965-54db-4027-a838-bb4f68689c15 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:44.174567 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fcd965-54db-4027-a838-bb4f68689c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:44.220369 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-13fcd965-54db-4027-a838-bb4f68689c15 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:44.222894 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-13fcd965-54db-4027-a838-bb4f68689c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:44.348554 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1013/2008] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:30:44.366068 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed6ba8-5040-4005-bdcd-507d94b848a7 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:44.368358 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-20ed6ba8-5040-4005-bdcd-507d94b848a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:44.440000 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed6ba8-5040-4005-bdcd-507d94b848a7 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:44.444722 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1268b6-c969-4769-97f9-8e7883b7c6ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:44.445507 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1268b6-c969-4769-97f9-8e7883b7c6ca service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:44.445903 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1268b6-c969-4769-97f9-8e7883b7c6ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:44.446269 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1268b6-c969-4769-97f9-8e7883b7c6ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:44.458407 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1268b6-c969-4769-97f9-8e7883b7c6ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:44.459971 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1268b6-c969-4769-97f9-8e7883b7c6ca service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:44.471327 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 996/2009] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:30:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:30:44.767074 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fcd965-54db-4027-a838-bb4f68689c15 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:44.768862 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-13fcd965-54db-4027-a838-bb4f68689c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:44.785734 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fcd965-54db-4027-a838-bb4f68689c15 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:44.789862 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ccdac-f316-4703-b773-ede088667e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:44.790450 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ccdac-f316-4703-b773-ede088667e2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:44.790735 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ccdac-f316-4703-b773-ede088667e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:44.791010 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ccdac-f316-4703-b773-ede088667e2f admin admin] PATH_INFO: `/v3/projects/bf2108cd622344768035be61f90e4eac` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:44.792183 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ccdac-f316-4703-b773-ede088667e2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf2108cd622344768035be61f90e4eac)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:44.794124 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ccdac-f316-4703-b773-ede088667e2f admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:44.842834 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:44.846423 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-d16ccdac-f316-4703-b773-ede088667e2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf2108cd622344768035be61f90e4eac', 'request_id': 'req-d16ccdac-f316-4703-b773-ede088667e2f'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:44.854809 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-d16ccdac-f316-4703-b773-ede088667e2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf2108cd622344768035be61f90e4eac', 'request_id': 'req-d16ccdac-f316-4703-b773-ede088667e2f'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:44.861613 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-d16ccdac-f316-4703-b773-ede088667e2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf2108cd622344768035be61f90e4eac', 'request_id': 'req-d16ccdac-f316-4703-b773-ede088667e2f'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:44.872495 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-d16ccdac-f316-4703-b773-ede088667e2f admin admin] The token cache is being invalidate because project bf2108cd622344768035be61f90e4eac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:30:44.872783 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-d16ccdac-f316-4703-b773-ede088667e2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:44.873529 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-d16ccdac-f316-4703-b773-ede088667e2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:44.875326 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1014/2010] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:30:44 2022] DELETE /identity/v3/projects/bf2108cd622344768035be61f90e4eac => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:44.879255 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1268b6-c969-4769-97f9-8e7883b7c6ca service neutron] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:44.890078 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1268b6-c969-4769-97f9-8e7883b7c6ca service neutron] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:44.947991 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa52314-6f0f-4084-ae40-6975c1cf2043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:44.948564 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa52314-6f0f-4084-ae40-6975c1cf2043 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:44.949450 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa52314-6f0f-4084-ae40-6975c1cf2043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:44.949732 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa52314-6f0f-4084-ae40-6975c1cf2043 admin admin] PATH_INFO: `/v3/users/b164f4de52f44c06893ab831f378f4b3` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:44.950893 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa52314-6f0f-4084-ae40-6975c1cf2043 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b164f4de52f44c06893ab831f378f4b3)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:44.952949 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa52314-6f0f-4084-ae40-6975c1cf2043 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:44.999781 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-4fa52314-6f0f-4084-ae40-6975c1cf2043 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b164f4de52f44c06893ab831f378f4b3'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:45.008205 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-4fa52314-6f0f-4084-ae40-6975c1cf2043 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b164f4de52f44c06893ab831f378f4b3'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:45.021778 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-4fa52314-6f0f-4084-ae40-6975c1cf2043 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b164f4de52f44c06893ab831f378f4b3'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:45.022558 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-4fa52314-6f0f-4084-ae40-6975c1cf2043 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b164f4de52f44c06893ab831f378f4b3'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:45.023386 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-4fa52314-6f0f-4084-ae40-6975c1cf2043 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b164f4de52f44c06893ab831f378f4b3'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:45.039872 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 997/2011] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:30:44 2022] DELETE /identity/v3/users/b164f4de52f44c06893ab831f378f4b3 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 15:30:45.514860 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ccdac-f316-4703-b773-ede088667e2f admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:45.516550 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-d16ccdac-f316-4703-b773-ede088667e2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:45.552305 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ccdac-f316-4703-b773-ede088667e2f admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:45.614722 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833f2fc7-d9d3-4fec-9ba8-05ab9e28dfe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:45.615510 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f2fc7-d9d3-4fec-9ba8-05ab9e28dfe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:45.615799 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f2fc7-d9d3-4fec-9ba8-05ab9e28dfe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:45.616088 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f2fc7-d9d3-4fec-9ba8-05ab9e28dfe1 admin admin] PATH_INFO: `/v3/projects/e32f8f26bbc64a07bd8f8e1fb3024919` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:45.617412 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833f2fc7-d9d3-4fec-9ba8-05ab9e28dfe1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e32f8f26bbc64a07bd8f8e1fb3024919)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:45.619518 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833f2fc7-d9d3-4fec-9ba8-05ab9e28dfe1 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:45.677530 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-833f2fc7-d9d3-4fec-9ba8-05ab9e28dfe1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e32f8f26bbc64a07bd8f8e1fb3024919', 'request_id': 'req-833f2fc7-d9d3-4fec-9ba8-05ab9e28dfe1'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:45.689164 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-833f2fc7-d9d3-4fec-9ba8-05ab9e28dfe1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e32f8f26bbc64a07bd8f8e1fb3024919', 'request_id': 'req-833f2fc7-d9d3-4fec-9ba8-05ab9e28dfe1'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:45.696769 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-833f2fc7-d9d3-4fec-9ba8-05ab9e28dfe1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e32f8f26bbc64a07bd8f8e1fb3024919', 'request_id': 'req-833f2fc7-d9d3-4fec-9ba8-05ab9e28dfe1'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:45.710452 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-833f2fc7-d9d3-4fec-9ba8-05ab9e28dfe1 admin admin] The token cache is being invalidate because project e32f8f26bbc64a07bd8f8e1fb3024919 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:30:45.710767 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-833f2fc7-d9d3-4fec-9ba8-05ab9e28dfe1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:45.711529 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-833f2fc7-d9d3-4fec-9ba8-05ab9e28dfe1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:45.715176 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1015/2012] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:30:45 2022] DELETE /identity/v3/projects/e32f8f26bbc64a07bd8f8e1fb3024919 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:45.719889 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2c43f-1b92-4275-8fde-aa18e8dac317 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:45.720298 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2c43f-1b92-4275-8fde-aa18e8dac317 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:45.720595 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2c43f-1b92-4275-8fde-aa18e8dac317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:45.747585 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-b6e2c43f-1b92-4275-8fde-aa18e8dac317 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:45.749817 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-b6e2c43f-1b92-4275-8fde-aa18e8dac317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:45.766034 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:45.833134 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 998/2013] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:30:45.841507 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f7f2b3-e86a-4759-88a9-009b5c722faf None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:45.842147 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f7f2b3-e86a-4759-88a9-009b5c722faf None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:45.842147 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f7f2b3-e86a-4759-88a9-009b5c722faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:45.862427 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-81f7f2b3-e86a-4759-88a9-009b5c722faf None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:45.863774 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-81f7f2b3-e86a-4759-88a9-009b5c722faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:45.873039 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1016/2014] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:30:45.877639 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2c43f-1b92-4275-8fde-aa18e8dac317 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:45.887864 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2c43f-1b92-4275-8fde-aa18e8dac317 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:45.892859 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c23b95-590b-41e0-9400-b1ee6271977f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:45.893480 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c23b95-590b-41e0-9400-b1ee6271977f admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:45.893765 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c23b95-590b-41e0-9400-b1ee6271977f admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:45.894044 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c23b95-590b-41e0-9400-b1ee6271977f admin admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:45.894735 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c23b95-590b-41e0-9400-b1ee6271977f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:30:45.895042 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c23b95-590b-41e0-9400-b1ee6271977f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:45.896695 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c23b95-590b-41e0-9400-b1ee6271977f admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:45.910828 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 999/2015] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 2 15:30:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:30:45.915762 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f7f2b3-e86a-4759-88a9-009b5c722faf None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:45.925324 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f7f2b3-e86a-4759-88a9-009b5c722faf None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:45.930020 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5108ae-7da1-44b0-9940-6d7245ae7ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:45.930677 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5108ae-7da1-44b0-9940-6d7245ae7ccb admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:45.930962 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5108ae-7da1-44b0-9940-6d7245ae7ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:45.931289 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5108ae-7da1-44b0-9940-6d7245ae7ccb admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:45.931961 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5108ae-7da1-44b0-9940-6d7245ae7ccb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:45.933826 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5108ae-7da1-44b0-9940-6d7245ae7ccb admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:45.962270 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1017/2016] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:30:45 2022] POST /identity/v3/projects => generated 355 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:30:45.967647 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c23b95-590b-41e0-9400-b1ee6271977f admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:45.977606 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c23b95-590b-41e0-9400-b1ee6271977f admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:46.032852 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad653808-9207-422d-a41f-eb33904273a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:46.033409 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad653808-9207-422d-a41f-eb33904273a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:46.033717 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad653808-9207-422d-a41f-eb33904273a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:46.034013 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad653808-9207-422d-a41f-eb33904273a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:46.034723 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad653808-9207-422d-a41f-eb33904273a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:46.036787 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad653808-9207-422d-a41f-eb33904273a8 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:46.057698 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1000/2017] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:30:45 2022] POST /identity/v3/users => generated 278 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 15:30:46.061986 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5108ae-7da1-44b0-9940-6d7245ae7ccb admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:46.078232 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5108ae-7da1-44b0-9940-6d7245ae7ccb admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:46.085125 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b1dbd-d8b7-4dd6-9685-850c0fc6a459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:46.085749 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b1dbd-d8b7-4dd6-9685-850c0fc6a459 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:46.086038 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b1dbd-d8b7-4dd6-9685-850c0fc6a459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:46.086314 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b1dbd-d8b7-4dd6-9685-850c0fc6a459 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:46.087065 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0b1dbd-d8b7-4dd6-9685-850c0fc6a459 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:46.088752 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0b1dbd-d8b7-4dd6-9685-850c0fc6a459 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:46.100348 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1018/2018] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:30:46 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 15:30:46.104512 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad653808-9207-422d-a41f-eb33904273a8 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:46.115838 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad653808-9207-422d-a41f-eb33904273a8 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:46.121119 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd15c007-a4b4-4f08-bf59-c6a8adbd366c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:46.121804 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15c007-a4b4-4f08-bf59-c6a8adbd366c admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:46.122095 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15c007-a4b4-4f08-bf59-c6a8adbd366c admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:46.122374 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15c007-a4b4-4f08-bf59-c6a8adbd366c admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:46.123061 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd15c007-a4b4-4f08-bf59-c6a8adbd366c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:46.125110 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd15c007-a4b4-4f08-bf59-c6a8adbd366c admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:46.137612 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1001/2019] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:30:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 15:30:46.141671 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b1dbd-d8b7-4dd6-9685-850c0fc6a459 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:46.152709 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b1dbd-d8b7-4dd6-9685-850c0fc6a459 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:46.161093 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd0ccb9-4e47-4fb8-86fa-a881908378d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:46.161786 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0ccb9-4e47-4fb8-86fa-a881908378d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:46.162073 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0ccb9-4e47-4fb8-86fa-a881908378d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:46.162347 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0ccb9-4e47-4fb8-86fa-a881908378d4 admin admin] PATH_INFO: `/v3/projects/0b1f6b5d2a3b4332af3da51d802b6af3/users/2f668c43532d4022a9ee908f254ee465/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:46.183963 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd0ccb9-4e47-4fb8-86fa-a881908378d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b1f6b5d2a3b4332af3da51d802b6af3, user_id=2f668c43532d4022a9ee908f254ee465, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:46.189314 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd0ccb9-4e47-4fb8-86fa-a881908378d4 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:46.205145 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:46.214882 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1019/2020] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:30:46 2022] PUT /identity/v3/projects/0b1f6b5d2a3b4332af3da51d802b6af3/users/2f668c43532d4022a9ee908f254ee465/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:46.228082 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d5547-e803-46ea-ae7e-940c09757d42 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:46.228393 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d5547-e803-46ea-ae7e-940c09757d42 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:46.229113 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d5547-e803-46ea-ae7e-940c09757d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:46.265212 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-de4d5547-e803-46ea-ae7e-940c09757d42 None None] MFA Rules not processed for user `2f668c43532d4022a9ee908f254ee465`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:46.267953 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-de4d5547-e803-46ea-ae7e-940c09757d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:46.352120 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1002/2021] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:46 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:30:46.356943 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd0ccb9-4e47-4fb8-86fa-a881908378d4 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:46.505682 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd0ccb9-4e47-4fb8-86fa-a881908378d4 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:46.510870 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e61ea-faa4-4b8e-b214-5d80dda77ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:46.511989 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e61ea-faa4-4b8e-b214-5d80dda77ff8 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:46.512129 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e61ea-faa4-4b8e-b214-5d80dda77ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:46.512430 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e61ea-faa4-4b8e-b214-5d80dda77ff8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:46.513227 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e61ea-faa4-4b8e-b214-5d80dda77ff8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:46.515700 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e61ea-faa4-4b8e-b214-5d80dda77ff8 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:46.583467 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1020/2022] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:30:46 2022] POST /identity/v3/projects => generated 355 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:30:46.588265 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d5547-e803-46ea-ae7e-940c09757d42 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:46.624089 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d5547-e803-46ea-ae7e-940c09757d42 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:46.666674 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:46.774077 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe9925-3bcb-49f3-965d-17c417cfb509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:46.774818 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe9925-3bcb-49f3-965d-17c417cfb509 admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:46.775282 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe9925-3bcb-49f3-965d-17c417cfb509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:46.777913 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe9925-3bcb-49f3-965d-17c417cfb509 admin admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:46.778649 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbe9925-3bcb-49f3-965d-17c417cfb509 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:46.781076 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbe9925-3bcb-49f3-965d-17c417cfb509 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:46.826137 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1003/2023] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:30:46 2022] POST /identity/v3/users => generated 284 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:30:46.830208 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e61ea-faa4-4b8e-b214-5d80dda77ff8 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:46.860580 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e61ea-faa4-4b8e-b214-5d80dda77ff8 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:46.871668 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a415c-6f0e-4d2a-ad87-477a56e475d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:46.874241 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a415c-6f0e-4d2a-ad87-477a56e475d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:46.874611 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a415c-6f0e-4d2a-ad87-477a56e475d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:46.874992 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a415c-6f0e-4d2a-ad87-477a56e475d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:46.875908 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845a415c-6f0e-4d2a-ad87-477a56e475d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:46.878852 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845a415c-6f0e-4d2a-ad87-477a56e475d6 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:46.915059 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1021/2024] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:30:46 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:30:46.916723 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe9925-3bcb-49f3-965d-17c417cfb509 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:46.950492 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe9925-3bcb-49f3-965d-17c417cfb509 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:46.962951 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ce66c-1aef-4126-89ff-9299491c24a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:46.963915 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ce66c-1aef-4126-89ff-9299491c24a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:46.964886 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ce66c-1aef-4126-89ff-9299491c24a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:46.965478 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ce66c-1aef-4126-89ff-9299491c24a7 admin admin] PATH_INFO: `/v3/projects/8f5740a8fa864a048bde641354803493/users/633d36e417174bf6afed4b61d02076e5/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:46.999201 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655ce66c-1aef-4126-89ff-9299491c24a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f5740a8fa864a048bde641354803493, user_id=633d36e417174bf6afed4b61d02076e5, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:47.003779 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655ce66c-1aef-4126-89ff-9299491c24a7 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:47.032893 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1004/2025] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:30:46 2022] PUT /identity/v3/projects/8f5740a8fa864a048bde641354803493/users/633d36e417174bf6afed4b61d02076e5/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:47.037298 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a415c-6f0e-4d2a-ad87-477a56e475d6 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:47.058455 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a415c-6f0e-4d2a-ad87-477a56e475d6 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:47.197796 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2a2000-398c-4f21-85bb-bb7008d4a237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:47.198433 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a2000-398c-4f21-85bb-bb7008d4a237 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:47.198751 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a2000-398c-4f21-85bb-bb7008d4a237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:47.199026 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a2000-398c-4f21-85bb-bb7008d4a237 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:47.200473 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2a2000-398c-4f21-85bb-bb7008d4a237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:47.202112 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2a2000-398c-4f21-85bb-bb7008d4a237 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:47.228561 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1022/2026] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:30:47 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 15:30:47.234038 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ce66c-1aef-4126-89ff-9299491c24a7 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:47.255268 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ce66c-1aef-4126-89ff-9299491c24a7 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:47.269538 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245960b6-0362-4e8d-84c3-dfac53a73698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:47.270546 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245960b6-0362-4e8d-84c3-dfac53a73698 admin admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:47.270835 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245960b6-0362-4e8d-84c3-dfac53a73698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:47.271117 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245960b6-0362-4e8d-84c3-dfac53a73698 admin admin] PATH_INFO: `/v3/projects/8f5740a8fa864a048bde641354803493/users/633d36e417174bf6afed4b61d02076e5/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:47.273234 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245960b6-0362-4e8d-84c3-dfac53a73698 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f5740a8fa864a048bde641354803493, user_id=633d36e417174bf6afed4b61d02076e5, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:47.276530 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245960b6-0362-4e8d-84c3-dfac53a73698 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:47.289926 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1005/2027] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:30:47 2022] PUT /identity/v3/projects/8f5740a8fa864a048bde641354803493/users/633d36e417174bf6afed4b61d02076e5/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:47.300423 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b758c0e-443b-4593-8653-5ac049b5e237 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:47.300824 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b758c0e-443b-4593-8653-5ac049b5e237 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:47.301004 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b758c0e-443b-4593-8653-5ac049b5e237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:47.356113 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-2b758c0e-443b-4593-8653-5ac049b5e237 None None] MFA Rules not processed for user `633d36e417174bf6afed4b61d02076e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:47.357380 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-2b758c0e-443b-4593-8653-5ac049b5e237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:47.449518 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:47.463813 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1023/2028] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:47 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:30:47.473567 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245960b6-0362-4e8d-84c3-dfac53a73698 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:47.475949 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-245960b6-0362-4e8d-84c3-dfac53a73698 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:47.540600 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245960b6-0362-4e8d-84c3-dfac53a73698 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:47.544636 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a00c61-f45c-4ac1-9880-7810dd958860 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:47.545528 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a00c61-f45c-4ac1-9880-7810dd958860 service cinder] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:47.545815 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a00c61-f45c-4ac1-9880-7810dd958860 service cinder] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:47.546096 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a00c61-f45c-4ac1-9880-7810dd958860 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:47.558605 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a00c61-f45c-4ac1-9880-7810dd958860 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:47.560569 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a00c61-f45c-4ac1-9880-7810dd958860 service cinder] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:47.571263 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1006/2029] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:30:47 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:30:47.661590 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b758c0e-443b-4593-8653-5ac049b5e237 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:47.671558 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b758c0e-443b-4593-8653-5ac049b5e237 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:47.675066 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f01ea-1e40-4f51-9bb0-afd5c0482262 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:47.675719 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f01ea-1e40-4f51-9bb0-afd5c0482262 service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:47.676005 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f01ea-1e40-4f51-9bb0-afd5c0482262 service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:47.676282 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f01ea-1e40-4f51-9bb0-afd5c0482262 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:47.734065 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f01ea-1e40-4f51-9bb0-afd5c0482262 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:47.735545 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f01ea-1e40-4f51-9bb0-afd5c0482262 service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:47.744702 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1024/2030] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:30:47 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:30:52.956819 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a00c61-f45c-4ac1-9880-7810dd958860 service cinder] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:52.960005 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-43a00c61-f45c-4ac1-9880-7810dd958860 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:52.981309 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f01ea-1e40-4f51-9bb0-afd5c0482262 service cinder] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:52.983324 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-eb2f01ea-1e40-4f51-9bb0-afd5c0482262 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:53.062277 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a00c61-f45c-4ac1-9880-7810dd958860 service cinder] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:53.067004 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6406f21d-1334-49ac-ab37-9f232a1bbb52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:53.067679 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6406f21d-1334-49ac-ab37-9f232a1bbb52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:53.067961 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6406f21d-1334-49ac-ab37-9f232a1bbb52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:53.068237 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6406f21d-1334-49ac-ab37-9f232a1bbb52 admin admin] PATH_INFO: `/v3/users/f0d58e9105b34ad496436dbf1cbec630` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:53.069387 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6406f21d-1334-49ac-ab37-9f232a1bbb52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0d58e9105b34ad496436dbf1cbec630)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:53.072128 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6406f21d-1334-49ac-ab37-9f232a1bbb52 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:53.072851 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f01ea-1e40-4f51-9bb0-afd5c0482262 service cinder] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:53.078825 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2faf451-31c0-49ee-8e12-a7da7cfec103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:53.079927 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2faf451-31c0-49ee-8e12-a7da7cfec103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:53.080396 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2faf451-31c0-49ee-8e12-a7da7cfec103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:53.081034 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2faf451-31c0-49ee-8e12-a7da7cfec103 admin admin] PATH_INFO: `/v3/users/9233698e6d004ebea58dedc0bce39515` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:53.082775 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2faf451-31c0-49ee-8e12-a7da7cfec103 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9233698e6d004ebea58dedc0bce39515)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:53.085934 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2faf451-31c0-49ee-8e12-a7da7cfec103 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:53.088258 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:53.130794 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-6406f21d-1334-49ac-ab37-9f232a1bbb52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0d58e9105b34ad496436dbf1cbec630'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:53.140647 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-6406f21d-1334-49ac-ab37-9f232a1bbb52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0d58e9105b34ad496436dbf1cbec630'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:53.141864 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-c2faf451-31c0-49ee-8e12-a7da7cfec103 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9233698e6d004ebea58dedc0bce39515'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:53.163327 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-6406f21d-1334-49ac-ab37-9f232a1bbb52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0d58e9105b34ad496436dbf1cbec630'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:53.164167 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-6406f21d-1334-49ac-ab37-9f232a1bbb52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0d58e9105b34ad496436dbf1cbec630'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:53.164622 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-c2faf451-31c0-49ee-8e12-a7da7cfec103 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9233698e6d004ebea58dedc0bce39515'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:53.164957 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-6406f21d-1334-49ac-ab37-9f232a1bbb52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0d58e9105b34ad496436dbf1cbec630'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:53.165925 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-c2faf451-31c0-49ee-8e12-a7da7cfec103 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9233698e6d004ebea58dedc0bce39515'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:53.173893 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-c2faf451-31c0-49ee-8e12-a7da7cfec103 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9233698e6d004ebea58dedc0bce39515'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:53.182328 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-c2faf451-31c0-49ee-8e12-a7da7cfec103 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9233698e6d004ebea58dedc0bce39515'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:53.183582 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1007/2031] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:30:52 2022] DELETE /identity/v3/users/f0d58e9105b34ad496436dbf1cbec630 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:53.188467 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dfe0b3-1db8-4ec6-9bb8-f8fb74e9b886 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:53.188824 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dfe0b3-1db8-4ec6-9bb8-f8fb74e9b886 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:53.189115 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dfe0b3-1db8-4ec6-9bb8-f8fb74e9b886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:53.191349 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1025/2032] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:30:52 2022] DELETE /identity/v3/users/9233698e6d004ebea58dedc0bce39515 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:53.195469 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810af0d-d16d-4418-9b9c-22c265c81762 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:53.195762 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810af0d-d16d-4418-9b9c-22c265c81762 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:53.196038 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810af0d-d16d-4418-9b9c-22c265c81762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:53.212703 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-c0dfe0b3-1db8-4ec6-9bb8-f8fb74e9b886 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:53.214308 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-c0dfe0b3-1db8-4ec6-9bb8-f8fb74e9b886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:53.217556 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-5810af0d-d16d-4418-9b9c-22c265c81762 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:53.218724 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-5810af0d-d16d-4418-9b9c-22c265c81762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:53.227066 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:53.284242 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1026/2033] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:30:53.289468 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1008/2034] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:30:53.294606 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5810af0d-d16d-4418-9b9c-22c265c81762 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:53.296261 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-5810af0d-d16d-4418-9b9c-22c265c81762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:53.299636 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dfe0b3-1db8-4ec6-9bb8-f8fb74e9b886 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:53.301038 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-c0dfe0b3-1db8-4ec6-9bb8-f8fb74e9b886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:53.366368 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5810af0d-d16d-4418-9b9c-22c265c81762 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:53.371318 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe3e930-91c4-4460-8435-b7d379ffd2aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:53.371949 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3e930-91c4-4460-8435-b7d379ffd2aa service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:53.372483 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3e930-91c4-4460-8435-b7d379ffd2aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:53.372813 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3e930-91c4-4460-8435-b7d379ffd2aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:53.373384 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dfe0b3-1db8-4ec6-9bb8-f8fb74e9b886 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:53.377345 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf629dc-63ab-4c18-8764-f6c07bd10132 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:53.377991 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf629dc-63ab-4c18-8764-f6c07bd10132 service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:53.378278 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf629dc-63ab-4c18-8764-f6c07bd10132 service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:53.378559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf629dc-63ab-4c18-8764-f6c07bd10132 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:53.383824 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe3e930-91c4-4460-8435-b7d379ffd2aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:53.386311 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe3e930-91c4-4460-8435-b7d379ffd2aa service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:53.389911 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf629dc-63ab-4c18-8764-f6c07bd10132 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:53.391815 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf629dc-63ab-4c18-8764-f6c07bd10132 service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:53.403183 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1027/2035] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:30:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:30:53.411472 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1009/2036] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:30:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 15:30:53.738808 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe3e930-91c4-4460-8435-b7d379ffd2aa service neutron] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:53.740202 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-9fe3e930-91c4-4460-8435-b7d379ffd2aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:53.759395 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe3e930-91c4-4460-8435-b7d379ffd2aa service neutron] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:53.770427 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe04579-5199-4eff-8a05-c45dcd39ef1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:53.771108 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe04579-5199-4eff-8a05-c45dcd39ef1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:53.771392 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe04579-5199-4eff-8a05-c45dcd39ef1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:53.775408 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe04579-5199-4eff-8a05-c45dcd39ef1b admin admin] PATH_INFO: `/v3/projects/fdf13a96519e4ab28ca1a04e0f383404` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:53.776314 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe04579-5199-4eff-8a05-c45dcd39ef1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdf13a96519e4ab28ca1a04e0f383404)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:53.779635 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe04579-5199-4eff-8a05-c45dcd39ef1b admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:53.864915 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-ffe04579-5199-4eff-8a05-c45dcd39ef1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdf13a96519e4ab28ca1a04e0f383404', 'request_id': 'req-ffe04579-5199-4eff-8a05-c45dcd39ef1b'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:53.873519 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-ffe04579-5199-4eff-8a05-c45dcd39ef1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdf13a96519e4ab28ca1a04e0f383404', 'request_id': 'req-ffe04579-5199-4eff-8a05-c45dcd39ef1b'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:53.882112 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-ffe04579-5199-4eff-8a05-c45dcd39ef1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdf13a96519e4ab28ca1a04e0f383404', 'request_id': 'req-ffe04579-5199-4eff-8a05-c45dcd39ef1b'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:53.900106 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-ffe04579-5199-4eff-8a05-c45dcd39ef1b admin admin] The token cache is being invalidate because project fdf13a96519e4ab28ca1a04e0f383404 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:30:53.901406 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-ffe04579-5199-4eff-8a05-c45dcd39ef1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:53.903054 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-ffe04579-5199-4eff-8a05-c45dcd39ef1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:53.905554 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1028/2037] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:30:53 2022] DELETE /identity/v3/projects/fdf13a96519e4ab28ca1a04e0f383404 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:53.909559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf629dc-63ab-4c18-8764-f6c07bd10132 service neutron] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:53.922253 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf629dc-63ab-4c18-8764-f6c07bd10132 service neutron] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:53.974548 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:54.003537 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe04579-5199-4eff-8a05-c45dcd39ef1b admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:54.005055 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-ffe04579-5199-4eff-8a05-c45dcd39ef1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:54.014426 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21ed954-124a-4f8e-bfe7-ce45a2973253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:54.015089 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ed954-124a-4f8e-bfe7-ce45a2973253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:54.019501 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ed954-124a-4f8e-bfe7-ce45a2973253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:54.020447 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ed954-124a-4f8e-bfe7-ce45a2973253 admin admin] PATH_INFO: `/v3/users/6e07509f3573424991898bc4125f2c68` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:54.022034 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21ed954-124a-4f8e-bfe7-ce45a2973253 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e07509f3573424991898bc4125f2c68)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:54.025281 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21ed954-124a-4f8e-bfe7-ce45a2973253 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:54.061796 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:54.102606 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe04579-5199-4eff-8a05-c45dcd39ef1b admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:54.104116 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-d21ed954-124a-4f8e-bfe7-ce45a2973253 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e07509f3573424991898bc4125f2c68'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:54.109813 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4bff69-1146-47f0-ba4e-5319da3c8fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:54.110461 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4bff69-1146-47f0-ba4e-5319da3c8fa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:54.110758 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4bff69-1146-47f0-ba4e-5319da3c8fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:54.111372 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4bff69-1146-47f0-ba4e-5319da3c8fa0 admin admin] PATH_INFO: `/v3/projects/0cee194132cb4f098f731e723877a217` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:54.115453 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4bff69-1146-47f0-ba4e-5319da3c8fa0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cee194132cb4f098f731e723877a217)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:54.116929 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-d21ed954-124a-4f8e-bfe7-ce45a2973253 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e07509f3573424991898bc4125f2c68'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:54.121633 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4bff69-1146-47f0-ba4e-5319da3c8fa0 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:54.159623 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-d21ed954-124a-4f8e-bfe7-ce45a2973253 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e07509f3573424991898bc4125f2c68'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:54.160549 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-d21ed954-124a-4f8e-bfe7-ce45a2973253 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e07509f3573424991898bc4125f2c68'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:54.161381 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-d21ed954-124a-4f8e-bfe7-ce45a2973253 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e07509f3573424991898bc4125f2c68'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:54.183845 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1010/2038] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:30:53 2022] DELETE /identity/v3/users/6e07509f3573424991898bc4125f2c68 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 15:30:54.217324 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-7e4bff69-1146-47f0-ba4e-5319da3c8fa0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cee194132cb4f098f731e723877a217', 'request_id': 'req-7e4bff69-1146-47f0-ba4e-5319da3c8fa0'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:54.244011 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-7e4bff69-1146-47f0-ba4e-5319da3c8fa0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cee194132cb4f098f731e723877a217', 'request_id': 'req-7e4bff69-1146-47f0-ba4e-5319da3c8fa0'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:54.257388 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-7e4bff69-1146-47f0-ba4e-5319da3c8fa0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cee194132cb4f098f731e723877a217', 'request_id': 'req-7e4bff69-1146-47f0-ba4e-5319da3c8fa0'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:54.270364 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-7e4bff69-1146-47f0-ba4e-5319da3c8fa0 admin admin] The token cache is being invalidate because project 0cee194132cb4f098f731e723877a217 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:30:54.270636 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-7e4bff69-1146-47f0-ba4e-5319da3c8fa0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:54.271610 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-7e4bff69-1146-47f0-ba4e-5319da3c8fa0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:54.277469 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21ed954-124a-4f8e-bfe7-ce45a2973253 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:54.279725 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-d21ed954-124a-4f8e-bfe7-ce45a2973253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:54.293314 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1029/2039] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:30:54 2022] DELETE /identity/v3/projects/0cee194132cb4f098f731e723877a217 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 15:30:54.357098 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21ed954-124a-4f8e-bfe7-ce45a2973253 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:54.424895 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0e1ffc-b364-4f3f-9f28-18c144af62bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:54.425558 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e1ffc-b364-4f3f-9f28-18c144af62bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:54.425838 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e1ffc-b364-4f3f-9f28-18c144af62bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:54.426113 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e1ffc-b364-4f3f-9f28-18c144af62bb admin admin] PATH_INFO: `/v3/users/43c5954a1c44426685c478af47b8b2db` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:54.427324 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0e1ffc-b364-4f3f-9f28-18c144af62bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=43c5954a1c44426685c478af47b8b2db)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:54.429288 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0e1ffc-b364-4f3f-9f28-18c144af62bb admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:54.431012 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:54.481112 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-fa0e1ffc-b364-4f3f-9f28-18c144af62bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43c5954a1c44426685c478af47b8b2db'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:54.489530 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-fa0e1ffc-b364-4f3f-9f28-18c144af62bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43c5954a1c44426685c478af47b8b2db'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:54.504063 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-fa0e1ffc-b364-4f3f-9f28-18c144af62bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43c5954a1c44426685c478af47b8b2db'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:54.504844 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-fa0e1ffc-b364-4f3f-9f28-18c144af62bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43c5954a1c44426685c478af47b8b2db'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:54.508136 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-fa0e1ffc-b364-4f3f-9f28-18c144af62bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43c5954a1c44426685c478af47b8b2db'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:54.510468 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4bff69-1146-47f0-ba4e-5319da3c8fa0 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:54.512136 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-7e4bff69-1146-47f0-ba4e-5319da3c8fa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:54.525585 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4bff69-1146-47f0-ba4e-5319da3c8fa0 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:54.531520 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1011/2040] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:30:54 2022] DELETE /identity/v3/users/43c5954a1c44426685c478af47b8b2db => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:54.533693 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0e1ffc-b364-4f3f-9f28-18c144af62bb admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:54.535355 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-fa0e1ffc-b364-4f3f-9f28-18c144af62bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:54.628575 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0e1ffc-b364-4f3f-9f28-18c144af62bb admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:54.630204 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de167cc-d16a-4bce-aa0f-500569fff1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:54.630673 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de167cc-d16a-4bce-aa0f-500569fff1c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:54.631163 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de167cc-d16a-4bce-aa0f-500569fff1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:54.631540 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de167cc-d16a-4bce-aa0f-500569fff1c1 admin admin] PATH_INFO: `/v3/users/41bfd2b93aff4d2ab2e2f465881a90a3` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:54.632796 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de167cc-d16a-4bce-aa0f-500569fff1c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41bfd2b93aff4d2ab2e2f465881a90a3)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:54.634741 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7214f8-59bc-4ef6-ad7e-144436f1c9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:54.634892 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de167cc-d16a-4bce-aa0f-500569fff1c1 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:54.635786 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7214f8-59bc-4ef6-ad7e-144436f1c9b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:54.636252 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7214f8-59bc-4ef6-ad7e-144436f1c9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:54.636675 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7214f8-59bc-4ef6-ad7e-144436f1c9b9 admin admin] PATH_INFO: `/v3/projects/f4cfad2e66354483801d753015b11493` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:54.638559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7214f8-59bc-4ef6-ad7e-144436f1c9b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4cfad2e66354483801d753015b11493)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:54.642033 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7214f8-59bc-4ef6-ad7e-144436f1c9b9 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:54.695206 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-1de167cc-d16a-4bce-aa0f-500569fff1c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41bfd2b93aff4d2ab2e2f465881a90a3'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:54.698695 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-9d7214f8-59bc-4ef6-ad7e-144436f1c9b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4cfad2e66354483801d753015b11493', 'request_id': 'req-9d7214f8-59bc-4ef6-ad7e-144436f1c9b9'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:54.707742 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-9d7214f8-59bc-4ef6-ad7e-144436f1c9b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4cfad2e66354483801d753015b11493', 'request_id': 'req-9d7214f8-59bc-4ef6-ad7e-144436f1c9b9'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:54.719630 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-1de167cc-d16a-4bce-aa0f-500569fff1c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41bfd2b93aff4d2ab2e2f465881a90a3'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:54.720342 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-9d7214f8-59bc-4ef6-ad7e-144436f1c9b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4cfad2e66354483801d753015b11493', 'request_id': 'req-9d7214f8-59bc-4ef6-ad7e-144436f1c9b9'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:54.721861 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-1de167cc-d16a-4bce-aa0f-500569fff1c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41bfd2b93aff4d2ab2e2f465881a90a3'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:54.728533 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:54.731596 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-1de167cc-d16a-4bce-aa0f-500569fff1c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41bfd2b93aff4d2ab2e2f465881a90a3'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:54.737267 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-9d7214f8-59bc-4ef6-ad7e-144436f1c9b9 admin admin] The token cache is being invalidate because project f4cfad2e66354483801d753015b11493 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80360) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:30:54.737848 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-9d7214f8-59bc-4ef6-ad7e-144436f1c9b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:54.738866 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-9d7214f8-59bc-4ef6-ad7e-144436f1c9b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:54.741362 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1012/2041] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:30:54 2022] DELETE /identity/v3/projects/f4cfad2e66354483801d753015b11493 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 15:30:54.741495 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-1de167cc-d16a-4bce-aa0f-500569fff1c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41bfd2b93aff4d2ab2e2f465881a90a3'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:54.745902 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c346aa-cb24-424e-adde-34991fa7a8ab None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:54.746437 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c346aa-cb24-424e-adde-34991fa7a8ab None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:54.746558 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c346aa-cb24-424e-adde-34991fa7a8ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:54.753234 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1030/2042] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:30:54 2022] DELETE /identity/v3/users/41bfd2b93aff4d2ab2e2f465881a90a3 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:54.758009 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b5ae1-9b23-490c-b915-21aee2cd9865 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:54.758362 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b5ae1-9b23-490c-b915-21aee2cd9865 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:54.758748 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b5ae1-9b23-490c-b915-21aee2cd9865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:54.767667 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-55c346aa-cb24-424e-adde-34991fa7a8ab None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:54.768913 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-55c346aa-cb24-424e-adde-34991fa7a8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:54.773589 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:54.782833 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-d57b5ae1-9b23-490c-b915-21aee2cd9865 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:54.784297 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-d57b5ae1-9b23-490c-b915-21aee2cd9865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:54.851382 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1013/2043] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:30:54.858839 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ce743-55e4-4c42-8a9e-9a0f55f568a2 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:54.859128 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ce743-55e4-4c42-8a9e-9a0f55f568a2 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:54.859459 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ce743-55e4-4c42-8a9e-9a0f55f568a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:54.875440 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1031/2044] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:30:54.876739 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b5ae1-9b23-490c-b915-21aee2cd9865 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:54.878165 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-d57b5ae1-9b23-490c-b915-21aee2cd9865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:54.889441 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-b47ce743-55e4-4c42-8a9e-9a0f55f568a2 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:54.890718 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-b47ce743-55e4-4c42-8a9e-9a0f55f568a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:54.900014 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b5ae1-9b23-490c-b915-21aee2cd9865 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:54.900593 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1014/2045] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:30:54.901585 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ce743-55e4-4c42-8a9e-9a0f55f568a2 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:54.906875 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-b47ce743-55e4-4c42-8a9e-9a0f55f568a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:54.912401 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b650d5e8-6840-4d65-b4d2-ca43f83f6ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:54.913499 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650d5e8-6840-4d65-b4d2-ca43f83f6ec1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:54.913860 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650d5e8-6840-4d65-b4d2-ca43f83f6ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:54.914247 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650d5e8-6840-4d65-b4d2-ca43f83f6ec1 admin admin] PATH_INFO: `/v3/projects/9cb88fe896ca4964a7173c9426bffb54` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:54.917361 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b650d5e8-6840-4d65-b4d2-ca43f83f6ec1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cb88fe896ca4964a7173c9426bffb54)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:54.921251 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b650d5e8-6840-4d65-b4d2-ca43f83f6ec1 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:54.988991 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ce743-55e4-4c42-8a9e-9a0f55f568a2 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:55.028869 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-b650d5e8-6840-4d65-b4d2-ca43f83f6ec1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cb88fe896ca4964a7173c9426bffb54', 'request_id': 'req-b650d5e8-6840-4d65-b4d2-ca43f83f6ec1'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:55.041928 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-b650d5e8-6840-4d65-b4d2-ca43f83f6ec1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cb88fe896ca4964a7173c9426bffb54', 'request_id': 'req-b650d5e8-6840-4d65-b4d2-ca43f83f6ec1'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:55.052113 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-b650d5e8-6840-4d65-b4d2-ca43f83f6ec1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cb88fe896ca4964a7173c9426bffb54', 'request_id': 'req-b650d5e8-6840-4d65-b4d2-ca43f83f6ec1'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:55.063382 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-b650d5e8-6840-4d65-b4d2-ca43f83f6ec1 admin admin] The token cache is being invalidate because project 9cb88fe896ca4964a7173c9426bffb54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:30:55.063754 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-b650d5e8-6840-4d65-b4d2-ca43f83f6ec1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:55.064499 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-b650d5e8-6840-4d65-b4d2-ca43f83f6ec1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:55.065157 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b32e6-dff9-4b15-a7f2-b60167e9f6d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:55.065913 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b32e6-dff9-4b15-a7f2-b60167e9f6d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:55.066261 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b32e6-dff9-4b15-a7f2-b60167e9f6d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:55.066626 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b32e6-dff9-4b15-a7f2-b60167e9f6d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:55.066963 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1032/2046] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:30:54 2022] DELETE /identity/v3/projects/9cb88fe896ca4964a7173c9426bffb54 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:55.068145 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b650d5e8-6840-4d65-b4d2-ca43f83f6ec1 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:55.069662 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-b650d5e8-6840-4d65-b4d2-ca43f83f6ec1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:55.074045 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-479b32e6-dff9-4b15-a7f2-b60167e9f6d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:55.181323 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479b32e6-dff9-4b15-a7f2-b60167e9f6d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:55.183562 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479b32e6-dff9-4b15-a7f2-b60167e9f6d2 service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:55.200234 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1015/2047] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:30:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:30:55.201238 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b32e6-dff9-4b15-a7f2-b60167e9f6d2 service neutron] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:55.202830 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-479b32e6-dff9-4b15-a7f2-b60167e9f6d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:55.203365 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b650d5e8-6840-4d65-b4d2-ca43f83f6ec1 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:55.209527 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b244b01-e6bb-473d-9794-8099cc8f95c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:55.210164 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b244b01-e6bb-473d-9794-8099cc8f95c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:55.210450 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b244b01-e6bb-473d-9794-8099cc8f95c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:55.210723 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b244b01-e6bb-473d-9794-8099cc8f95c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:55.211450 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b244b01-e6bb-473d-9794-8099cc8f95c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:30:55.211754 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b244b01-e6bb-473d-9794-8099cc8f95c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:55.213419 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b244b01-e6bb-473d-9794-8099cc8f95c6 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:55.215713 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b32e6-dff9-4b15-a7f2-b60167e9f6d2 service neutron] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:55.220518 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1dd92d-7bde-4238-bbb1-8194a3e98b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:55.221177 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1dd92d-7bde-4238-bbb1-8194a3e98b92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:55.221460 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1dd92d-7bde-4238-bbb1-8194a3e98b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:55.221739 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1dd92d-7bde-4238-bbb1-8194a3e98b92 admin admin] PATH_INFO: `/v3/users/b31f45e7559f4dbda38f840476281fb6` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:55.222928 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1dd92d-7bde-4238-bbb1-8194a3e98b92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b31f45e7559f4dbda38f840476281fb6)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:55.226766 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1dd92d-7bde-4238-bbb1-8194a3e98b92 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:55.227706 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1033/2048] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 2 15:30:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:30:55.230610 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:55.232023 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b244b01-e6bb-473d-9794-8099cc8f95c6 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:55.243701 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b244b01-e6bb-473d-9794-8099cc8f95c6 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:55.250902 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa705ec3-0f0a-4a66-9f66-eb8e367cd75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:55.252192 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa705ec3-0f0a-4a66-9f66-eb8e367cd75a admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:55.252919 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa705ec3-0f0a-4a66-9f66-eb8e367cd75a admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:55.253234 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa705ec3-0f0a-4a66-9f66-eb8e367cd75a admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:55.254785 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa705ec3-0f0a-4a66-9f66-eb8e367cd75a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:55.257761 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa705ec3-0f0a-4a66-9f66-eb8e367cd75a admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:55.265590 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:55.313452 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1034/2049] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:30:55 2022] POST /identity/v3/projects => generated 367 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 15:30:55.315614 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa705ec3-0f0a-4a66-9f66-eb8e367cd75a admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:55.334505 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-9f1dd92d-7bde-4238-bbb1-8194a3e98b92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b31f45e7559f4dbda38f840476281fb6'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:55.342521 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-9f1dd92d-7bde-4238-bbb1-8194a3e98b92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b31f45e7559f4dbda38f840476281fb6'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:55.361061 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-9f1dd92d-7bde-4238-bbb1-8194a3e98b92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b31f45e7559f4dbda38f840476281fb6'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:55.362073 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-9f1dd92d-7bde-4238-bbb1-8194a3e98b92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b31f45e7559f4dbda38f840476281fb6'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:55.363079 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-9f1dd92d-7bde-4238-bbb1-8194a3e98b92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b31f45e7559f4dbda38f840476281fb6'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:55.394545 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1016/2050] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:30:55 2022] DELETE /identity/v3/users/b31f45e7559f4dbda38f840476281fb6 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:55.418192 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa705ec3-0f0a-4a66-9f66-eb8e367cd75a admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:55.531232 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b8ce8-975a-4315-8383-b6449de2bc71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:55.532023 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b8ce8-975a-4315-8383-b6449de2bc71 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:55.532366 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b8ce8-975a-4315-8383-b6449de2bc71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:55.532777 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b8ce8-975a-4315-8383-b6449de2bc71 admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:55.533523 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347b8ce8-975a-4315-8383-b6449de2bc71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:55.535950 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347b8ce8-975a-4315-8383-b6449de2bc71 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:55.562264 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1035/2051] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:30:55 2022] POST /identity/v3/users => generated 284 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:30:55.567240 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1dd92d-7bde-4238-bbb1-8194a3e98b92 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:55.569132 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-9f1dd92d-7bde-4238-bbb1-8194a3e98b92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:55.590680 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1dd92d-7bde-4238-bbb1-8194a3e98b92 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:55.608089 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a8699d-ffa8-4b9b-a8bf-d47525057439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:55.609164 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8699d-ffa8-4b9b-a8bf-d47525057439 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:55.609641 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8699d-ffa8-4b9b-a8bf-d47525057439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:55.610228 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8699d-ffa8-4b9b-a8bf-d47525057439 admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:55.611459 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a8699d-ffa8-4b9b-a8bf-d47525057439 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:55.614877 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a8699d-ffa8-4b9b-a8bf-d47525057439 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:55.636734 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1017/2052] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:30:55.641296 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b8ce8-975a-4315-8383-b6449de2bc71 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:55.661619 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b8ce8-975a-4315-8383-b6449de2bc71 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:55.675932 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a084130d-bfe4-42ac-beea-599efed28022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:55.677157 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084130d-bfe4-42ac-beea-599efed28022 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:55.677570 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084130d-bfe4-42ac-beea-599efed28022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:55.677911 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084130d-bfe4-42ac-beea-599efed28022 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:55.679098 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a084130d-bfe4-42ac-beea-599efed28022 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:55.682537 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a084130d-bfe4-42ac-beea-599efed28022 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:55.701494 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1036/2053] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:30:55.705701 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a8699d-ffa8-4b9b-a8bf-d47525057439 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:55.737370 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a8699d-ffa8-4b9b-a8bf-d47525057439 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:55.744460 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9037f7bb-df39-4694-9ca3-166384d72a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:55.745563 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037f7bb-df39-4694-9ca3-166384d72a59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:55.746102 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037f7bb-df39-4694-9ca3-166384d72a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:55.746687 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037f7bb-df39-4694-9ca3-166384d72a59 admin admin] PATH_INFO: `/v3/projects/395d496287ff4e45995088300f5e6110/users/3031b6943c3b4d7dbdfbf81160fcc72e/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:55.774592 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9037f7bb-df39-4694-9ca3-166384d72a59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=395d496287ff4e45995088300f5e6110, user_id=3031b6943c3b4d7dbdfbf81160fcc72e, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:55.779365 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9037f7bb-df39-4694-9ca3-166384d72a59 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:55.798445 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a084130d-bfe4-42ac-beea-599efed28022 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:55.800967 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-a084130d-bfe4-42ac-beea-599efed28022 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:55.824405 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1018/2054] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:30:55 2022] PUT /identity/v3/projects/395d496287ff4e45995088300f5e6110/users/3031b6943c3b4d7dbdfbf81160fcc72e/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 15:30:55.826082 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f6b9a-ff95-487b-80dd-6a7cddbd6221 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:55.826383 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f6b9a-ff95-487b-80dd-6a7cddbd6221 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:55.826666 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f6b9a-ff95-487b-80dd-6a7cddbd6221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:55.837970 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a084130d-bfe4-42ac-beea-599efed28022 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:55.883626 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-6d2f6b9a-ff95-487b-80dd-6a7cddbd6221 None None] MFA Rules not processed for user `3031b6943c3b4d7dbdfbf81160fcc72e`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:55.886500 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-6d2f6b9a-ff95-487b-80dd-6a7cddbd6221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:55.931072 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e10bb-76bc-4dc5-b0bb-d3ca66c94af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:55.931973 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e10bb-76bc-4dc5-b0bb-d3ca66c94af1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:55.932459 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e10bb-76bc-4dc5-b0bb-d3ca66c94af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:55.932596 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e10bb-76bc-4dc5-b0bb-d3ca66c94af1 admin admin] PATH_INFO: `/v3/projects/0153139ee74f499589c8ba5940c83fa8` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:55.934510 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e10bb-76bc-4dc5-b0bb-d3ca66c94af1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0153139ee74f499589c8ba5940c83fa8)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:55.936911 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e10bb-76bc-4dc5-b0bb-d3ca66c94af1 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:55.956107 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:56.000534 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1019/2055] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:30:56.001489 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f6b9a-ff95-487b-80dd-6a7cddbd6221 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:56.002915 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-6d2f6b9a-ff95-487b-80dd-6a7cddbd6221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:56.015646 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-f47e10bb-76bc-4dc5-b0bb-d3ca66c94af1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0153139ee74f499589c8ba5940c83fa8', 'request_id': 'req-f47e10bb-76bc-4dc5-b0bb-d3ca66c94af1'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:56.034620 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f6b9a-ff95-487b-80dd-6a7cddbd6221 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:56.042912 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-f47e10bb-76bc-4dc5-b0bb-d3ca66c94af1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0153139ee74f499589c8ba5940c83fa8', 'request_id': 'req-f47e10bb-76bc-4dc5-b0bb-d3ca66c94af1'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:56.053123 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-f47e10bb-76bc-4dc5-b0bb-d3ca66c94af1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0153139ee74f499589c8ba5940c83fa8', 'request_id': 'req-f47e10bb-76bc-4dc5-b0bb-d3ca66c94af1'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:56.067944 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-f47e10bb-76bc-4dc5-b0bb-d3ca66c94af1 admin admin] The token cache is being invalidate because project 0153139ee74f499589c8ba5940c83fa8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:30:56.068230 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-f47e10bb-76bc-4dc5-b0bb-d3ca66c94af1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:56.068922 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-f47e10bb-76bc-4dc5-b0bb-d3ca66c94af1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:56.070469 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1037/2056] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:30:55 2022] DELETE /identity/v3/projects/0153139ee74f499589c8ba5940c83fa8 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 15:30:56.072000 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e10bb-76bc-4dc5-b0bb-d3ca66c94af1 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:56.073994 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-f47e10bb-76bc-4dc5-b0bb-d3ca66c94af1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:56.089712 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:56.120028 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da10cf2-2b3b-4f16-a1e0-81c140edc8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:56.121221 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da10cf2-2b3b-4f16-a1e0-81c140edc8c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:56.121848 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da10cf2-2b3b-4f16-a1e0-81c140edc8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:56.121848 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da10cf2-2b3b-4f16-a1e0-81c140edc8c3 admin admin] PATH_INFO: `/v3/projects/71e308d1e9c442ae9a51bbf20df6df9b` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:56.122971 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da10cf2-2b3b-4f16-a1e0-81c140edc8c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71e308d1e9c442ae9a51bbf20df6df9b)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:56.124934 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da10cf2-2b3b-4f16-a1e0-81c140edc8c3 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:56.146844 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e10bb-76bc-4dc5-b0bb-d3ca66c94af1 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:56.152484 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a010a108-3c7a-440b-aad8-8341789a5b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:56.153047 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a010a108-3c7a-440b-aad8-8341789a5b56 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:56.153332 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a010a108-3c7a-440b-aad8-8341789a5b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:56.153607 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a010a108-3c7a-440b-aad8-8341789a5b56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:56.159437 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a010a108-3c7a-440b-aad8-8341789a5b56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:56.159437 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a010a108-3c7a-440b-aad8-8341789a5b56 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:56.191724 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1038/2057] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:30:56 2022] POST /identity/v3/projects => generated 365 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:30:56.192894 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-6da10cf2-2b3b-4f16-a1e0-81c140edc8c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71e308d1e9c442ae9a51bbf20df6df9b', 'request_id': 'req-6da10cf2-2b3b-4f16-a1e0-81c140edc8c3'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:56.193199 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc79d82-619a-4e75-9151-64188cb077fe None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:56.193494 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc79d82-619a-4e75-9151-64188cb077fe None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:56.193793 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc79d82-619a-4e75-9151-64188cb077fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:56.204945 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-6da10cf2-2b3b-4f16-a1e0-81c140edc8c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71e308d1e9c442ae9a51bbf20df6df9b', 'request_id': 'req-6da10cf2-2b3b-4f16-a1e0-81c140edc8c3'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:56.213312 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-6da10cf2-2b3b-4f16-a1e0-81c140edc8c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71e308d1e9c442ae9a51bbf20df6df9b', 'request_id': 'req-6da10cf2-2b3b-4f16-a1e0-81c140edc8c3'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:56.218313 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-ecc79d82-619a-4e75-9151-64188cb077fe None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:56.219605 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-ecc79d82-619a-4e75-9151-64188cb077fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:56.232398 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-6da10cf2-2b3b-4f16-a1e0-81c140edc8c3 admin admin] The token cache is being invalidate because project 71e308d1e9c442ae9a51bbf20df6df9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80360) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:30:56.232866 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-6da10cf2-2b3b-4f16-a1e0-81c140edc8c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:56.233578 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-6da10cf2-2b3b-4f16-a1e0-81c140edc8c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:56.235602 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1020/2058] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:30:56 2022] DELETE /identity/v3/projects/71e308d1e9c442ae9a51bbf20df6df9b => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:56.236475 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da10cf2-2b3b-4f16-a1e0-81c140edc8c3 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:56.238057 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-6da10cf2-2b3b-4f16-a1e0-81c140edc8c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:56.307982 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1039/2059] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:30:56.307982 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fae157-b0dc-48f0-81e9-6d01390325ab None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:56.307982 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fae157-b0dc-48f0-81e9-6d01390325ab None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:56.307982 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fae157-b0dc-48f0-81e9-6d01390325ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:56.327605 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da10cf2-2b3b-4f16-a1e0-81c140edc8c3 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:56.341042 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-30fae157-b0dc-48f0-81e9-6d01390325ab None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:56.341955 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df53de4d-38b6-4ee0-b567-6e8d2326a3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:56.342676 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53de4d-38b6-4ee0-b567-6e8d2326a3ba admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:56.342791 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-30fae157-b0dc-48f0-81e9-6d01390325ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:56.343085 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53de4d-38b6-4ee0-b567-6e8d2326a3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:56.343459 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53de4d-38b6-4ee0-b567-6e8d2326a3ba admin admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:56.344207 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df53de4d-38b6-4ee0-b567-6e8d2326a3ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:56.346216 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df53de4d-38b6-4ee0-b567-6e8d2326a3ba admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:56.360919 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1040/2060] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:30:56.362583 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2fb84-5a45-46cc-961d-6408bd7401b9 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:56.362880 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2fb84-5a45-46cc-961d-6408bd7401b9 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:56.363158 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2fb84-5a45-46cc-961d-6408bd7401b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:56.378983 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1021/2061] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:30:56 2022] POST /identity/v3/users => generated 289 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:30:56.380592 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e955704-d4fb-4815-8412-74d1677b58d5 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:56.381820 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e955704-d4fb-4815-8412-74d1677b58d5 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:56.382176 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e955704-d4fb-4815-8412-74d1677b58d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:56.390402 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-03b2fb84-5a45-46cc-961d-6408bd7401b9 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:56.393495 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-03b2fb84-5a45-46cc-961d-6408bd7401b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:56.405614 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1041/2062] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:30:56.406531 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b2fb84-5a45-46cc-961d-6408bd7401b9 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:56.408416 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-9e955704-d4fb-4815-8412-74d1677b58d5 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:56.409750 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-9e955704-d4fb-4815-8412-74d1677b58d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:56.418290 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b2fb84-5a45-46cc-961d-6408bd7401b9 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:56.420275 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1022/2063] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:30:56.421055 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e955704-d4fb-4815-8412-74d1677b58d5 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:56.428450 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c15b342-bf3a-4a8d-aad6-12b7f29f1e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:56.429167 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15b342-bf3a-4a8d-aad6-12b7f29f1e92 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:56.429665 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15b342-bf3a-4a8d-aad6-12b7f29f1e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:56.430015 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15b342-bf3a-4a8d-aad6-12b7f29f1e92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:56.431472 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c15b342-bf3a-4a8d-aad6-12b7f29f1e92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:56.431609 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e955704-d4fb-4815-8412-74d1677b58d5 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:56.433475 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c15b342-bf3a-4a8d-aad6-12b7f29f1e92 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:56.437489 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1b5af0-f14a-4cda-b005-9afa8a689ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:56.438420 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b5af0-f14a-4cda-b005-9afa8a689ab3 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:56.438541 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b5af0-f14a-4cda-b005-9afa8a689ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:56.438798 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b5af0-f14a-4cda-b005-9afa8a689ab3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:56.439555 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1b5af0-f14a-4cda-b005-9afa8a689ab3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:30:56.439865 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1b5af0-f14a-4cda-b005-9afa8a689ab3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:56.441472 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1b5af0-f14a-4cda-b005-9afa8a689ab3 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:56.448245 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1042/2064] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:30:56.449658 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c15b342-bf3a-4a8d-aad6-12b7f29f1e92 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:56.461351 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c15b342-bf3a-4a8d-aad6-12b7f29f1e92 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:56.462633 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:56.469717 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a3174f-f75c-4608-a81c-326adc366f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:56.470482 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3174f-f75c-4608-a81c-326adc366f00 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:56.470777 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3174f-f75c-4608-a81c-326adc366f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:56.471326 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3174f-f75c-4608-a81c-326adc366f00 admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:56.472577 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a3174f-f75c-4608-a81c-326adc366f00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:30:56.472577 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a3174f-f75c-4608-a81c-326adc366f00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:56.474735 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a3174f-f75c-4608-a81c-326adc366f00 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:56.479044 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1023/2065] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 2 15:30:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:30:56.483025 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1b5af0-f14a-4cda-b005-9afa8a689ab3 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:56.494372 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1043/2066] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 2 15:30:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:30:56.494575 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1b5af0-f14a-4cda-b005-9afa8a689ab3 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:56.500181 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a3174f-f75c-4608-a81c-326adc366f00 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:56.502676 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108b0e1d-6b84-402d-b8bc-0bef5501d4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:56.503478 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b0e1d-6b84-402d-b8bc-0bef5501d4c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:56.503828 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b0e1d-6b84-402d-b8bc-0bef5501d4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:56.504244 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b0e1d-6b84-402d-b8bc-0bef5501d4c6 admin admin] PATH_INFO: `/v3/projects/ee340aeed9744346b06af550e6eed169/users/f489a8e4c00e4c8a81528ebffa3c1dff/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:56.513863 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a3174f-f75c-4608-a81c-326adc366f00 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:56.524350 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d4dfa9-e7a1-4605-bb0b-1f48b8a4cda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:56.524658 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108b0e1d-6b84-402d-b8bc-0bef5501d4c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee340aeed9744346b06af550e6eed169, user_id=f489a8e4c00e4c8a81528ebffa3c1dff, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:56.525231 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4dfa9-e7a1-4605-bb0b-1f48b8a4cda1 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:56.525656 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4dfa9-e7a1-4605-bb0b-1f48b8a4cda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:56.526166 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4dfa9-e7a1-4605-bb0b-1f48b8a4cda1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:56.527125 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d4dfa9-e7a1-4605-bb0b-1f48b8a4cda1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:56.527409 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108b0e1d-6b84-402d-b8bc-0bef5501d4c6 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:56.529316 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d4dfa9-e7a1-4605-bb0b-1f48b8a4cda1 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:56.546286 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1024/2067] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:30:56 2022] PUT /identity/v3/projects/ee340aeed9744346b06af550e6eed169/users/f489a8e4c00e4c8a81528ebffa3c1dff/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:56.547097 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108b0e1d-6b84-402d-b8bc-0bef5501d4c6 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:56.568555 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1044/2068] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:30:56 2022] POST /identity/v3/projects => generated 369 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:30:56.569642 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d4dfa9-e7a1-4605-bb0b-1f48b8a4cda1 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:56.571669 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:56.573410 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-43d4dfa9-e7a1-4605-bb0b-1f48b8a4cda1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:56.638438 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108b0e1d-6b84-402d-b8bc-0bef5501d4c6 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:56.643474 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ebcbdd-b514-41b1-8108-aa9220bc7f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:56.644099 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ebcbdd-b514-41b1-8108-aa9220bc7f80 admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:56.644380 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ebcbdd-b514-41b1-8108-aa9220bc7f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:56.644654 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ebcbdd-b514-41b1-8108-aa9220bc7f80 admin admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:56.645319 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ebcbdd-b514-41b1-8108-aa9220bc7f80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:56.647283 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ebcbdd-b514-41b1-8108-aa9220bc7f80 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:56.648451 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d4dfa9-e7a1-4605-bb0b-1f48b8a4cda1 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:56.654130 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e71679-5940-441d-adbf-ed72a1ee5d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:56.654773 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e71679-5940-441d-adbf-ed72a1ee5d6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:56.655086 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e71679-5940-441d-adbf-ed72a1ee5d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:56.655459 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e71679-5940-441d-adbf-ed72a1ee5d6f admin admin] PATH_INFO: `/v3/users/7adf2f9bcec046fd900437422bc7e7c9` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:56.656759 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e71679-5940-441d-adbf-ed72a1ee5d6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7adf2f9bcec046fd900437422bc7e7c9)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:56.659521 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e71679-5940-441d-adbf-ed72a1ee5d6f admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:56.682284 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1025/2069] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:30:56 2022] POST /identity/v3/projects => generated 383 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:30:56.683356 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ebcbdd-b514-41b1-8108-aa9220bc7f80 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:56.721479 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-02e71679-5940-441d-adbf-ed72a1ee5d6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7adf2f9bcec046fd900437422bc7e7c9'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:56.738449 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-02e71679-5940-441d-adbf-ed72a1ee5d6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7adf2f9bcec046fd900437422bc7e7c9'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:56.739454 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-02e71679-5940-441d-adbf-ed72a1ee5d6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7adf2f9bcec046fd900437422bc7e7c9'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:56.747012 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-02e71679-5940-441d-adbf-ed72a1ee5d6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7adf2f9bcec046fd900437422bc7e7c9'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:56.756721 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-02e71679-5940-441d-adbf-ed72a1ee5d6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7adf2f9bcec046fd900437422bc7e7c9'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:56.761760 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ebcbdd-b514-41b1-8108-aa9220bc7f80 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:56.764710 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1045/2070] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:30:56 2022] DELETE /identity/v3/users/7adf2f9bcec046fd900437422bc7e7c9 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:56.765536 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e71679-5940-441d-adbf-ed72a1ee5d6f admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:56.767189 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-02e71679-5940-441d-adbf-ed72a1ee5d6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:56.832701 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:56.837344 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39afaf3-4a19-4047-9c49-938f00d835eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:56.837957 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39afaf3-4a19-4047-9c49-938f00d835eb admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:56.838506 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39afaf3-4a19-4047-9c49-938f00d835eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:56.838767 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39afaf3-4a19-4047-9c49-938f00d835eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:56.840510 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39afaf3-4a19-4047-9c49-938f00d835eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:56.841703 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39afaf3-4a19-4047-9c49-938f00d835eb admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:56.854252 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1026/2071] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:30:56.857104 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e71679-5940-441d-adbf-ed72a1ee5d6f admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:56.858807 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39afaf3-4a19-4047-9c49-938f00d835eb admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:56.860959 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-a39afaf3-4a19-4047-9c49-938f00d835eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:56.862448 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6e4688-0ab0-4b24-93e3-4c3fdb4da1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:56.863152 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e4688-0ab0-4b24-93e3-4c3fdb4da1db admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:56.863531 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e4688-0ab0-4b24-93e3-4c3fdb4da1db admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:56.863890 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e4688-0ab0-4b24-93e3-4c3fdb4da1db admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:56.865413 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6e4688-0ab0-4b24-93e3-4c3fdb4da1db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:56.867856 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6e4688-0ab0-4b24-93e3-4c3fdb4da1db admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:56.874514 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39afaf3-4a19-4047-9c49-938f00d835eb admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:56.879499 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a866133-0482-420c-b2d0-db73ecc65faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:56.880281 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a866133-0482-420c-b2d0-db73ecc65faa admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:56.880605 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a866133-0482-420c-b2d0-db73ecc65faa admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:56.883131 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a866133-0482-420c-b2d0-db73ecc65faa admin admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:56.883131 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a866133-0482-420c-b2d0-db73ecc65faa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:56.883680 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a866133-0482-420c-b2d0-db73ecc65faa admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:56.894316 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1046/2072] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:30:56 2022] POST /identity/v3/users => generated 285 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:30:56.896053 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3ce2d-1b6f-45a4-ac65-4360449c0bf4 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:56.896390 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3ce2d-1b6f-45a4-ac65-4360449c0bf4 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:56.896800 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3ce2d-1b6f-45a4-ac65-4360449c0bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:56.912348 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1027/2073] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:30:56 2022] POST /identity/v3/users => generated 292 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:30:56.913111 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a866133-0482-420c-b2d0-db73ecc65faa admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:56.921616 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-fcc3ce2d-1b6f-45a4-ac65-4360449c0bf4 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:56.922840 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-fcc3ce2d-1b6f-45a4-ac65-4360449c0bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:56.924632 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-7a866133-0482-420c-b2d0-db73ecc65faa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:56.931632 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1047/2074] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:30:56.933406 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc3ce2d-1b6f-45a4-ac65-4360449c0bf4 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:56.943398 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a866133-0482-420c-b2d0-db73ecc65faa admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:56.944904 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc3ce2d-1b6f-45a4-ac65-4360449c0bf4 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:56.949071 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ca2b5-a2f9-496c-965a-6a4d66b0f82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:56.949998 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ca2b5-a2f9-496c-965a-6a4d66b0f82b admin admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:56.950491 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ca2b5-a2f9-496c-965a-6a4d66b0f82b admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:56.950671 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546702ca-0cb9-49d1-b41c-81f357ef1225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:56.950975 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ca2b5-a2f9-496c-965a-6a4d66b0f82b admin admin] PATH_INFO: `/v3/projects/ee340aeed9744346b06af550e6eed169/users/f489a8e4c00e4c8a81528ebffa3c1dff/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:56.951530 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546702ca-0cb9-49d1-b41c-81f357ef1225 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:56.951879 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546702ca-0cb9-49d1-b41c-81f357ef1225 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:56.952220 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546702ca-0cb9-49d1-b41c-81f357ef1225 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:56.952983 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546702ca-0cb9-49d1-b41c-81f357ef1225 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:56.953433 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726ca2b5-a2f9-496c-965a-6a4d66b0f82b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee340aeed9744346b06af550e6eed169, user_id=f489a8e4c00e4c8a81528ebffa3c1dff, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:56.954707 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546702ca-0cb9-49d1-b41c-81f357ef1225 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:56.956417 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726ca2b5-a2f9-496c-965a-6a4d66b0f82b admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:56.975597 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1028/2075] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:30:56 2022] PUT /identity/v3/projects/ee340aeed9744346b06af550e6eed169/users/f489a8e4c00e4c8a81528ebffa3c1dff/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:56.976879 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ca2b5-a2f9-496c-965a-6a4d66b0f82b admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:56.978381 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1048/2076] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:30:56.978381 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546702ca-0cb9-49d1-b41c-81f357ef1225 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:56.982221 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-546702ca-0cb9-49d1-b41c-81f357ef1225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:56.997434 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:57.056581 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546702ca-0cb9-49d1-b41c-81f357ef1225 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:57.072551 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ca2b5-a2f9-496c-965a-6a4d66b0f82b admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:57.077858 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1ca386-9410-4e96-b0e9-8a43f83d1e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:57.078488 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ca386-9410-4e96-b0e9-8a43f83d1e20 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:57.078772 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ca386-9410-4e96-b0e9-8a43f83d1e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:57.079051 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ca386-9410-4e96-b0e9-8a43f83d1e20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:57.079791 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1ca386-9410-4e96-b0e9-8a43f83d1e20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:57.081899 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1ca386-9410-4e96-b0e9-8a43f83d1e20 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:57.094295 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1029/2077] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:30:57.095164 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1ca386-9410-4e96-b0e9-8a43f83d1e20 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:57.108694 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1ca386-9410-4e96-b0e9-8a43f83d1e20 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:57.114599 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a790dc-c697-481a-b456-ef041627f9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:57.115578 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a790dc-c697-481a-b456-ef041627f9d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:57.115934 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a790dc-c697-481a-b456-ef041627f9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:57.116344 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a790dc-c697-481a-b456-ef041627f9d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:57.117199 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a790dc-c697-481a-b456-ef041627f9d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:57.118821 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a790dc-c697-481a-b456-ef041627f9d4 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:57.122499 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089e71e-0240-4559-8801-9683bb78e277 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:57.123473 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089e71e-0240-4559-8801-9683bb78e277 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:57.124693 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089e71e-0240-4559-8801-9683bb78e277 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:57.124693 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089e71e-0240-4559-8801-9683bb78e277 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:57.133643 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1030/2078] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:30:57.133643 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64495156-e400-46bc-922e-61f2c8a40991 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:57.133643 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64495156-e400-46bc-922e-61f2c8a40991 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:57.133643 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64495156-e400-46bc-922e-61f2c8a40991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:57.138144 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8089e71e-0240-4559-8801-9683bb78e277 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:57.140593 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8089e71e-0240-4559-8801-9683bb78e277 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:57.161984 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1049/2079] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:30:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:30:57.163011 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089e71e-0240-4559-8801-9683bb78e277 service neutron] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:57.175594 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089e71e-0240-4559-8801-9683bb78e277 service neutron] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:57.177907 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-64495156-e400-46bc-922e-61f2c8a40991 None None] MFA Rules not processed for user `f489a8e4c00e4c8a81528ebffa3c1dff`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:57.179664 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-64495156-e400-46bc-922e-61f2c8a40991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:57.182597 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0684782-1aff-4766-83b0-312f7084cbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:57.183919 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0684782-1aff-4766-83b0-312f7084cbb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:57.184298 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0684782-1aff-4766-83b0-312f7084cbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:57.184709 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0684782-1aff-4766-83b0-312f7084cbb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:57.185540 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0684782-1aff-4766-83b0-312f7084cbb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:57.187352 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0684782-1aff-4766-83b0-312f7084cbb2 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:57.210322 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1050/2080] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:30:57.210322 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0684782-1aff-4766-83b0-312f7084cbb2 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:57.227613 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0684782-1aff-4766-83b0-312f7084cbb2 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:57.234388 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc55f83-86c7-4606-b93b-ad3504c509d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:57.236088 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc55f83-86c7-4606-b93b-ad3504c509d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:57.236465 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc55f83-86c7-4606-b93b-ad3504c509d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:57.236639 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc55f83-86c7-4606-b93b-ad3504c509d8 admin admin] PATH_INFO: `/v3/projects/7b83e3e91bb0488cb5d32af310d6c202/users/4fe40f90a9014a5380f5c6bd2688c5fa/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:57.255864 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc55f83-86c7-4606-b93b-ad3504c509d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b83e3e91bb0488cb5d32af310d6c202, user_id=4fe40f90a9014a5380f5c6bd2688c5fa, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:57.259020 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc55f83-86c7-4606-b93b-ad3504c509d8 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:57.278453 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1051/2081] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:30:57 2022] PUT /identity/v3/projects/7b83e3e91bb0488cb5d32af310d6c202/users/4fe40f90a9014a5380f5c6bd2688c5fa/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:57.279293 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc55f83-86c7-4606-b93b-ad3504c509d8 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:57.308726 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1031/2082] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:57 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:30:57.310031 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb5dac-6ae0-4c4f-93e0-9783d54a5170 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:57.310316 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb5dac-6ae0-4c4f-93e0-9783d54a5170 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:57.310591 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb5dac-6ae0-4c4f-93e0-9783d54a5170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:57.344713 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:57.346684 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-4beb5dac-6ae0-4c4f-93e0-9783d54a5170 None None] MFA Rules not processed for user `4fe40f90a9014a5380f5c6bd2688c5fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:57.347961 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-4beb5dac-6ae0-4c4f-93e0-9783d54a5170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:57.371387 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc55f83-86c7-4606-b93b-ad3504c509d8 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:57.377123 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0afb58f-0464-4954-90fb-669d45388357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:57.377968 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0afb58f-0464-4954-90fb-669d45388357 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:57.378263 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0afb58f-0464-4954-90fb-669d45388357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:57.378543 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0afb58f-0464-4954-90fb-669d45388357 admin admin] PATH_INFO: `/v3/projects/dfae20dade2c4d0393ccfc1eea42b62b/users/db585176ae0a41ed918445ee5c326975/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:57.397413 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0afb58f-0464-4954-90fb-669d45388357 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfae20dade2c4d0393ccfc1eea42b62b, user_id=db585176ae0a41ed918445ee5c326975, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:57.400379 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0afb58f-0464-4954-90fb-669d45388357 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:57.416204 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1052/2083] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:30:57 2022] PUT /identity/v3/projects/dfae20dade2c4d0393ccfc1eea42b62b/users/db585176ae0a41ed918445ee5c326975/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:57.422573 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0afb58f-0464-4954-90fb-669d45388357 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:57.424521 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-c0afb58f-0464-4954-90fb-669d45388357 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:57.432560 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1032/2084] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:30:57.434517 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d4ae2-af1a-4501-af6e-57a37baaa35e None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:57.434897 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d4ae2-af1a-4501-af6e-57a37baaa35e None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:57.435511 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d4ae2-af1a-4501-af6e-57a37baaa35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:57.458941 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:57.474125 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-e86d4ae2-af1a-4501-af6e-57a37baaa35e None None] MFA Rules not processed for user `db585176ae0a41ed918445ee5c326975`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:57.475273 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-e86d4ae2-af1a-4501-af6e-57a37baaa35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:57.510779 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0afb58f-0464-4954-90fb-669d45388357 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:57.524516 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b131af4d-631d-47f1-a14a-e1fbe3646240 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:57.524516 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b131af4d-631d-47f1-a14a-e1fbe3646240 service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:57.524516 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b131af4d-631d-47f1-a14a-e1fbe3646240 service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:57.524516 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b131af4d-631d-47f1-a14a-e1fbe3646240 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:57.575258 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1033/2085] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:30:57.576217 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d4ae2-af1a-4501-af6e-57a37baaa35e None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:57.579763 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-e86d4ae2-af1a-4501-af6e-57a37baaa35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:57.607010 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b131af4d-631d-47f1-a14a-e1fbe3646240 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:57.609423 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b131af4d-631d-47f1-a14a-e1fbe3646240 service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:57.624030 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1053/2086] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:30:57 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:30:57.625386 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b131af4d-631d-47f1-a14a-e1fbe3646240 service cinder] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:57.705073 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d4ae2-af1a-4501-af6e-57a37baaa35e None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:57.709926 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e7866-3428-40b4-8778-5c78848c25ff service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946af31d75ca41a2a4301e0294cf98f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:57.710528 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e7866-3428-40b4-8778-5c78848c25ff service glance] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:57.710818 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e7866-3428-40b4-8778-5c78848c25ff service glance] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:57.711462 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e7866-3428-40b4-8778-5c78848c25ff service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:57.736916 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b131af4d-631d-47f1-a14a-e1fbe3646240 service cinder] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:57.743460 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06de6b6-15a1-43ac-9956-316594ee86b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:57.744930 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06de6b6-15a1-43ac-9956-316594ee86b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:57.745363 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06de6b6-15a1-43ac-9956-316594ee86b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:57.746194 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06de6b6-15a1-43ac-9956-316594ee86b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:57.747329 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06de6b6-15a1-43ac-9956-316594ee86b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:57.749893 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06de6b6-15a1-43ac-9956-316594ee86b8 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:57.784352 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:57.800449 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1054/2087] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:30:57 2022] POST /identity/v3/projects => generated 383 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:30:57.800949 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e7866-3428-40b4-8778-5c78848c25ff service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:57.801751 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06de6b6-15a1-43ac-9956-316594ee86b8 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:57.802646 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e7866-3428-40b4-8778-5c78848c25ff service glance] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:57.813859 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1034/2088] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:30:57 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:30:57.814717 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e7866-3428-40b4-8778-5c78848c25ff service glance] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:57.816381 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-8b7e7866-3428-40b4-8778-5c78848c25ff service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:57.833286 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e7866-3428-40b4-8778-5c78848c25ff service glance] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:57.868983 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:57.874726 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06de6b6-15a1-43ac-9956-316594ee86b8 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:57.878679 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3048064-2089-4863-8a9f-afd1dfd521e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:57.879542 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3048064-2089-4863-8a9f-afd1dfd521e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:57.879906 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3048064-2089-4863-8a9f-afd1dfd521e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:57.881359 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3048064-2089-4863-8a9f-afd1dfd521e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:57.882773 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-d3048064-2089-4863-8a9f-afd1dfd521e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:57.903005 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e6615-51fc-42b3-a528-985703048a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:57.903881 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e6615-51fc-42b3-a528-985703048a2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:57.904328 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e6615-51fc-42b3-a528-985703048a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:57.904655 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e6615-51fc-42b3-a528-985703048a2d admin admin] PATH_INFO: `/v3/projects/324d13a723aa4d3a987c5541d25d529f` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:57.906532 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05e6615-51fc-42b3-a528-985703048a2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=324d13a723aa4d3a987c5541d25d529f)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:57.909016 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05e6615-51fc-42b3-a528-985703048a2d admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:57.953010 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3048064-2089-4863-8a9f-afd1dfd521e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:57.954473 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3048064-2089-4863-8a9f-afd1dfd521e8 service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:57.964986 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1055/2089] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:30:57 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:30:57.965807 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3048064-2089-4863-8a9f-afd1dfd521e8 service cinder] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:57.972389 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-f05e6615-51fc-42b3-a528-985703048a2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '324d13a723aa4d3a987c5541d25d529f', 'request_id': 'req-f05e6615-51fc-42b3-a528-985703048a2d'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:57.977069 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3048064-2089-4863-8a9f-afd1dfd521e8 service cinder] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:57.982253 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-f05e6615-51fc-42b3-a528-985703048a2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '324d13a723aa4d3a987c5541d25d529f', 'request_id': 'req-f05e6615-51fc-42b3-a528-985703048a2d'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:57.990447 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-f05e6615-51fc-42b3-a528-985703048a2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '324d13a723aa4d3a987c5541d25d529f', 'request_id': 'req-f05e6615-51fc-42b3-a528-985703048a2d'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:58.004838 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-f05e6615-51fc-42b3-a528-985703048a2d admin admin] The token cache is being invalidate because project 324d13a723aa4d3a987c5541d25d529f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80360) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:30:58.005482 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-f05e6615-51fc-42b3-a528-985703048a2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:58.007498 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-f05e6615-51fc-42b3-a528-985703048a2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:58.009347 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1035/2090] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:30:57 2022] DELETE /identity/v3/projects/324d13a723aa4d3a987c5541d25d529f => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:58.016167 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66411b9c-8fbe-430e-a45a-4f2a09c8b811 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:58.016869 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66411b9c-8fbe-430e-a45a-4f2a09c8b811 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:58.017346 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66411b9c-8fbe-430e-a45a-4f2a09c8b811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:58.047024 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-66411b9c-8fbe-430e-a45a-4f2a09c8b811 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:58.048043 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-66411b9c-8fbe-430e-a45a-4f2a09c8b811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:58.055966 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330cac82-1786-4aa4-96f4-cc8823cf40da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:58.058459 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cac82-1786-4aa4-96f4-cc8823cf40da admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:58.059014 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cac82-1786-4aa4-96f4-cc8823cf40da admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:58.059014 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cac82-1786-4aa4-96f4-cc8823cf40da admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:58.059896 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330cac82-1786-4aa4-96f4-cc8823cf40da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:58.062105 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330cac82-1786-4aa4-96f4-cc8823cf40da admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:58.090839 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1056/2091] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:30:57 2022] POST /identity/v3/users => generated 298 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:30:58.091790 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330cac82-1786-4aa4-96f4-cc8823cf40da admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:58.093868 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-330cac82-1786-4aa4-96f4-cc8823cf40da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:58.109861 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330cac82-1786-4aa4-96f4-cc8823cf40da admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:58.115847 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8b4004-edcb-4fed-a8c0-92137b76c003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:58.116636 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b4004-edcb-4fed-a8c0-92137b76c003 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:58.116921 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b4004-edcb-4fed-a8c0-92137b76c003 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:58.117521 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b4004-edcb-4fed-a8c0-92137b76c003 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:58.118495 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8b4004-edcb-4fed-a8c0-92137b76c003 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:58.120912 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8b4004-edcb-4fed-a8c0-92137b76c003 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:58.137173 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1057/2092] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:30:58.140048 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1036/2093] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:30:58.147308 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8b4004-edcb-4fed-a8c0-92137b76c003 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:58.149232 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8490fa-f243-4ab3-bb21-d523bb55797d None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:58.149514 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8490fa-f243-4ab3-bb21-d523bb55797d None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:58.152561 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8490fa-f243-4ab3-bb21-d523bb55797d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:58.165891 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8b4004-edcb-4fed-a8c0-92137b76c003 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:58.176414 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6338b3-dcdc-4b37-94f0-aa5774817ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:58.177310 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6338b3-dcdc-4b37-94f0-aa5774817ecb admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:58.179625 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6338b3-dcdc-4b37-94f0-aa5774817ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:58.180169 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6338b3-dcdc-4b37-94f0-aa5774817ecb admin admin] PATH_INFO: `/v3/projects/a6115291de054c89877e066789a52390/users/36db5e63f1a6401aa407ad5e7f06f69d/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:58.181287 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-dc8490fa-f243-4ab3-bb21-d523bb55797d None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:58.182907 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-dc8490fa-f243-4ab3-bb21-d523bb55797d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:58.198161 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1037/2094] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:30:58.202735 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8490fa-f243-4ab3-bb21-d523bb55797d None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:58.207901 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6338b3-dcdc-4b37-94f0-aa5774817ecb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6115291de054c89877e066789a52390, user_id=36db5e63f1a6401aa407ad5e7f06f69d, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:58.211280 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6338b3-dcdc-4b37-94f0-aa5774817ecb admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:58.218396 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8490fa-f243-4ab3-bb21-d523bb55797d None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:58.224793 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5e5b7-3bad-46ec-bd3c-827ab247edbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:58.225266 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5e5b7-3bad-46ec-bd3c-827ab247edbf admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:58.225625 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5e5b7-3bad-46ec-bd3c-827ab247edbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:58.226032 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5e5b7-3bad-46ec-bd3c-827ab247edbf admin admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:58.226802 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde5e5b7-3bad-46ec-bd3c-827ab247edbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:30:58.227181 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde5e5b7-3bad-46ec-bd3c-827ab247edbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:58.229120 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde5e5b7-3bad-46ec-bd3c-827ab247edbf admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:58.239554 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1058/2095] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:30:58 2022] PUT /identity/v3/projects/a6115291de054c89877e066789a52390/users/36db5e63f1a6401aa407ad5e7f06f69d/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:58.240524 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6338b3-dcdc-4b37-94f0-aa5774817ecb admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:58.246208 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1038/2096] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 2 15:30:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:30:58.250408 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5e5b7-3bad-46ec-bd3c-827ab247edbf admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:58.252766 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:58.263751 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5e5b7-3bad-46ec-bd3c-827ab247edbf admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:58.328156 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:58.330179 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6338b3-dcdc-4b37-94f0-aa5774817ecb admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:58.340631 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202d63ae-c5e8-43fa-bf69-0b77246ea5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:58.342182 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d63ae-c5e8-43fa-bf69-0b77246ea5cb admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:58.342526 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d63ae-c5e8-43fa-bf69-0b77246ea5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:58.342973 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d63ae-c5e8-43fa-bf69-0b77246ea5cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:58.344894 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202d63ae-c5e8-43fa-bf69-0b77246ea5cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:58.348265 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202d63ae-c5e8-43fa-bf69-0b77246ea5cb admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:58.364882 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1059/2097] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:30:58.368754 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202d63ae-c5e8-43fa-bf69-0b77246ea5cb admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:58.370558 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f05a7-5ff4-4163-a456-bbb9bad40ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:58.371434 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f05a7-5ff4-4163-a456-bbb9bad40ac9 admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:58.374158 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f05a7-5ff4-4163-a456-bbb9bad40ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:58.374505 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f05a7-5ff4-4163-a456-bbb9bad40ac9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:58.376322 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9f05a7-5ff4-4163-a456-bbb9bad40ac9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:58.381873 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202d63ae-c5e8-43fa-bf69-0b77246ea5cb admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:58.382092 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9f05a7-5ff4-4163-a456-bbb9bad40ac9 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:58.387897 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ebc20-c67a-45d4-a6c0-2f56e2921d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:58.388835 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ebc20-c67a-45d4-a6c0-2f56e2921d97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:58.389370 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ebc20-c67a-45d4-a6c0-2f56e2921d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:58.390080 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ebc20-c67a-45d4-a6c0-2f56e2921d97 admin admin] PATH_INFO: `/v3/projects/a6115291de054c89877e066789a52390/users/36db5e63f1a6401aa407ad5e7f06f69d/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:58.392701 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36ebc20-c67a-45d4-a6c0-2f56e2921d97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6115291de054c89877e066789a52390, user_id=36db5e63f1a6401aa407ad5e7f06f69d, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:58.395953 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36ebc20-c67a-45d4-a6c0-2f56e2921d97 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:58.411787 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1060/2098] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:30:58 2022] PUT /identity/v3/projects/a6115291de054c89877e066789a52390/users/36db5e63f1a6401aa407ad5e7f06f69d/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 15:30:58.428355 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1039/2099] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:30:58 2022] POST /identity/v3/projects => generated 375 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 15:30:58.430198 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8dd0af-4e42-4ac2-845a-60ed3a684c54 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:58.430738 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8dd0af-4e42-4ac2-845a-60ed3a684c54 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:58.431452 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8dd0af-4e42-4ac2-845a-60ed3a684c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:58.431920 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f05a7-5ff4-4163-a456-bbb9bad40ac9 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:58.506096 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-ba8dd0af-4e42-4ac2-845a-60ed3a684c54 None None] MFA Rules not processed for user `36db5e63f1a6401aa407ad5e7f06f69d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:58.507515 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-ba8dd0af-4e42-4ac2-845a-60ed3a684c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:58.509021 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f05a7-5ff4-4163-a456-bbb9bad40ac9 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:58.516966 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ad39e-699d-48f3-bbfe-17a3c0df3793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:58.517608 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ad39e-699d-48f3-bbfe-17a3c0df3793 admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:58.517946 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ad39e-699d-48f3-bbfe-17a3c0df3793 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:58.518197 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ad39e-699d-48f3-bbfe-17a3c0df3793 admin admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:58.518829 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4ad39e-699d-48f3-bbfe-17a3c0df3793 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:58.520828 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4ad39e-699d-48f3-bbfe-17a3c0df3793 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:58.565989 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1040/2100] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:30:58 2022] POST /identity/v3/users => generated 288 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:30:58.571886 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ad39e-699d-48f3-bbfe-17a3c0df3793 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:58.601392 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ad39e-699d-48f3-bbfe-17a3c0df3793 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:58.613338 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b81ec-e1e9-4c7e-88d8-8d77022d23e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:58.613979 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b81ec-e1e9-4c7e-88d8-8d77022d23e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:58.614256 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b81ec-e1e9-4c7e-88d8-8d77022d23e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:58.614529 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b81ec-e1e9-4c7e-88d8-8d77022d23e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:58.615249 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964b81ec-e1e9-4c7e-88d8-8d77022d23e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:58.618882 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964b81ec-e1e9-4c7e-88d8-8d77022d23e9 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:58.636832 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1041/2101] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:30:58.641948 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b81ec-e1e9-4c7e-88d8-8d77022d23e9 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:58.655882 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b81ec-e1e9-4c7e-88d8-8d77022d23e9 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:58.661946 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf7546-8bb4-426c-851b-4394329f92c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:58.662576 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf7546-8bb4-426c-851b-4394329f92c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:58.662862 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf7546-8bb4-426c-851b-4394329f92c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:58.663408 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf7546-8bb4-426c-851b-4394329f92c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:58.664106 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecf7546-8bb4-426c-851b-4394329f92c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:58.665702 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecf7546-8bb4-426c-851b-4394329f92c5 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:58.682315 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1061/2102] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:58 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:30:58.685590 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1042/2103] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:30:58.701795 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8dd0af-4e42-4ac2-845a-60ed3a684c54 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:58.705078 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf7546-8bb4-426c-851b-4394329f92c5 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:58.708027 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-6ecf7546-8bb4-426c-851b-4394329f92c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:58.714249 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8dd0af-4e42-4ac2-845a-60ed3a684c54 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:58.720361 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7376330-5778-4f51-9413-bd5b05a091fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:58.721165 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7376330-5778-4f51-9413-bd5b05a091fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:58.721438 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7376330-5778-4f51-9413-bd5b05a091fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:58.721746 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7376330-5778-4f51-9413-bd5b05a091fe admin admin] PATH_INFO: `/v3/projects/b3cbd5ab1939461488287f904501aa17/users/67f6eea3c2044c24843daf73e46f7fef/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:58.744586 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7376330-5778-4f51-9413-bd5b05a091fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3cbd5ab1939461488287f904501aa17, user_id=67f6eea3c2044c24843daf73e46f7fef, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:58.748544 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7376330-5778-4f51-9413-bd5b05a091fe admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:58.764403 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1062/2104] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:30:58 2022] PUT /identity/v3/projects/b3cbd5ab1939461488287f904501aa17/users/67f6eea3c2044c24843daf73e46f7fef/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:58.775599 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9c942-54d9-4d4f-bfc3-c832cfaa6484 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:58.775975 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9c942-54d9-4d4f-bfc3-c832cfaa6484 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:58.776363 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9c942-54d9-4d4f-bfc3-c832cfaa6484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:58.807518 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf7546-8bb4-426c-851b-4394329f92c5 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:58.827383 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-07c9c942-54d9-4d4f-bfc3-c832cfaa6484 None None] MFA Rules not processed for user `67f6eea3c2044c24843daf73e46f7fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:58.827383 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-07c9c942-54d9-4d4f-bfc3-c832cfaa6484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:58.881547 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:58.920538 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfa2802-ab5e-4deb-ae53-f40c46756fbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:58.922183 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1063/2105] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:30:58.924113 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa2802-ab5e-4deb-ae53-f40c46756fbd service cinder] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:58.924701 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa2802-ab5e-4deb-ae53-f40c46756fbd service cinder] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:58.924956 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa2802-ab5e-4deb-ae53-f40c46756fbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:58.935016 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:58.981686 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c9c942-54d9-4d4f-bfc3-c832cfaa6484 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:58.983089 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-07c9c942-54d9-4d4f-bfc3-c832cfaa6484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:58.996331 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c9c942-54d9-4d4f-bfc3-c832cfaa6484 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:58.998543 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfa2802-ab5e-4deb-ae53-f40c46756fbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:59.000069 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9765033-944e-46ad-a0c0-5c8c289178f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:59.000262 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfa2802-ab5e-4deb-ae53-f40c46756fbd service cinder] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:59.000686 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9765033-944e-46ad-a0c0-5c8c289178f5 service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:59.001015 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9765033-944e-46ad-a0c0-5c8c289178f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:59.001229 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9765033-944e-46ad-a0c0-5c8c289178f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:59.010132 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9765033-944e-46ad-a0c0-5c8c289178f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:59.011444 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1043/2106] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:30:58 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:30:59.012484 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9765033-944e-46ad-a0c0-5c8c289178f5 service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:59.022479 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1064/2107] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:30:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 15:30:59.106394 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfa2802-ab5e-4deb-ae53-f40c46756fbd service cinder] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:59.114961 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfa2802-ab5e-4deb-ae53-f40c46756fbd service cinder] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:59.118693 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4737d32f-99b6-4e2f-8212-3dba9f6defbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:59.119377 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737d32f-99b6-4e2f-8212-3dba9f6defbc service cinder] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:59.119610 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737d32f-99b6-4e2f-8212-3dba9f6defbc service cinder] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:59.119885 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737d32f-99b6-4e2f-8212-3dba9f6defbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:59.122196 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-4737d32f-99b6-4e2f-8212-3dba9f6defbc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:59.192731 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4737d32f-99b6-4e2f-8212-3dba9f6defbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:59.194332 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4737d32f-99b6-4e2f-8212-3dba9f6defbc service cinder] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:59.204625 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1044/2108] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:30:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:30:59.506568 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9765033-944e-46ad-a0c0-5c8c289178f5 service cinder] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:59.580548 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9765033-944e-46ad-a0c0-5c8c289178f5 service cinder] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:59.585465 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a44a957-ffd8-49e2-943d-dd003c41e2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:59.586104 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44a957-ffd8-49e2-943d-dd003c41e2b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:59.586390 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44a957-ffd8-49e2-943d-dd003c41e2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:59.586670 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44a957-ffd8-49e2-943d-dd003c41e2b0 admin admin] PATH_INFO: `/v3/users/db585176ae0a41ed918445ee5c326975` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:59.587906 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a44a957-ffd8-49e2-943d-dd003c41e2b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db585176ae0a41ed918445ee5c326975)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:59.590389 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a44a957-ffd8-49e2-943d-dd003c41e2b0 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:59.648290 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-8a44a957-ffd8-49e2-943d-dd003c41e2b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db585176ae0a41ed918445ee5c326975'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:59.661416 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-8a44a957-ffd8-49e2-943d-dd003c41e2b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db585176ae0a41ed918445ee5c326975'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:59.662204 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-8a44a957-ffd8-49e2-943d-dd003c41e2b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db585176ae0a41ed918445ee5c326975'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:59.669621 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-8a44a957-ffd8-49e2-943d-dd003c41e2b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db585176ae0a41ed918445ee5c326975'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:59.687440 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-8a44a957-ffd8-49e2-943d-dd003c41e2b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db585176ae0a41ed918445ee5c326975'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:30:59.697097 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1065/2109] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:30:59 2022] DELETE /identity/v3/users/db585176ae0a41ed918445ee5c326975 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:30:59.701594 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421bda63-f2b6-4a2a-9d5d-b7f594907baf None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:59.701693 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421bda63-f2b6-4a2a-9d5d-b7f594907baf None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:59.701948 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421bda63-f2b6-4a2a-9d5d-b7f594907baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:59.738001 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-421bda63-f2b6-4a2a-9d5d-b7f594907baf None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:30:59.739345 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-421bda63-f2b6-4a2a-9d5d-b7f594907baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:59.823363 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1045/2110] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:30:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:30:59.831433 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a44a957-ffd8-49e2-943d-dd003c41e2b0 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:30:59.835539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-8a44a957-ffd8-49e2-943d-dd003c41e2b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:30:59.896091 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:30:59.900150 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a44a957-ffd8-49e2-943d-dd003c41e2b0 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:30:59.906045 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cbbd51-a3a2-461b-a8c9-4a2fc1f14de7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:30:59.906746 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cbbd51-a3a2-461b-a8c9-4a2fc1f14de7 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:30:59.907093 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cbbd51-a3a2-461b-a8c9-4a2fc1f14de7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:30:59.907407 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cbbd51-a3a2-461b-a8c9-4a2fc1f14de7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:30:59.917909 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cbbd51-a3a2-461b-a8c9-4a2fc1f14de7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:30:59.919417 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cbbd51-a3a2-461b-a8c9-4a2fc1f14de7 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:30:59.933936 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1066/2111] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:30:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:31:00.263469 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421bda63-f2b6-4a2a-9d5d-b7f594907baf None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:00.264956 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-421bda63-f2b6-4a2a-9d5d-b7f594907baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:00.277594 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421bda63-f2b6-4a2a-9d5d-b7f594907baf None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:00.282667 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b6e0aa-8de7-4d5d-a8e1-998e491cec61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:00.283361 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b6e0aa-8de7-4d5d-a8e1-998e491cec61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:00.283639 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b6e0aa-8de7-4d5d-a8e1-998e491cec61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:00.283913 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b6e0aa-8de7-4d5d-a8e1-998e491cec61 admin admin] PATH_INFO: `/v3/projects/dfae20dade2c4d0393ccfc1eea42b62b` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:00.285084 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b6e0aa-8de7-4d5d-a8e1-998e491cec61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfae20dade2c4d0393ccfc1eea42b62b)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:00.286979 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b6e0aa-8de7-4d5d-a8e1-998e491cec61 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:00.328927 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:31:00.339635 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-f2b6e0aa-8de7-4d5d-a8e1-998e491cec61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfae20dade2c4d0393ccfc1eea42b62b', 'request_id': 'req-f2b6e0aa-8de7-4d5d-a8e1-998e491cec61'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:00.348033 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-f2b6e0aa-8de7-4d5d-a8e1-998e491cec61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfae20dade2c4d0393ccfc1eea42b62b', 'request_id': 'req-f2b6e0aa-8de7-4d5d-a8e1-998e491cec61'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:00.355419 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-f2b6e0aa-8de7-4d5d-a8e1-998e491cec61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfae20dade2c4d0393ccfc1eea42b62b', 'request_id': 'req-f2b6e0aa-8de7-4d5d-a8e1-998e491cec61'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:00.365807 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-f2b6e0aa-8de7-4d5d-a8e1-998e491cec61 admin admin] The token cache is being invalidate because project dfae20dade2c4d0393ccfc1eea42b62b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80360) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:31:00.366095 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-f2b6e0aa-8de7-4d5d-a8e1-998e491cec61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:00.366722 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-f2b6e0aa-8de7-4d5d-a8e1-998e491cec61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:00.368259 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1046/2112] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:31:00 2022] DELETE /identity/v3/projects/dfae20dade2c4d0393ccfc1eea42b62b => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:31:00.372376 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cbbd51-a3a2-461b-a8c9-4a2fc1f14de7 service neutron] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:00.381884 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cbbd51-a3a2-461b-a8c9-4a2fc1f14de7 service neutron] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:00.444351 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b415e-d176-4b04-b123-7a2b33fde2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:00.444999 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b415e-d176-4b04-b123-7a2b33fde2d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:00.445282 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b415e-d176-4b04-b123-7a2b33fde2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:00.445560 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b415e-d176-4b04-b123-7a2b33fde2d8 admin admin] PATH_INFO: `/v3/users/36db5e63f1a6401aa407ad5e7f06f69d` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:00.446755 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960b415e-d176-4b04-b123-7a2b33fde2d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36db5e63f1a6401aa407ad5e7f06f69d)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:00.448748 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960b415e-d176-4b04-b123-7a2b33fde2d8 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:00.497348 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-960b415e-d176-4b04-b123-7a2b33fde2d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36db5e63f1a6401aa407ad5e7f06f69d'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:00.514430 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-960b415e-d176-4b04-b123-7a2b33fde2d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36db5e63f1a6401aa407ad5e7f06f69d'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:00.515287 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-960b415e-d176-4b04-b123-7a2b33fde2d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36db5e63f1a6401aa407ad5e7f06f69d'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:00.522519 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-960b415e-d176-4b04-b123-7a2b33fde2d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36db5e63f1a6401aa407ad5e7f06f69d'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:00.541970 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-960b415e-d176-4b04-b123-7a2b33fde2d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36db5e63f1a6401aa407ad5e7f06f69d'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:00.551939 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1067/2113] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:31:00 2022] DELETE /identity/v3/users/36db5e63f1a6401aa407ad5e7f06f69d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:31:00.912100 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b6e0aa-8de7-4d5d-a8e1-998e491cec61 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:00.913850 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-f2b6e0aa-8de7-4d5d-a8e1-998e491cec61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:00.932108 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b6e0aa-8de7-4d5d-a8e1-998e491cec61 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:01.005485 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a32820a-ae6c-469c-b44a-7d8ff0ab47fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:01.006253 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a32820a-ae6c-469c-b44a-7d8ff0ab47fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:01.006533 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a32820a-ae6c-469c-b44a-7d8ff0ab47fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:01.006808 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a32820a-ae6c-469c-b44a-7d8ff0ab47fe admin admin] PATH_INFO: `/v3/projects/a6115291de054c89877e066789a52390` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:01.008065 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a32820a-ae6c-469c-b44a-7d8ff0ab47fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6115291de054c89877e066789a52390)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:01.009954 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a32820a-ae6c-469c-b44a-7d8ff0ab47fe admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:01.073660 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-6a32820a-ae6c-469c-b44a-7d8ff0ab47fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6115291de054c89877e066789a52390', 'request_id': 'req-6a32820a-ae6c-469c-b44a-7d8ff0ab47fe'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:01.084138 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-6a32820a-ae6c-469c-b44a-7d8ff0ab47fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6115291de054c89877e066789a52390', 'request_id': 'req-6a32820a-ae6c-469c-b44a-7d8ff0ab47fe'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:01.094295 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-6a32820a-ae6c-469c-b44a-7d8ff0ab47fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6115291de054c89877e066789a52390', 'request_id': 'req-6a32820a-ae6c-469c-b44a-7d8ff0ab47fe'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:01.107842 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-6a32820a-ae6c-469c-b44a-7d8ff0ab47fe admin admin] The token cache is being invalidate because project a6115291de054c89877e066789a52390 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80360) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:31:01.108244 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-6a32820a-ae6c-469c-b44a-7d8ff0ab47fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:01.109151 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-6a32820a-ae6c-469c-b44a-7d8ff0ab47fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:01.117831 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1047/2114] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:31:00 2022] DELETE /identity/v3/projects/a6115291de054c89877e066789a52390 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:31:01.119567 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce88232-0d42-408b-a999-dc9b06636e3e None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:01.119962 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce88232-0d42-408b-a999-dc9b06636e3e None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:01.120436 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce88232-0d42-408b-a999-dc9b06636e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:01.141285 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-4ce88232-0d42-408b-a999-dc9b06636e3e None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:31:01.142656 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-4ce88232-0d42-408b-a999-dc9b06636e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:01.241620 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1068/2115] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:31:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:31:01.250261 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d546e4-7eb4-4311-8e6b-e1427e3bfa21 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:01.250586 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d546e4-7eb4-4311-8e6b-e1427e3bfa21 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:01.250830 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d546e4-7eb4-4311-8e6b-e1427e3bfa21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:01.275182 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-82d546e4-7eb4-4311-8e6b-e1427e3bfa21 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:31:01.276990 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-82d546e4-7eb4-4311-8e6b-e1427e3bfa21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:01.289917 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1048/2116] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:31:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:31:01.290704 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce88232-0d42-408b-a999-dc9b06636e3e None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:01.304931 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce88232-0d42-408b-a999-dc9b06636e3e None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:01.310133 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16efc0f1-f802-4812-b469-1ce13c3bbe6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:01.310925 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16efc0f1-f802-4812-b469-1ce13c3bbe6a admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:01.311337 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16efc0f1-f802-4812-b469-1ce13c3bbe6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:01.311521 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16efc0f1-f802-4812-b469-1ce13c3bbe6a admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:01.316348 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16efc0f1-f802-4812-b469-1ce13c3bbe6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:31:01.316632 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16efc0f1-f802-4812-b469-1ce13c3bbe6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:01.318288 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16efc0f1-f802-4812-b469-1ce13c3bbe6a admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:01.326147 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:31:01.333839 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1069/2117] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 2 15:31:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:31:01.340112 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d546e4-7eb4-4311-8e6b-e1427e3bfa21 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:01.355069 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d546e4-7eb4-4311-8e6b-e1427e3bfa21 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:01.360052 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ebde5-7015-4296-9e6f-5d8a0f8ed7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:01.360680 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ebde5-7015-4296-9e6f-5d8a0f8ed7b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:01.360964 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ebde5-7015-4296-9e6f-5d8a0f8ed7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:01.361243 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ebde5-7015-4296-9e6f-5d8a0f8ed7b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:01.361916 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06ebde5-7015-4296-9e6f-5d8a0f8ed7b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:01.363939 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06ebde5-7015-4296-9e6f-5d8a0f8ed7b8 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:01.399286 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1049/2118] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:31:01 2022] POST /identity/v3/projects => generated 375 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:31:01.402221 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16efc0f1-f802-4812-b469-1ce13c3bbe6a admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:01.415142 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16efc0f1-f802-4812-b469-1ce13c3bbe6a admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:01.501052 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba9989-2ef5-4364-8171-61fc722bbdad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:01.501724 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba9989-2ef5-4364-8171-61fc722bbdad admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:01.502001 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba9989-2ef5-4364-8171-61fc722bbdad admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:01.502282 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba9989-2ef5-4364-8171-61fc722bbdad admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:01.502996 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caba9989-2ef5-4364-8171-61fc722bbdad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:01.505132 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caba9989-2ef5-4364-8171-61fc722bbdad admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:01.542701 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ebde5-7015-4296-9e6f-5d8a0f8ed7b8 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:01.542920 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1070/2119] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:31:01 2022] POST /identity/v3/users => generated 288 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:31:01.558418 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ebde5-7015-4296-9e6f-5d8a0f8ed7b8 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:01.568012 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0c4cd-9afa-48b6-907e-b930300df63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:01.568667 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0c4cd-9afa-48b6-907e-b930300df63a admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:01.568957 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0c4cd-9afa-48b6-907e-b930300df63a admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:01.569233 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0c4cd-9afa-48b6-907e-b930300df63a admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:01.570256 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e0c4cd-9afa-48b6-907e-b930300df63a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:01.571757 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e0c4cd-9afa-48b6-907e-b930300df63a admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:01.584837 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1050/2120] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:31:01.589318 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba9989-2ef5-4364-8171-61fc722bbdad admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:01.605487 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba9989-2ef5-4364-8171-61fc722bbdad admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:01.610734 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46379ecc-0b72-4330-8f21-7e1a4df53b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:01.611475 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46379ecc-0b72-4330-8f21-7e1a4df53b98 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:01.611825 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46379ecc-0b72-4330-8f21-7e1a4df53b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:01.612225 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46379ecc-0b72-4330-8f21-7e1a4df53b98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:01.613054 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46379ecc-0b72-4330-8f21-7e1a4df53b98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:01.615013 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46379ecc-0b72-4330-8f21-7e1a4df53b98 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:01.629323 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1071/2121] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 15:31:01.633966 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0c4cd-9afa-48b6-907e-b930300df63a admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:01.655993 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0c4cd-9afa-48b6-907e-b930300df63a admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:01.664960 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ed76b-f90b-48c9-8aeb-6c8b9a23bb26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:01.665953 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ed76b-f90b-48c9-8aeb-6c8b9a23bb26 admin admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:01.666412 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ed76b-f90b-48c9-8aeb-6c8b9a23bb26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:01.667412 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ed76b-f90b-48c9-8aeb-6c8b9a23bb26 admin admin] PATH_INFO: `/v3/projects/7627a044fd6d4821879d1ed30b1dc46f/users/9fe8adf42f9c4e3a839a8ad81321bf73/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:01.688710 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:31:01.693622 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6ed76b-f90b-48c9-8aeb-6c8b9a23bb26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7627a044fd6d4821879d1ed30b1dc46f, user_id=9fe8adf42f9c4e3a839a8ad81321bf73, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:01.697113 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6ed76b-f90b-48c9-8aeb-6c8b9a23bb26 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:01.715909 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1051/2122] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:31:01 2022] PUT /identity/v3/projects/7627a044fd6d4821879d1ed30b1dc46f/users/9fe8adf42f9c4e3a839a8ad81321bf73/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:31:01.726142 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466caba3-f2f6-430a-a82c-155b95a373a8 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:01.726439 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466caba3-f2f6-430a-a82c-155b95a373a8 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:01.726717 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466caba3-f2f6-430a-a82c-155b95a373a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:01.758318 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-466caba3-f2f6-430a-a82c-155b95a373a8 None None] MFA Rules not processed for user `9fe8adf42f9c4e3a839a8ad81321bf73`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:31:01.759594 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-466caba3-f2f6-430a-a82c-155b95a373a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:01.845166 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1072/2123] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:31:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:31:01.857631 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ed76b-f90b-48c9-8aeb-6c8b9a23bb26 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:01.859823 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-ce6ed76b-f90b-48c9-8aeb-6c8b9a23bb26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:01.938423 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ed76b-f90b-48c9-8aeb-6c8b9a23bb26 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:01.941091 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df87f3d-5ed0-4f25-b606-ae223ee82533 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946af31d75ca41a2a4301e0294cf98f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:01.942181 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df87f3d-5ed0-4f25-b606-ae223ee82533 service glance] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:01.942495 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df87f3d-5ed0-4f25-b606-ae223ee82533 service glance] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:01.942846 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df87f3d-5ed0-4f25-b606-ae223ee82533 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:01.953399 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df87f3d-5ed0-4f25-b606-ae223ee82533 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:01.954951 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df87f3d-5ed0-4f25-b606-ae223ee82533 service glance] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:01.974193 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1052/2124] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:31:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:31:04.335820 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466caba3-f2f6-430a-a82c-155b95a373a8 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:04.337554 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-466caba3-f2f6-430a-a82c-155b95a373a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:04.420413 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466caba3-f2f6-430a-a82c-155b95a373a8 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:04.425036 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd32fd1f-3eec-469c-9bfc-35d3ff92f7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:04.425766 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32fd1f-3eec-469c-9bfc-35d3ff92f7b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:04.426053 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32fd1f-3eec-469c-9bfc-35d3ff92f7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:04.426326 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32fd1f-3eec-469c-9bfc-35d3ff92f7b1 admin admin] PATH_INFO: `/v3/users/3031b6943c3b4d7dbdfbf81160fcc72e` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:04.427507 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd32fd1f-3eec-469c-9bfc-35d3ff92f7b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3031b6943c3b4d7dbdfbf81160fcc72e)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:04.429423 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd32fd1f-3eec-469c-9bfc-35d3ff92f7b1 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:04.435910 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:31:04.485589 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-fd32fd1f-3eec-469c-9bfc-35d3ff92f7b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3031b6943c3b4d7dbdfbf81160fcc72e'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:04.499474 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-fd32fd1f-3eec-469c-9bfc-35d3ff92f7b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3031b6943c3b4d7dbdfbf81160fcc72e'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:04.500196 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-fd32fd1f-3eec-469c-9bfc-35d3ff92f7b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3031b6943c3b4d7dbdfbf81160fcc72e'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:04.510125 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-fd32fd1f-3eec-469c-9bfc-35d3ff92f7b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3031b6943c3b4d7dbdfbf81160fcc72e'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:04.518297 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-fd32fd1f-3eec-469c-9bfc-35d3ff92f7b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3031b6943c3b4d7dbdfbf81160fcc72e'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:04.524719 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1073/2125] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:31:04 2022] DELETE /identity/v3/users/3031b6943c3b4d7dbdfbf81160fcc72e => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:31:04.529697 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da3684-36aa-4400-b79c-6fba7e39cd4d None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:04.530204 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da3684-36aa-4400-b79c-6fba7e39cd4d None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:04.530506 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da3684-36aa-4400-b79c-6fba7e39cd4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:04.550628 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-68da3684-36aa-4400-b79c-6fba7e39cd4d None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:31:04.551986 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-68da3684-36aa-4400-b79c-6fba7e39cd4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:04.624176 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1053/2126] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:31:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:31:04.636740 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd32fd1f-3eec-469c-9bfc-35d3ff92f7b1 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:04.638540 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-fd32fd1f-3eec-469c-9bfc-35d3ff92f7b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:04.712394 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd32fd1f-3eec-469c-9bfc-35d3ff92f7b1 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:04.719041 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710cba48-19a0-40eb-a4f5-4b4fcdd9ff51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:04.719779 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710cba48-19a0-40eb-a4f5-4b4fcdd9ff51 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:04.720131 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710cba48-19a0-40eb-a4f5-4b4fcdd9ff51 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:04.720491 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710cba48-19a0-40eb-a4f5-4b4fcdd9ff51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:04.733188 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710cba48-19a0-40eb-a4f5-4b4fcdd9ff51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:04.734713 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710cba48-19a0-40eb-a4f5-4b4fcdd9ff51 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:04.746309 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1074/2127] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:31:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:31:05.070152 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da3684-36aa-4400-b79c-6fba7e39cd4d None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:05.072310 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-68da3684-36aa-4400-b79c-6fba7e39cd4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:05.091955 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da3684-36aa-4400-b79c-6fba7e39cd4d None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:05.097930 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05501edf-929f-4922-9406-bffdafc17cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:05.099820 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05501edf-929f-4922-9406-bffdafc17cc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:05.102489 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05501edf-929f-4922-9406-bffdafc17cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:05.102489 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05501edf-929f-4922-9406-bffdafc17cc0 admin admin] PATH_INFO: `/v3/projects/395d496287ff4e45995088300f5e6110` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:05.103161 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05501edf-929f-4922-9406-bffdafc17cc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=395d496287ff4e45995088300f5e6110)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:05.105287 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05501edf-929f-4922-9406-bffdafc17cc0 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:05.193806 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-05501edf-929f-4922-9406-bffdafc17cc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '395d496287ff4e45995088300f5e6110', 'request_id': 'req-05501edf-929f-4922-9406-bffdafc17cc0'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:05.208383 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-05501edf-929f-4922-9406-bffdafc17cc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '395d496287ff4e45995088300f5e6110', 'request_id': 'req-05501edf-929f-4922-9406-bffdafc17cc0'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:05.218043 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-05501edf-929f-4922-9406-bffdafc17cc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '395d496287ff4e45995088300f5e6110', 'request_id': 'req-05501edf-929f-4922-9406-bffdafc17cc0'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:05.232036 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-05501edf-929f-4922-9406-bffdafc17cc0 admin admin] The token cache is being invalidate because project 395d496287ff4e45995088300f5e6110 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80360) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:31:05.232580 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-05501edf-929f-4922-9406-bffdafc17cc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:05.233538 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-05501edf-929f-4922-9406-bffdafc17cc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:05.235254 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1054/2128] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:31:05 2022] DELETE /identity/v3/projects/395d496287ff4e45995088300f5e6110 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:31:05.240205 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710cba48-19a0-40eb-a4f5-4b4fcdd9ff51 service neutron] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:05.267385 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710cba48-19a0-40eb-a4f5-4b4fcdd9ff51 service neutron] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:05.382116 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee8c21c-03cf-44e4-bf2c-7565a1d8a73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:05.383098 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8c21c-03cf-44e4-bf2c-7565a1d8a73e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:05.383510 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8c21c-03cf-44e4-bf2c-7565a1d8a73e admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:05.383892 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8c21c-03cf-44e4-bf2c-7565a1d8a73e admin admin] PATH_INFO: `/v3/users/f489a8e4c00e4c8a81528ebffa3c1dff` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:05.386120 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee8c21c-03cf-44e4-bf2c-7565a1d8a73e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f489a8e4c00e4c8a81528ebffa3c1dff)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:05.389958 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee8c21c-03cf-44e4-bf2c-7565a1d8a73e admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:05.447749 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:31:05.480726 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-aee8c21c-03cf-44e4-bf2c-7565a1d8a73e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f489a8e4c00e4c8a81528ebffa3c1dff'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:05.497160 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-aee8c21c-03cf-44e4-bf2c-7565a1d8a73e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f489a8e4c00e4c8a81528ebffa3c1dff'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:05.499273 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-aee8c21c-03cf-44e4-bf2c-7565a1d8a73e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f489a8e4c00e4c8a81528ebffa3c1dff'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:05.512281 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-aee8c21c-03cf-44e4-bf2c-7565a1d8a73e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f489a8e4c00e4c8a81528ebffa3c1dff'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:05.521836 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-aee8c21c-03cf-44e4-bf2c-7565a1d8a73e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f489a8e4c00e4c8a81528ebffa3c1dff'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:05.529770 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1075/2129] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:31:05 2022] DELETE /identity/v3/users/f489a8e4c00e4c8a81528ebffa3c1dff => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:31:05.881815 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05501edf-929f-4922-9406-bffdafc17cc0 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:05.883402 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-05501edf-929f-4922-9406-bffdafc17cc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:05.899045 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05501edf-929f-4922-9406-bffdafc17cc0 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:05.932035 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:31:06.012816 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd948068-b672-4b6a-ae8c-568b8f227c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:06.013570 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd948068-b672-4b6a-ae8c-568b8f227c45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:06.013945 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd948068-b672-4b6a-ae8c-568b8f227c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:06.014346 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd948068-b672-4b6a-ae8c-568b8f227c45 admin admin] PATH_INFO: `/v3/projects/ee340aeed9744346b06af550e6eed169` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:06.015764 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd948068-b672-4b6a-ae8c-568b8f227c45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee340aeed9744346b06af550e6eed169)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:06.017753 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd948068-b672-4b6a-ae8c-568b8f227c45 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:06.079263 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-fd948068-b672-4b6a-ae8c-568b8f227c45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee340aeed9744346b06af550e6eed169', 'request_id': 'req-fd948068-b672-4b6a-ae8c-568b8f227c45'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:06.087203 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-fd948068-b672-4b6a-ae8c-568b8f227c45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee340aeed9744346b06af550e6eed169', 'request_id': 'req-fd948068-b672-4b6a-ae8c-568b8f227c45'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:06.094283 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-fd948068-b672-4b6a-ae8c-568b8f227c45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee340aeed9744346b06af550e6eed169', 'request_id': 'req-fd948068-b672-4b6a-ae8c-568b8f227c45'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:06.104771 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-fd948068-b672-4b6a-ae8c-568b8f227c45 admin admin] The token cache is being invalidate because project ee340aeed9744346b06af550e6eed169 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80360) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:31:06.105071 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-fd948068-b672-4b6a-ae8c-568b8f227c45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:06.105712 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-fd948068-b672-4b6a-ae8c-568b8f227c45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:06.107274 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1055/2130] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:31:05 2022] DELETE /identity/v3/projects/ee340aeed9744346b06af550e6eed169 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:31:06.112027 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dbff6e-f36a-49dc-a3d9-93e9aa1d34b7 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:06.112315 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dbff6e-f36a-49dc-a3d9-93e9aa1d34b7 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:06.112586 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dbff6e-f36a-49dc-a3d9-93e9aa1d34b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:06.132252 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-55dbff6e-f36a-49dc-a3d9-93e9aa1d34b7 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:31:06.133465 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-55dbff6e-f36a-49dc-a3d9-93e9aa1d34b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:06.211187 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1076/2131] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:31:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:31:06.222711 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78218de5-1d7b-4a55-90c5-16ba381985ae None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:06.223206 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78218de5-1d7b-4a55-90c5-16ba381985ae None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:06.223651 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78218de5-1d7b-4a55-90c5-16ba381985ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:06.249194 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-78218de5-1d7b-4a55-90c5-16ba381985ae None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:31:06.250466 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-78218de5-1d7b-4a55-90c5-16ba381985ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:06.258752 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1056/2132] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:31:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:31:06.264245 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dbff6e-f36a-49dc-a3d9-93e9aa1d34b7 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:06.274103 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dbff6e-f36a-49dc-a3d9-93e9aa1d34b7 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:06.279645 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e04e0-3b66-4a46-a0fc-b934f304998e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:06.280192 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e04e0-3b66-4a46-a0fc-b934f304998e admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:06.280504 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e04e0-3b66-4a46-a0fc-b934f304998e admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:06.280892 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e04e0-3b66-4a46-a0fc-b934f304998e admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:06.281593 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12e04e0-3b66-4a46-a0fc-b934f304998e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:31:06.281893 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12e04e0-3b66-4a46-a0fc-b934f304998e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:06.283581 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12e04e0-3b66-4a46-a0fc-b934f304998e admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:06.296432 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1077/2133] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 2 15:31:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:31:06.301017 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78218de5-1d7b-4a55-90c5-16ba381985ae None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:06.313171 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78218de5-1d7b-4a55-90c5-16ba381985ae None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:06.319224 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c87284-adec-45af-80b9-38cb34fa99c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:06.319869 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c87284-adec-45af-80b9-38cb34fa99c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:06.320152 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c87284-adec-45af-80b9-38cb34fa99c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:06.320471 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c87284-adec-45af-80b9-38cb34fa99c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:06.321152 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c87284-adec-45af-80b9-38cb34fa99c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:06.323608 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c87284-adec-45af-80b9-38cb34fa99c6 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:06.351102 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1057/2134] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:31:06 2022] POST /identity/v3/projects => generated 387 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:31:06.355386 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e04e0-3b66-4a46-a0fc-b934f304998e admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:06.365454 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e04e0-3b66-4a46-a0fc-b934f304998e admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:06.426998 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421073b2-6367-4543-8c88-6239167597a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:06.427723 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421073b2-6367-4543-8c88-6239167597a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:06.427932 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421073b2-6367-4543-8c88-6239167597a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:06.428204 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421073b2-6367-4543-8c88-6239167597a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:06.428926 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421073b2-6367-4543-8c88-6239167597a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:06.430870 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421073b2-6367-4543-8c88-6239167597a8 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:06.452918 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1078/2135] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:31:06 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 15:31:06.457079 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c87284-adec-45af-80b9-38cb34fa99c6 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:06.467477 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c87284-adec-45af-80b9-38cb34fa99c6 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:06.472201 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753513d-f21f-403b-90d7-7b9fc8911a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:06.472816 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753513d-f21f-403b-90d7-7b9fc8911a9c admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:06.473102 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753513d-f21f-403b-90d7-7b9fc8911a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:06.473398 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753513d-f21f-403b-90d7-7b9fc8911a9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:06.474088 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a753513d-f21f-403b-90d7-7b9fc8911a9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:06.476568 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a753513d-f21f-403b-90d7-7b9fc8911a9c admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:06.487639 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1058/2136] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:31:06.491474 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421073b2-6367-4543-8c88-6239167597a8 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:06.501857 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421073b2-6367-4543-8c88-6239167597a8 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:06.506385 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760ca26-df38-4bfb-aa24-01cf0fd5ec96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:06.506985 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760ca26-df38-4bfb-aa24-01cf0fd5ec96 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:06.507301 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760ca26-df38-4bfb-aa24-01cf0fd5ec96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:06.507581 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760ca26-df38-4bfb-aa24-01cf0fd5ec96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:06.508271 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f760ca26-df38-4bfb-aa24-01cf0fd5ec96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:06.509866 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f760ca26-df38-4bfb-aa24-01cf0fd5ec96 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:06.521777 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1079/2137] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:31:06.525903 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753513d-f21f-403b-90d7-7b9fc8911a9c admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:06.535987 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753513d-f21f-403b-90d7-7b9fc8911a9c admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:06.540596 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97235e59-d477-49f0-8973-e702aea8caed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:06.541285 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97235e59-d477-49f0-8973-e702aea8caed admin admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:06.541570 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97235e59-d477-49f0-8973-e702aea8caed admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:06.541887 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97235e59-d477-49f0-8973-e702aea8caed admin admin] PATH_INFO: `/v3/projects/18372a5a6011402eb9cc8d754ed748c1/users/f0e53eee92e84dbe8b042a0d331efb9d/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:06.558616 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97235e59-d477-49f0-8973-e702aea8caed admin admin] RBAC: Authorizing `identity:create_grant(project_id=18372a5a6011402eb9cc8d754ed748c1, user_id=f0e53eee92e84dbe8b042a0d331efb9d, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:06.561404 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97235e59-d477-49f0-8973-e702aea8caed admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:06.574643 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1059/2138] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:31:06 2022] PUT /identity/v3/projects/18372a5a6011402eb9cc8d754ed748c1/users/f0e53eee92e84dbe8b042a0d331efb9d/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:31:06.584879 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f5a400-32d8-4a49-828c-94a741cf53fa None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:06.585170 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f5a400-32d8-4a49-828c-94a741cf53fa None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:06.585451 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f5a400-32d8-4a49-828c-94a741cf53fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:06.610886 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:31:06.614522 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-e9f5a400-32d8-4a49-828c-94a741cf53fa None None] MFA Rules not processed for user `f0e53eee92e84dbe8b042a0d331efb9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:31:06.616376 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-e9f5a400-32d8-4a49-828c-94a741cf53fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:06.689381 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1080/2139] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:31:06 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:31:06.694563 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97235e59-d477-49f0-8973-e702aea8caed admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:06.748040 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:31:06.767822 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97235e59-d477-49f0-8973-e702aea8caed admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:06.773140 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0a8fc4-4c67-4c69-87af-64eabd4ca771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:06.773775 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a8fc4-4c67-4c69-87af-64eabd4ca771 admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:06.774060 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a8fc4-4c67-4c69-87af-64eabd4ca771 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:06.774342 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a8fc4-4c67-4c69-87af-64eabd4ca771 admin admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:06.775039 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0a8fc4-4c67-4c69-87af-64eabd4ca771 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:06.779328 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0a8fc4-4c67-4c69-87af-64eabd4ca771 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:06.823803 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1060/2140] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:31:06 2022] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:31:06.829209 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f5a400-32d8-4a49-828c-94a741cf53fa None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:06.841300 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f5a400-32d8-4a49-828c-94a741cf53fa None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:06.919038 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d5efe-b0ec-40e9-9e91-0223a5153d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:06.919705 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d5efe-b0ec-40e9-9e91-0223a5153d01 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:06.920346 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d5efe-b0ec-40e9-9e91-0223a5153d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:06.920536 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d5efe-b0ec-40e9-9e91-0223a5153d01 admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:06.921250 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9d5efe-b0ec-40e9-9e91-0223a5153d01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:06.923672 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9d5efe-b0ec-40e9-9e91-0223a5153d01 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:06.953575 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1081/2141] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:31:06 2022] POST /identity/v3/users => generated 299 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 15:31:06.957120 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0a8fc4-4c67-4c69-87af-64eabd4ca771 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:06.969972 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0a8fc4-4c67-4c69-87af-64eabd4ca771 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:06.975104 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced1b37d-e537-4598-8334-ad829577508d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:06.975833 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1b37d-e537-4598-8334-ad829577508d admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:06.976193 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1b37d-e537-4598-8334-ad829577508d admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:06.976547 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1b37d-e537-4598-8334-ad829577508d admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:06.977324 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced1b37d-e537-4598-8334-ad829577508d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:06.979016 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced1b37d-e537-4598-8334-ad829577508d admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:06.993347 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1061/2142] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:31:06.998311 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d5efe-b0ec-40e9-9e91-0223a5153d01 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:07.009035 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d5efe-b0ec-40e9-9e91-0223a5153d01 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:07.015014 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b38495-d2f5-4579-866b-a50855c3791b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:07.015726 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b38495-d2f5-4579-866b-a50855c3791b admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:07.016018 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b38495-d2f5-4579-866b-a50855c3791b admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:07.016297 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b38495-d2f5-4579-866b-a50855c3791b admin admin] PATH_INFO: `/v3/projects/85d8739000824f538c8c02bf18803d4d/users/e0dfff8dae5b430fad486d08c905903c/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:07.033251 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b38495-d2f5-4579-866b-a50855c3791b admin admin] RBAC: Authorizing `identity:create_grant(project_id=85d8739000824f538c8c02bf18803d4d, user_id=e0dfff8dae5b430fad486d08c905903c, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:07.035964 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b38495-d2f5-4579-866b-a50855c3791b admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:07.055157 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1082/2143] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:31:06 2022] PUT /identity/v3/projects/85d8739000824f538c8c02bf18803d4d/users/e0dfff8dae5b430fad486d08c905903c/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:31:07.061015 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced1b37d-e537-4598-8334-ad829577508d admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:07.074194 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced1b37d-e537-4598-8334-ad829577508d admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:07.142720 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eea5489-e82f-4b39-86bd-0b59d56ef145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:07.149463 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea5489-e82f-4b39-86bd-0b59d56ef145 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:07.149463 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea5489-e82f-4b39-86bd-0b59d56ef145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:07.149463 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea5489-e82f-4b39-86bd-0b59d56ef145 admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:07.149463 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eea5489-e82f-4b39-86bd-0b59d56ef145 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:07.149463 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eea5489-e82f-4b39-86bd-0b59d56ef145 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:07.161781 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1062/2144] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:31:07.163941 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b38495-d2f5-4579-866b-a50855c3791b admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:07.180934 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b38495-d2f5-4579-866b-a50855c3791b admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:07.188057 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15415b0e-7614-4878-a05a-55e6724a790b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:07.188741 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15415b0e-7614-4878-a05a-55e6724a790b admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:07.189017 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15415b0e-7614-4878-a05a-55e6724a790b admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:07.189345 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15415b0e-7614-4878-a05a-55e6724a790b admin admin] PATH_INFO: `/v3/projects/85d8739000824f538c8c02bf18803d4d/users/e0dfff8dae5b430fad486d08c905903c/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:07.191730 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15415b0e-7614-4878-a05a-55e6724a790b admin admin] RBAC: Authorizing `identity:create_grant(project_id=85d8739000824f538c8c02bf18803d4d, user_id=e0dfff8dae5b430fad486d08c905903c, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:07.195000 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15415b0e-7614-4878-a05a-55e6724a790b admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:07.211516 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1083/2145] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:31:07 2022] PUT /identity/v3/projects/85d8739000824f538c8c02bf18803d4d/users/e0dfff8dae5b430fad486d08c905903c/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:31:07.217971 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ea3c0-46b3-4c46-90f7-a0b06c61def1 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:07.218256 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ea3c0-46b3-4c46-90f7-a0b06c61def1 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:07.218585 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ea3c0-46b3-4c46-90f7-a0b06c61def1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:07.253876 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-6c1ea3c0-46b3-4c46-90f7-a0b06c61def1 None None] MFA Rules not processed for user `e0dfff8dae5b430fad486d08c905903c`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:31:07.255131 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-6c1ea3c0-46b3-4c46-90f7-a0b06c61def1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:07.330439 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1063/2146] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:31:07 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:31:07.342158 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15415b0e-7614-4878-a05a-55e6724a790b admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:07.344244 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-15415b0e-7614-4878-a05a-55e6724a790b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:07.405058 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15415b0e-7614-4878-a05a-55e6724a790b admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:07.408704 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c916df6-5d43-426a-b493-c51189b35d22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:07.409385 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c916df6-5d43-426a-b493-c51189b35d22 service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:07.409666 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c916df6-5d43-426a-b493-c51189b35d22 service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:07.409942 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c916df6-5d43-426a-b493-c51189b35d22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:07.420630 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c916df6-5d43-426a-b493-c51189b35d22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:07.422133 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c916df6-5d43-426a-b493-c51189b35d22 service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:07.426039 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:31:07.433096 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1084/2147] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:31:07 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 15:31:08.131251 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1ea3c0-46b3-4c46-90f7-a0b06c61def1 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:08.189383 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:31:08.213331 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1ea3c0-46b3-4c46-90f7-a0b06c61def1 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:08.218287 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c1a50b-74cf-4d11-b859-26d46d300c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:08.218966 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1a50b-74cf-4d11-b859-26d46d300c93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:08.219370 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1a50b-74cf-4d11-b859-26d46d300c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:08.219706 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1a50b-74cf-4d11-b859-26d46d300c93 admin admin] PATH_INFO: `/v3/users/f0e53eee92e84dbe8b042a0d331efb9d` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:08.220917 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c1a50b-74cf-4d11-b859-26d46d300c93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0e53eee92e84dbe8b042a0d331efb9d)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:08.222878 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c1a50b-74cf-4d11-b859-26d46d300c93 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:08.282281 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-91c1a50b-74cf-4d11-b859-26d46d300c93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0e53eee92e84dbe8b042a0d331efb9d'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:08.289962 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-91c1a50b-74cf-4d11-b859-26d46d300c93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0e53eee92e84dbe8b042a0d331efb9d'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:08.298489 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c916df6-5d43-426a-b493-c51189b35d22 service cinder] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:08.300236 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-7c916df6-5d43-426a-b493-c51189b35d22 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:08.306071 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-91c1a50b-74cf-4d11-b859-26d46d300c93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0e53eee92e84dbe8b042a0d331efb9d'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:08.306783 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-91c1a50b-74cf-4d11-b859-26d46d300c93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0e53eee92e84dbe8b042a0d331efb9d'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:08.307991 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-91c1a50b-74cf-4d11-b859-26d46d300c93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0e53eee92e84dbe8b042a0d331efb9d'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:08.320035 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c916df6-5d43-426a-b493-c51189b35d22 service cinder] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:08.325755 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1064/2148] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:31:08 2022] DELETE /identity/v3/users/f0e53eee92e84dbe8b042a0d331efb9d => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:31:08.326404 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58d338c-5725-4133-9519-a167ce679a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:08.327129 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d338c-5725-4133-9519-a167ce679a9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:08.327469 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d338c-5725-4133-9519-a167ce679a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:08.327745 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d338c-5725-4133-9519-a167ce679a9a admin admin] PATH_INFO: `/v3/users/2f668c43532d4022a9ee908f254ee465` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:08.328940 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58d338c-5725-4133-9519-a167ce679a9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f668c43532d4022a9ee908f254ee465)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:08.331325 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58d338c-5725-4133-9519-a167ce679a9a admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:08.333739 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b603d4d-7e60-47a6-90bd-2159c1b258ee None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:08.335247 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b603d4d-7e60-47a6-90bd-2159c1b258ee None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:08.336379 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b603d4d-7e60-47a6-90bd-2159c1b258ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:08.365403 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-3b603d4d-7e60-47a6-90bd-2159c1b258ee None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:31:08.367115 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-3b603d4d-7e60-47a6-90bd-2159c1b258ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:08.397275 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-f58d338c-5725-4133-9519-a167ce679a9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f668c43532d4022a9ee908f254ee465'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:08.422035 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-f58d338c-5725-4133-9519-a167ce679a9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f668c43532d4022a9ee908f254ee465'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:08.422788 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-f58d338c-5725-4133-9519-a167ce679a9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f668c43532d4022a9ee908f254ee465'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:08.430156 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-f58d338c-5725-4133-9519-a167ce679a9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f668c43532d4022a9ee908f254ee465'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:08.444665 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-f58d338c-5725-4133-9519-a167ce679a9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f668c43532d4022a9ee908f254ee465'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:08.453867 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1085/2149] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:31:08 2022] DELETE /identity/v3/users/2f668c43532d4022a9ee908f254ee465 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 15:31:08.458461 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded1747-fc58-4fc6-8354-92668a76efcb None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:08.458997 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded1747-fc58-4fc6-8354-92668a76efcb None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:08.459316 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded1747-fc58-4fc6-8354-92668a76efcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:08.469900 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1065/2150] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:31:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:31:08.484034 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-3ded1747-fc58-4fc6-8354-92668a76efcb None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:31:08.485309 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-3ded1747-fc58-4fc6-8354-92668a76efcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:08.496919 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b603d4d-7e60-47a6-90bd-2159c1b258ee None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:08.498281 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-3b603d4d-7e60-47a6-90bd-2159c1b258ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:08.584894 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1086/2151] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:31:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:31:08.599066 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded1747-fc58-4fc6-8354-92668a76efcb None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:08.608151 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b603d4d-7e60-47a6-90bd-2159c1b258ee None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:08.620834 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:31:08.670901 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded1747-fc58-4fc6-8354-92668a76efcb None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:08.675138 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c4b10-4952-4b85-97a6-99aef2256fa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:08.675799 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c4b10-4952-4b85-97a6-99aef2256fa7 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:08.676013 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765fdcbd-940c-41f5-b290-a3a2aad74b64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:08.676159 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c4b10-4952-4b85-97a6-99aef2256fa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:08.676351 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c4b10-4952-4b85-97a6-99aef2256fa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:08.676798 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765fdcbd-940c-41f5-b290-a3a2aad74b64 service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:08.677094 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765fdcbd-940c-41f5-b290-a3a2aad74b64 service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:08.677480 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765fdcbd-940c-41f5-b290-a3a2aad74b64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:08.685997 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772c4b10-4952-4b85-97a6-99aef2256fa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:08.687488 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772c4b10-4952-4b85-97a6-99aef2256fa7 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:08.691643 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765fdcbd-940c-41f5-b290-a3a2aad74b64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:08.693809 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765fdcbd-940c-41f5-b290-a3a2aad74b64 service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:08.701070 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1087/2152] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:31:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 15:31:08.704891 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1066/2153] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:31:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:31:09.305238 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c4b10-4952-4b85-97a6-99aef2256fa7 service neutron] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:09.307982 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-772c4b10-4952-4b85-97a6-99aef2256fa7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:09.325168 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765fdcbd-940c-41f5-b290-a3a2aad74b64 service neutron] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:09.326882 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-765fdcbd-940c-41f5-b290-a3a2aad74b64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:09.336837 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c4b10-4952-4b85-97a6-99aef2256fa7 service neutron] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:09.342114 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765fdcbd-940c-41f5-b290-a3a2aad74b64 service neutron] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:09.344059 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e631067-c62a-4f1e-ac0f-bd1708e1c76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:09.345192 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e631067-c62a-4f1e-ac0f-bd1708e1c76b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:09.345483 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e631067-c62a-4f1e-ac0f-bd1708e1c76b admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:09.345763 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e631067-c62a-4f1e-ac0f-bd1708e1c76b admin admin] PATH_INFO: `/v3/projects/18372a5a6011402eb9cc8d754ed748c1` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:09.346837 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a6214-c0cc-4e8f-8f9a-21ddb93b6a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:09.346985 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e631067-c62a-4f1e-ac0f-bd1708e1c76b admin admin] RBAC: Authorizing `identity:delete_project(project_id=18372a5a6011402eb9cc8d754ed748c1)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:09.347522 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a6214-c0cc-4e8f-8f9a-21ddb93b6a13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:09.347806 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a6214-c0cc-4e8f-8f9a-21ddb93b6a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:09.348326 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a6214-c0cc-4e8f-8f9a-21ddb93b6a13 admin admin] PATH_INFO: `/v3/projects/0b1f6b5d2a3b4332af3da51d802b6af3` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:09.348970 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e631067-c62a-4f1e-ac0f-bd1708e1c76b admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:09.349962 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3a6214-c0cc-4e8f-8f9a-21ddb93b6a13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b1f6b5d2a3b4332af3da51d802b6af3)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:09.352743 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3a6214-c0cc-4e8f-8f9a-21ddb93b6a13 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:09.360271 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:31:09.407665 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-6f3a6214-c0cc-4e8f-8f9a-21ddb93b6a13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b1f6b5d2a3b4332af3da51d802b6af3', 'request_id': 'req-6f3a6214-c0cc-4e8f-8f9a-21ddb93b6a13'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:09.408500 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-5e631067-c62a-4f1e-ac0f-bd1708e1c76b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18372a5a6011402eb9cc8d754ed748c1', 'request_id': 'req-5e631067-c62a-4f1e-ac0f-bd1708e1c76b'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:09.419303 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-6f3a6214-c0cc-4e8f-8f9a-21ddb93b6a13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b1f6b5d2a3b4332af3da51d802b6af3', 'request_id': 'req-6f3a6214-c0cc-4e8f-8f9a-21ddb93b6a13'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:09.419553 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-5e631067-c62a-4f1e-ac0f-bd1708e1c76b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18372a5a6011402eb9cc8d754ed748c1', 'request_id': 'req-5e631067-c62a-4f1e-ac0f-bd1708e1c76b'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:09.426351 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-6f3a6214-c0cc-4e8f-8f9a-21ddb93b6a13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b1f6b5d2a3b4332af3da51d802b6af3', 'request_id': 'req-6f3a6214-c0cc-4e8f-8f9a-21ddb93b6a13'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:09.427717 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-5e631067-c62a-4f1e-ac0f-bd1708e1c76b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18372a5a6011402eb9cc8d754ed748c1', 'request_id': 'req-5e631067-c62a-4f1e-ac0f-bd1708e1c76b'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:09.438496 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-6f3a6214-c0cc-4e8f-8f9a-21ddb93b6a13 admin admin] The token cache is being invalidate because project 0b1f6b5d2a3b4332af3da51d802b6af3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80360) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:31:09.438814 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-6f3a6214-c0cc-4e8f-8f9a-21ddb93b6a13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:09.439507 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-5e631067-c62a-4f1e-ac0f-bd1708e1c76b admin admin] The token cache is being invalidate because project 18372a5a6011402eb9cc8d754ed748c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:31:09.439640 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-6f3a6214-c0cc-4e8f-8f9a-21ddb93b6a13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:09.439795 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-5e631067-c62a-4f1e-ac0f-bd1708e1c76b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:09.440423 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-5e631067-c62a-4f1e-ac0f-bd1708e1c76b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:09.441314 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1067/2154] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:31:09 2022] DELETE /identity/v3/projects/0b1f6b5d2a3b4332af3da51d802b6af3 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 15:31:09.442132 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1088/2155] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:31:09 2022] DELETE /identity/v3/projects/18372a5a6011402eb9cc8d754ed748c1 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:31:09.445195 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a6214-c0cc-4e8f-8f9a-21ddb93b6a13 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:09.445793 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e631067-c62a-4f1e-ac0f-bd1708e1c76b admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:09.447026 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-6f3a6214-c0cc-4e8f-8f9a-21ddb93b6a13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:09.447153 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-5e631067-c62a-4f1e-ac0f-bd1708e1c76b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:09.518030 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e631067-c62a-4f1e-ac0f-bd1708e1c76b admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:09.527565 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8539009-b562-4e16-8076-1b25161c318b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:09.527894 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8539009-b562-4e16-8076-1b25161c318b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:09.528180 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8539009-b562-4e16-8076-1b25161c318b admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:09.528453 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8539009-b562-4e16-8076-1b25161c318b admin admin] PATH_INFO: `/v3/users/e0dfff8dae5b430fad486d08c905903c` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:09.529654 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a6214-c0cc-4e8f-8f9a-21ddb93b6a13 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:09.532033 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8539009-b562-4e16-8076-1b25161c318b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0dfff8dae5b430fad486d08c905903c)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:09.535746 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8539009-b562-4e16-8076-1b25161c318b admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:09.547754 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e8421-4bc9-4a42-b324-bec0b45422d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:09.548502 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e8421-4bc9-4a42-b324-bec0b45422d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:09.548781 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e8421-4bc9-4a42-b324-bec0b45422d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:09.549056 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e8421-4bc9-4a42-b324-bec0b45422d5 admin admin] PATH_INFO: `/v3/users/633d36e417174bf6afed4b61d02076e5` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:09.550348 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915e8421-4bc9-4a42-b324-bec0b45422d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=633d36e417174bf6afed4b61d02076e5)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:09.552712 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915e8421-4bc9-4a42-b324-bec0b45422d5 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:09.601986 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-b8539009-b562-4e16-8076-1b25161c318b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0dfff8dae5b430fad486d08c905903c'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:09.629132 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-b8539009-b562-4e16-8076-1b25161c318b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0dfff8dae5b430fad486d08c905903c'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:09.630913 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-b8539009-b562-4e16-8076-1b25161c318b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0dfff8dae5b430fad486d08c905903c'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:09.632724 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:31:09.638629 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-915e8421-4bc9-4a42-b324-bec0b45422d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '633d36e417174bf6afed4b61d02076e5'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:09.645077 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-b8539009-b562-4e16-8076-1b25161c318b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0dfff8dae5b430fad486d08c905903c'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:09.657788 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-915e8421-4bc9-4a42-b324-bec0b45422d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '633d36e417174bf6afed4b61d02076e5'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:09.670619 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-b8539009-b562-4e16-8076-1b25161c318b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0dfff8dae5b430fad486d08c905903c'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:09.680735 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1089/2156] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:31:09 2022] DELETE /identity/v3/users/e0dfff8dae5b430fad486d08c905903c => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 15:31:09.684599 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8539009-b562-4e16-8076-1b25161c318b admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:09.685659 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-915e8421-4bc9-4a42-b324-bec0b45422d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '633d36e417174bf6afed4b61d02076e5'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:09.686501 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-915e8421-4bc9-4a42-b324-bec0b45422d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '633d36e417174bf6afed4b61d02076e5'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:09.687494 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-b8539009-b562-4e16-8076-1b25161c318b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:09.688933 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-915e8421-4bc9-4a42-b324-bec0b45422d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '633d36e417174bf6afed4b61d02076e5'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:09.714740 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1068/2157] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:31:09 2022] DELETE /identity/v3/users/633d36e417174bf6afed4b61d02076e5 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:31:09.726780 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:31:09.817447 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8539009-b562-4e16-8076-1b25161c318b admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:09.915743 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d5082a-f5a1-4b6b-8ca8-adb2eb4cff7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:09.916399 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d5082a-f5a1-4b6b-8ca8-adb2eb4cff7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:09.916718 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d5082a-f5a1-4b6b-8ca8-adb2eb4cff7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:09.916995 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d5082a-f5a1-4b6b-8ca8-adb2eb4cff7b admin admin] PATH_INFO: `/v3/users/67f6eea3c2044c24843daf73e46f7fef` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:09.920232 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d5082a-f5a1-4b6b-8ca8-adb2eb4cff7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=67f6eea3c2044c24843daf73e46f7fef)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:09.922177 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d5082a-f5a1-4b6b-8ca8-adb2eb4cff7b admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:09.993194 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-32d5082a-f5a1-4b6b-8ca8-adb2eb4cff7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67f6eea3c2044c24843daf73e46f7fef'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:10.021414 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-32d5082a-f5a1-4b6b-8ca8-adb2eb4cff7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67f6eea3c2044c24843daf73e46f7fef'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:10.022298 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-32d5082a-f5a1-4b6b-8ca8-adb2eb4cff7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67f6eea3c2044c24843daf73e46f7fef'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:10.030807 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-32d5082a-f5a1-4b6b-8ca8-adb2eb4cff7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67f6eea3c2044c24843daf73e46f7fef'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:10.043390 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-32d5082a-f5a1-4b6b-8ca8-adb2eb4cff7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67f6eea3c2044c24843daf73e46f7fef'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:10.054649 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1090/2158] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:31:09 2022] DELETE /identity/v3/users/67f6eea3c2044c24843daf73e46f7fef => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:31:10.063022 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9186034-5766-463a-abc0-804e026b3973 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:10.063340 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9186034-5766-463a-abc0-804e026b3973 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:10.063763 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9186034-5766-463a-abc0-804e026b3973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:10.064955 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d5082a-f5a1-4b6b-8ca8-adb2eb4cff7b admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:10.066822 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-32d5082a-f5a1-4b6b-8ca8-adb2eb4cff7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:10.091969 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-a9186034-5766-463a-abc0-804e026b3973 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:31:10.093352 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-a9186034-5766-463a-abc0-804e026b3973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:10.125668 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:31:10.148127 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d5082a-f5a1-4b6b-8ca8-adb2eb4cff7b admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:10.153740 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0eaeea-1fd7-40ee-ae80-eda979314647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:10.154378 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0eaeea-1fd7-40ee-ae80-eda979314647 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:10.154662 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0eaeea-1fd7-40ee-ae80-eda979314647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:10.154937 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0eaeea-1fd7-40ee-ae80-eda979314647 admin admin] PATH_INFO: `/v3/projects/8f5740a8fa864a048bde641354803493` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:10.156123 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0eaeea-1fd7-40ee-ae80-eda979314647 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f5740a8fa864a048bde641354803493)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:10.158100 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0eaeea-1fd7-40ee-ae80-eda979314647 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:10.174178 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1069/2159] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:31:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:31:10.176272 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9186034-5766-463a-abc0-804e026b3973 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:10.179852 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-a9186034-5766-463a-abc0-804e026b3973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:10.193344 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9186034-5766-463a-abc0-804e026b3973 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:10.198106 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e7aea8-0a21-46b3-92c3-ad41c8a744e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:10.198877 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7aea8-0a21-46b3-92c3-ad41c8a744e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:10.199166 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7aea8-0a21-46b3-92c3-ad41c8a744e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:10.199486 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7aea8-0a21-46b3-92c3-ad41c8a744e5 admin admin] PATH_INFO: `/v3/projects/85d8739000824f538c8c02bf18803d4d` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:10.200689 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e7aea8-0a21-46b3-92c3-ad41c8a744e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85d8739000824f538c8c02bf18803d4d)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:10.202603 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e7aea8-0a21-46b3-92c3-ad41c8a744e5 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:10.218577 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-2c0eaeea-1fd7-40ee-ae80-eda979314647 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f5740a8fa864a048bde641354803493', 'request_id': 'req-2c0eaeea-1fd7-40ee-ae80-eda979314647'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:10.230914 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-2c0eaeea-1fd7-40ee-ae80-eda979314647 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f5740a8fa864a048bde641354803493', 'request_id': 'req-2c0eaeea-1fd7-40ee-ae80-eda979314647'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:10.242132 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-2c0eaeea-1fd7-40ee-ae80-eda979314647 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f5740a8fa864a048bde641354803493', 'request_id': 'req-2c0eaeea-1fd7-40ee-ae80-eda979314647'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:10.263884 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-2c0eaeea-1fd7-40ee-ae80-eda979314647 admin admin] The token cache is being invalidate because project 8f5740a8fa864a048bde641354803493 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:31:10.264193 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-2c0eaeea-1fd7-40ee-ae80-eda979314647 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:10.264912 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-2c0eaeea-1fd7-40ee-ae80-eda979314647 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:10.266858 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1091/2160] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:31:10 2022] DELETE /identity/v3/projects/8f5740a8fa864a048bde641354803493 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:31:10.268787 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0eaeea-1fd7-40ee-ae80-eda979314647 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:10.272254 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-2c0eaeea-1fd7-40ee-ae80-eda979314647 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:10.278460 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-e2e7aea8-0a21-46b3-92c3-ad41c8a744e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85d8739000824f538c8c02bf18803d4d', 'request_id': 'req-e2e7aea8-0a21-46b3-92c3-ad41c8a744e5'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:10.292741 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-e2e7aea8-0a21-46b3-92c3-ad41c8a744e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85d8739000824f538c8c02bf18803d4d', 'request_id': 'req-e2e7aea8-0a21-46b3-92c3-ad41c8a744e5'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:10.302839 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-e2e7aea8-0a21-46b3-92c3-ad41c8a744e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85d8739000824f538c8c02bf18803d4d', 'request_id': 'req-e2e7aea8-0a21-46b3-92c3-ad41c8a744e5'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:10.315674 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-e2e7aea8-0a21-46b3-92c3-ad41c8a744e5 admin admin] The token cache is being invalidate because project 85d8739000824f538c8c02bf18803d4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80360) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:31:10.315964 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-e2e7aea8-0a21-46b3-92c3-ad41c8a744e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:10.316808 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-e2e7aea8-0a21-46b3-92c3-ad41c8a744e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:10.319489 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1070/2161] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:31:10 2022] DELETE /identity/v3/projects/85d8739000824f538c8c02bf18803d4d => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:31:10.320081 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d2732-dcfe-4882-ac52-b44b02681da0 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:10.320201 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d2732-dcfe-4882-ac52-b44b02681da0 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:10.320562 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d2732-dcfe-4882-ac52-b44b02681da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:10.344127 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-2b1d2732-dcfe-4882-ac52-b44b02681da0 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:31:10.344793 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0eaeea-1fd7-40ee-ae80-eda979314647 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:10.345337 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-2b1d2732-dcfe-4882-ac52-b44b02681da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:10.399235 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:31:10.430877 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1071/2162] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:31:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:31:10.430877 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f3291-cd3a-47a1-a0f9-0d6c4ba8790d None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:10.430877 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f3291-cd3a-47a1-a0f9-0d6c4ba8790d None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:10.430877 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f3291-cd3a-47a1-a0f9-0d6c4ba8790d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:10.441081 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21d3b9f-2a93-4f98-b27c-27080c6f4cbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:10.441874 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d3b9f-2a93-4f98-b27c-27080c6f4cbe service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:10.442400 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d3b9f-2a93-4f98-b27c-27080c6f4cbe service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:10.442790 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d3b9f-2a93-4f98-b27c-27080c6f4cbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:10.449051 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-e21d3b9f-2a93-4f98-b27c-27080c6f4cbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:10.463747 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-5b4f3291-cd3a-47a1-a0f9-0d6c4ba8790d None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:31:10.464442 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21d3b9f-2a93-4f98-b27c-27080c6f4cbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:10.465030 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-5b4f3291-cd3a-47a1-a0f9-0d6c4ba8790d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:10.466134 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21d3b9f-2a93-4f98-b27c-27080c6f4cbe service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:10.473217 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1072/2163] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:31:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:31:10.481636 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1a190-6c48-4718-ae92-80836e61eeed None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:10.481636 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1a190-6c48-4718-ae92-80836e61eeed None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:10.481636 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1a190-6c48-4718-ae92-80836e61eeed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:10.481902 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1092/2164] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:31:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:31:10.486695 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea5774-d662-4c78-95da-4f52eb3dd0d1 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:10.490287 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea5774-d662-4c78-95da-4f52eb3dd0d1 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:10.490756 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea5774-d662-4c78-95da-4f52eb3dd0d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:10.498817 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-1fb1a190-6c48-4718-ae92-80836e61eeed None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:31:10.500559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-1fb1a190-6c48-4718-ae92-80836e61eeed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:10.509056 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1073/2165] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:31:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:31:10.513634 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb1a190-6c48-4718-ae92-80836e61eeed None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:10.522266 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-cfea5774-d662-4c78-95da-4f52eb3dd0d1 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:31:10.523710 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-cfea5774-d662-4c78-95da-4f52eb3dd0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:10.526609 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb1a190-6c48-4718-ae92-80836e61eeed None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:10.531524 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6172ff19-c86e-4d91-946c-edafd60ba0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:10.532243 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172ff19-c86e-4d91-946c-edafd60ba0b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:10.532532 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172ff19-c86e-4d91-946c-edafd60ba0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:10.532808 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172ff19-c86e-4d91-946c-edafd60ba0b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:10.533579 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6172ff19-c86e-4d91-946c-edafd60ba0b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:31:10.533880 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6172ff19-c86e-4d91-946c-edafd60ba0b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:10.535996 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6172ff19-c86e-4d91-946c-edafd60ba0b6 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:10.536653 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1093/2166] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:31:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:31:10.537690 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea5774-d662-4c78-95da-4f52eb3dd0d1 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:10.549762 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea5774-d662-4c78-95da-4f52eb3dd0d1 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:10.555947 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1074/2167] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 2 15:31:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:31:10.560318 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3bc6ef-67c2-4791-ae21-764b800c9341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:10.560956 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3bc6ef-67c2-4791-ae21-764b800c9341 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:10.561240 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3bc6ef-67c2-4791-ae21-764b800c9341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:10.561356 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6172ff19-c86e-4d91-946c-edafd60ba0b6 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:10.561527 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3bc6ef-67c2-4791-ae21-764b800c9341 admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:10.562225 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3bc6ef-67c2-4791-ae21-764b800c9341 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:31:10.562556 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3bc6ef-67c2-4791-ae21-764b800c9341 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:10.564302 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3bc6ef-67c2-4791-ae21-764b800c9341 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:10.572793 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6172ff19-c86e-4d91-946c-edafd60ba0b6 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:10.577900 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52afc90b-dd76-42fe-9e78-4224bcf3dcb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:10.578511 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52afc90b-dd76-42fe-9e78-4224bcf3dcb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:10.578845 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52afc90b-dd76-42fe-9e78-4224bcf3dcb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:10.579122 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52afc90b-dd76-42fe-9e78-4224bcf3dcb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:10.579818 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52afc90b-dd76-42fe-9e78-4224bcf3dcb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:10.579940 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1094/2168] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 2 15:31:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:31:10.581778 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52afc90b-dd76-42fe-9e78-4224bcf3dcb6 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:10.583777 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3bc6ef-67c2-4791-ae21-764b800c9341 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:10.595238 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3bc6ef-67c2-4791-ae21-764b800c9341 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:10.600567 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54062753-84fa-4c15-b331-727088d3d4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:10.601153 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54062753-84fa-4c15-b331-727088d3d4ac admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:10.601447 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54062753-84fa-4c15-b331-727088d3d4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:10.601762 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54062753-84fa-4c15-b331-727088d3d4ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:10.602547 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54062753-84fa-4c15-b331-727088d3d4ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:10.604441 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54062753-84fa-4c15-b331-727088d3d4ac admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:10.617097 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:31:10.617522 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1075/2169] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:31:10 2022] POST /identity/v3/projects => generated 387 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:31:10.624177 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52afc90b-dd76-42fe-9e78-4224bcf3dcb6 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:10.648978 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1095/2170] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:31:10 2022] POST /identity/v3/projects => generated 389 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 15:31:10.653141 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54062753-84fa-4c15-b331-727088d3d4ac admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:10.709000 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52afc90b-dd76-42fe-9e78-4224bcf3dcb6 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:10.736453 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54062753-84fa-4c15-b331-727088d3d4ac admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:10.742997 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08efc97-3289-4adb-806f-152d7f1118e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:10.743675 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08efc97-3289-4adb-806f-152d7f1118e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:10.743957 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08efc97-3289-4adb-806f-152d7f1118e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:10.744232 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08efc97-3289-4adb-806f-152d7f1118e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:10.745194 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08efc97-3289-4adb-806f-152d7f1118e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:10.748396 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08efc97-3289-4adb-806f-152d7f1118e4 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:10.781785 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1096/2171] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:31:10 2022] POST /identity/v3/users => generated 295 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 15:31:10.785523 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08efc97-3289-4adb-806f-152d7f1118e4 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:10.798319 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3388db1b-0a2e-4929-a642-6a72626deb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:10.798988 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388db1b-0a2e-4929-a642-6a72626deb3d admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:10.799947 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388db1b-0a2e-4929-a642-6a72626deb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:10.800387 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08efc97-3289-4adb-806f-152d7f1118e4 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:10.800552 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388db1b-0a2e-4929-a642-6a72626deb3d admin admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:10.801673 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3388db1b-0a2e-4929-a642-6a72626deb3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:10.804603 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3388db1b-0a2e-4929-a642-6a72626deb3d admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:10.806712 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed33dd-8ac7-4c67-9209-88f1c266d27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:10.807670 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed33dd-8ac7-4c67-9209-88f1c266d27d admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:10.808205 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed33dd-8ac7-4c67-9209-88f1c266d27d admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:10.808494 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed33dd-8ac7-4c67-9209-88f1c266d27d admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:10.809359 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ed33dd-8ac7-4c67-9209-88f1c266d27d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:10.811106 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ed33dd-8ac7-4c67-9209-88f1c266d27d admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:10.830676 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1076/2172] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:31:10 2022] POST /identity/v3/users => generated 294 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:31:10.834864 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1097/2173] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 15:31:10.835932 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3388db1b-0a2e-4929-a642-6a72626deb3d admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:10.839513 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed33dd-8ac7-4c67-9209-88f1c266d27d admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:10.851242 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed33dd-8ac7-4c67-9209-88f1c266d27d admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:10.851839 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3388db1b-0a2e-4929-a642-6a72626deb3d admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:10.862944 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cb665e-ed7f-4eb1-b094-de7864db1ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:10.863415 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f432edf-4d5f-463c-b916-2a3d18e2bc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:10.864268 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f432edf-4d5f-463c-b916-2a3d18e2bc60 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:10.864559 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f432edf-4d5f-463c-b916-2a3d18e2bc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:10.864843 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f432edf-4d5f-463c-b916-2a3d18e2bc60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:10.865433 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb665e-ed7f-4eb1-b094-de7864db1ff2 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:10.865904 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb665e-ed7f-4eb1-b094-de7864db1ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:10.866362 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb665e-ed7f-4eb1-b094-de7864db1ff2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:10.866688 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f432edf-4d5f-463c-b916-2a3d18e2bc60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:10.867942 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cb665e-ed7f-4eb1-b094-de7864db1ff2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:10.869996 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cb665e-ed7f-4eb1-b094-de7864db1ff2 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:10.877805 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f432edf-4d5f-463c-b916-2a3d18e2bc60 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:10.886480 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1077/2174] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 15:31:10.887472 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cb665e-ed7f-4eb1-b094-de7864db1ff2 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:10.889182 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-b0cb665e-ed7f-4eb1-b094-de7864db1ff2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:10.898335 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1098/2175] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:31:10.901884 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f432edf-4d5f-463c-b916-2a3d18e2bc60 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:10.906269 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cb665e-ed7f-4eb1-b094-de7864db1ff2 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:10.915081 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00863de6-d4ca-4e07-8143-d718b468e1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:10.915787 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00863de6-d4ca-4e07-8143-d718b468e1cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:10.916136 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00863de6-d4ca-4e07-8143-d718b468e1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:10.916237 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f432edf-4d5f-463c-b916-2a3d18e2bc60 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:10.916545 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00863de6-d4ca-4e07-8143-d718b468e1cf admin admin] PATH_INFO: `/v3/projects/b3cbd5ab1939461488287f904501aa17` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:10.917924 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00863de6-d4ca-4e07-8143-d718b468e1cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3cbd5ab1939461488287f904501aa17)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:10.919926 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00863de6-d4ca-4e07-8143-d718b468e1cf admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:10.922369 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c11e14-5b36-437a-a2d1-72aac77bd414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:10.923405 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c11e14-5b36-437a-a2d1-72aac77bd414 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:10.924230 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c11e14-5b36-437a-a2d1-72aac77bd414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:10.924230 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c11e14-5b36-437a-a2d1-72aac77bd414 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:10.924653 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c11e14-5b36-437a-a2d1-72aac77bd414 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:10.926562 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c11e14-5b36-437a-a2d1-72aac77bd414 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:10.943064 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:31:10.943925 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1099/2176] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:31:10.944838 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c11e14-5b36-437a-a2d1-72aac77bd414 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:10.965090 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c11e14-5b36-437a-a2d1-72aac77bd414 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:10.979207 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-00863de6-d4ca-4e07-8143-d718b468e1cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3cbd5ab1939461488287f904501aa17', 'request_id': 'req-00863de6-d4ca-4e07-8143-d718b468e1cf'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:10.990494 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-00863de6-d4ca-4e07-8143-d718b468e1cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3cbd5ab1939461488287f904501aa17', 'request_id': 'req-00863de6-d4ca-4e07-8143-d718b468e1cf'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:11.002613 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-00863de6-d4ca-4e07-8143-d718b468e1cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3cbd5ab1939461488287f904501aa17', 'request_id': 'req-00863de6-d4ca-4e07-8143-d718b468e1cf'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:11.017889 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-00863de6-d4ca-4e07-8143-d718b468e1cf admin admin] The token cache is being invalidate because project b3cbd5ab1939461488287f904501aa17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80360) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:31:11.018195 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-00863de6-d4ca-4e07-8143-d718b468e1cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:11.018890 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-00863de6-d4ca-4e07-8143-d718b468e1cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:11.020762 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1078/2177] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:31:10 2022] DELETE /identity/v3/projects/b3cbd5ab1939461488287f904501aa17 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:31:11.021321 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00863de6-d4ca-4e07-8143-d718b468e1cf admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:11.022732 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-00863de6-d4ca-4e07-8143-d718b468e1cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:11.051009 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbede41-79c1-4baf-a925-70c7aaafd33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:11.051722 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbede41-79c1-4baf-a925-70c7aaafd33f admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:11.052062 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbede41-79c1-4baf-a925-70c7aaafd33f admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:11.052353 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbede41-79c1-4baf-a925-70c7aaafd33f admin admin] PATH_INFO: `/v3/projects/567455fc1a3d4fc9b81d10b46d4fcc0a/users/5945ee6ff83c44f0b3985156702d137f/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:11.085611 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbede41-79c1-4baf-a925-70c7aaafd33f admin admin] RBAC: Authorizing `identity:create_grant(project_id=567455fc1a3d4fc9b81d10b46d4fcc0a, user_id=5945ee6ff83c44f0b3985156702d137f, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:11.085611 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbede41-79c1-4baf-a925-70c7aaafd33f admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:11.098804 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1100/2178] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:31:10 2022] PUT /identity/v3/projects/567455fc1a3d4fc9b81d10b46d4fcc0a/users/5945ee6ff83c44f0b3985156702d137f/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:31:11.100111 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f81b64e-4c7b-49d1-90b5-66238e6f016b None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:11.100404 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f81b64e-4c7b-49d1-90b5-66238e6f016b None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:11.100684 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f81b64e-4c7b-49d1-90b5-66238e6f016b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:11.109036 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00863de6-d4ca-4e07-8143-d718b468e1cf admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:11.120082 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-2f81b64e-4c7b-49d1-90b5-66238e6f016b None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:31:11.121334 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-2f81b64e-4c7b-49d1-90b5-66238e6f016b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:11.159053 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:31:11.179296 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb79998-433f-4f3f-b634-e3467c53dcb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:11.179931 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb79998-433f-4f3f-b634-e3467c53dcb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:11.180217 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb79998-433f-4f3f-b634-e3467c53dcb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:11.180495 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb79998-433f-4f3f-b634-e3467c53dcb7 admin admin] PATH_INFO: `/v3/projects/ee05d3e2e90d4727bf5a13fa198b27e1/users/54b8bf3d581f43f893aa03c94b47ade2/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:11.191882 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1101/2179] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:31:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:31:11.193276 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70aff5-9268-431a-8050-de8ae8f7846c None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:11.193863 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70aff5-9268-431a-8050-de8ae8f7846c None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:11.194149 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70aff5-9268-431a-8050-de8ae8f7846c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:11.203805 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb79998-433f-4f3f-b634-e3467c53dcb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee05d3e2e90d4727bf5a13fa198b27e1, user_id=54b8bf3d581f43f893aa03c94b47ade2, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:11.206751 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb79998-433f-4f3f-b634-e3467c53dcb7 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:11.222978 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1079/2180] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:31:11 2022] PUT /identity/v3/projects/ee05d3e2e90d4727bf5a13fa198b27e1/users/54b8bf3d581f43f893aa03c94b47ade2/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:31:11.224423 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b734ca-2798-46bb-94c2-7c2b2abe6aba None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:11.224711 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b734ca-2798-46bb-94c2-7c2b2abe6aba None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:11.224989 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b734ca-2798-46bb-94c2-7c2b2abe6aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:11.227850 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-fb70aff5-9268-431a-8050-de8ae8f7846c None None] MFA Rules not processed for user `5945ee6ff83c44f0b3985156702d137f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:31:11.229862 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-fb70aff5-9268-431a-8050-de8ae8f7846c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:11.246753 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-28b734ca-2798-46bb-94c2-7c2b2abe6aba None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:31:11.248026 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-28b734ca-2798-46bb-94c2-7c2b2abe6aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:11.279166 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:31:11.311066 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1102/2181] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:31:11 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:31:11.312378 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73516379-14a2-46f5-b649-a24865fda537 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:11.312661 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73516379-14a2-46f5-b649-a24865fda537 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:11.312935 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73516379-14a2-46f5-b649-a24865fda537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:11.324631 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1080/2182] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:31:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:31:11.325552 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b734ca-2798-46bb-94c2-7c2b2abe6aba None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:11.328843 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-28b734ca-2798-46bb-94c2-7c2b2abe6aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:11.349812 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-73516379-14a2-46f5-b649-a24865fda537 None None] MFA Rules not processed for user `54b8bf3d581f43f893aa03c94b47ade2`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:31:11.351036 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-73516379-14a2-46f5-b649-a24865fda537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:11.393077 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b734ca-2798-46bb-94c2-7c2b2abe6aba None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:11.396826 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2750d4-4bb2-49b2-b165-2c16716be01d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:11.397464 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2750d4-4bb2-49b2-b165-2c16716be01d service cinder] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:11.397724 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2750d4-4bb2-49b2-b165-2c16716be01d service cinder] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:11.398004 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2750d4-4bb2-49b2-b165-2c16716be01d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:11.408345 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2750d4-4bb2-49b2-b165-2c16716be01d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:11.409778 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2750d4-4bb2-49b2-b165-2c16716be01d service cinder] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:11.419372 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1081/2183] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:31:11 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:31:11.420521 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2750d4-4bb2-49b2-b165-2c16716be01d service cinder] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:11.424351 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1103/2184] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:31:11 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:31:11.428710 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73516379-14a2-46f5-b649-a24865fda537 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:11.432938 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2750d4-4bb2-49b2-b165-2c16716be01d service cinder] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:11.438068 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94255287-348b-4650-be0b-4bcc742bed7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:11.438661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94255287-348b-4650-be0b-4bcc742bed7c admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:11.438943 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94255287-348b-4650-be0b-4bcc742bed7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:11.439251 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94255287-348b-4650-be0b-4bcc742bed7c admin admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:11.439972 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73516379-14a2-46f5-b649-a24865fda537 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:11.440109 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94255287-348b-4650-be0b-4bcc742bed7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:31:11.440320 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94255287-348b-4650-be0b-4bcc742bed7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:11.442169 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94255287-348b-4650-be0b-4bcc742bed7c admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:11.444582 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba85059-4594-4d80-b0ec-93ebae8fec09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:11.445195 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba85059-4594-4d80-b0ec-93ebae8fec09 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:11.445479 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba85059-4594-4d80-b0ec-93ebae8fec09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:11.445748 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba85059-4594-4d80-b0ec-93ebae8fec09 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:11.446405 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba85059-4594-4d80-b0ec-93ebae8fec09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:11.448957 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba85059-4594-4d80-b0ec-93ebae8fec09 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:11.458832 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1082/2185] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 2 15:31:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:31:11.459847 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94255287-348b-4650-be0b-4bcc742bed7c admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:11.472678 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94255287-348b-4650-be0b-4bcc742bed7c admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:11.477791 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33670716-e714-4d13-b14e-31794e435583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:11.478485 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33670716-e714-4d13-b14e-31794e435583 admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:11.478862 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33670716-e714-4d13-b14e-31794e435583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:11.479144 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33670716-e714-4d13-b14e-31794e435583 admin admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:11.480114 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33670716-e714-4d13-b14e-31794e435583 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:11.482313 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33670716-e714-4d13-b14e-31794e435583 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:11.493562 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1104/2186] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:31:11 2022] POST /identity/v3/projects => generated 385 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:31:11.499371 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba85059-4594-4d80-b0ec-93ebae8fec09 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:11.520743 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1083/2187] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:31:11 2022] POST /identity/v3/projects => generated 369 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:31:11.524844 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33670716-e714-4d13-b14e-31794e435583 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:11.556324 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:31:11.614143 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba85059-4594-4d80-b0ec-93ebae8fec09 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:11.640877 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33670716-e714-4d13-b14e-31794e435583 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:11.646729 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d97bf-1fc2-4656-ab7d-4ab430e7b47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:11.647551 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d97bf-1fc2-4656-ab7d-4ab430e7b47c admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:11.647838 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d97bf-1fc2-4656-ab7d-4ab430e7b47c admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:11.648252 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d97bf-1fc2-4656-ab7d-4ab430e7b47c admin admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:11.648945 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2d97bf-1fc2-4656-ab7d-4ab430e7b47c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:11.651666 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2d97bf-1fc2-4656-ab7d-4ab430e7b47c admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:11.680448 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1084/2188] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:31:11 2022] POST /identity/v3/users => generated 285 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 15:31:11.684476 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d97bf-1fc2-4656-ab7d-4ab430e7b47c admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:11.697592 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d97bf-1fc2-4656-ab7d-4ab430e7b47c admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:11.704687 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1f986-e9bb-47fc-856d-468fd7b88ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:11.705530 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1f986-e9bb-47fc-856d-468fd7b88ebd admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:11.706543 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1f986-e9bb-47fc-856d-468fd7b88ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:11.706904 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1f986-e9bb-47fc-856d-468fd7b88ebd admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:11.707747 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f1f986-e9bb-47fc-856d-468fd7b88ebd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:11.708332 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb94993-263d-458e-aefc-b0646c5fd0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:11.709231 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb94993-263d-458e-aefc-b0646c5fd0c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:11.709760 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb94993-263d-458e-aefc-b0646c5fd0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:11.710069 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb94993-263d-458e-aefc-b0646c5fd0c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:11.710186 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f1f986-e9bb-47fc-856d-468fd7b88ebd admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:11.710832 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb94993-263d-458e-aefc-b0646c5fd0c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:11.712754 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb94993-263d-458e-aefc-b0646c5fd0c1 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:11.728457 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1085/2189] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 15:31:11.737529 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb94993-263d-458e-aefc-b0646c5fd0c1 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:11.744132 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1105/2190] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:31:11 2022] POST /identity/v3/users => generated 299 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:31:11.748187 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1f986-e9bb-47fc-856d-468fd7b88ebd admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:11.751822 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb94993-263d-458e-aefc-b0646c5fd0c1 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:11.763494 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d16b03-f2e1-47c3-b1c4-cce446d4c63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:11.764170 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d16b03-f2e1-47c3-b1c4-cce446d4c63d admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:11.764486 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d16b03-f2e1-47c3-b1c4-cce446d4c63d admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:11.764799 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d16b03-f2e1-47c3-b1c4-cce446d4c63d admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:11.765554 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1f986-e9bb-47fc-856d-468fd7b88ebd admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:11.766231 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d16b03-f2e1-47c3-b1c4-cce446d4c63d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:11.768423 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d16b03-f2e1-47c3-b1c4-cce446d4c63d admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:11.772603 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff1000d-8e66-4099-bc73-5f641d9b1f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:11.773350 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1000d-8e66-4099-bc73-5f641d9b1f35 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:11.773632 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1000d-8e66-4099-bc73-5f641d9b1f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:11.773958 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1000d-8e66-4099-bc73-5f641d9b1f35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:11.774608 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff1000d-8e66-4099-bc73-5f641d9b1f35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:11.777619 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff1000d-8e66-4099-bc73-5f641d9b1f35 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:11.785296 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1086/2191] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:31:11.787489 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d16b03-f2e1-47c3-b1c4-cce446d4c63d admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:11.791855 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1106/2192] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:31:11.802421 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d16b03-f2e1-47c3-b1c4-cce446d4c63d admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:11.808399 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff1000d-8e66-4099-bc73-5f641d9b1f35 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:11.814419 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c5ee0-3af4-4cbe-81fe-72cb6a0146f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:11.815262 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c5ee0-3af4-4cbe-81fe-72cb6a0146f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:11.815624 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c5ee0-3af4-4cbe-81fe-72cb6a0146f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:11.816427 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c5ee0-3af4-4cbe-81fe-72cb6a0146f7 admin admin] PATH_INFO: `/v3/projects/b06d32be08fc44ee99bdcd97d7bcc580/users/2802f9cc5f2044abafe63cb8c2d51864/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:11.827883 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff1000d-8e66-4099-bc73-5f641d9b1f35 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:11.829633 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:31:11.846499 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2167be54-2abb-4d6a-90d3-fe8fa8b91b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:11.848401 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2167be54-2abb-4d6a-90d3-fe8fa8b91b8c admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:11.849182 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2167be54-2abb-4d6a-90d3-fe8fa8b91b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:11.849467 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2167be54-2abb-4d6a-90d3-fe8fa8b91b8c admin admin] PATH_INFO: `/v3/projects/7ca38a9f4b8a41a78bcef272aeacf9d9/users/8b5937e905a749f9b9de7b79cfb73111/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:11.852682 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2c5ee0-3af4-4cbe-81fe-72cb6a0146f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b06d32be08fc44ee99bdcd97d7bcc580, user_id=2802f9cc5f2044abafe63cb8c2d51864, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:11.855944 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2c5ee0-3af4-4cbe-81fe-72cb6a0146f7 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:11.877970 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2167be54-2abb-4d6a-90d3-fe8fa8b91b8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ca38a9f4b8a41a78bcef272aeacf9d9, user_id=8b5937e905a749f9b9de7b79cfb73111, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:11.882389 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1087/2193] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:31:11 2022] PUT /identity/v3/projects/b06d32be08fc44ee99bdcd97d7bcc580/users/2802f9cc5f2044abafe63cb8c2d51864/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 15:31:11.882614 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2167be54-2abb-4d6a-90d3-fe8fa8b91b8c admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:11.884345 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1059003f-bbe4-4fd6-89a3-897e37e428d5 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:11.884637 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1059003f-bbe4-4fd6-89a3-897e37e428d5 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:11.884914 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1059003f-bbe4-4fd6-89a3-897e37e428d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:11.909021 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1107/2194] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:31:11 2022] PUT /identity/v3/projects/7ca38a9f4b8a41a78bcef272aeacf9d9/users/8b5937e905a749f9b9de7b79cfb73111/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:31:11.909904 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-1059003f-bbe4-4fd6-89a3-897e37e428d5 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:31:11.910206 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2167be54-2abb-4d6a-90d3-fe8fa8b91b8c admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:11.911856 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-1059003f-bbe4-4fd6-89a3-897e37e428d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:12.024003 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1088/2195] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:31:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:31:12.025675 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1059003f-bbe4-4fd6-89a3-897e37e428d5 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:12.029449 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-1059003f-bbe4-4fd6-89a3-897e37e428d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:12.050925 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2167be54-2abb-4d6a-90d3-fe8fa8b91b8c admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:12.058125 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d694b65b-cb39-4b93-a3e0-446be3914523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:12.059189 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694b65b-cb39-4b93-a3e0-446be3914523 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:12.059596 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694b65b-cb39-4b93-a3e0-446be3914523 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:12.059979 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694b65b-cb39-4b93-a3e0-446be3914523 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:12.060795 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d694b65b-cb39-4b93-a3e0-446be3914523 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:12.062470 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d694b65b-cb39-4b93-a3e0-446be3914523 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:12.075262 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1108/2196] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:31:12.082411 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d694b65b-cb39-4b93-a3e0-446be3914523 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:12.099420 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d694b65b-cb39-4b93-a3e0-446be3914523 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:12.106856 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4f7902-f427-4981-94df-3fc946ebc81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:12.108040 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f7902-f427-4981-94df-3fc946ebc81a admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:12.108333 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f7902-f427-4981-94df-3fc946ebc81a admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:12.108608 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f7902-f427-4981-94df-3fc946ebc81a admin admin] PATH_INFO: `/v3/projects/7ca38a9f4b8a41a78bcef272aeacf9d9/users/8b5937e905a749f9b9de7b79cfb73111/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:12.110503 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1059003f-bbe4-4fd6-89a3-897e37e428d5 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:12.110762 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4f7902-f427-4981-94df-3fc946ebc81a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ca38a9f4b8a41a78bcef272aeacf9d9, user_id=8b5937e905a749f9b9de7b79cfb73111, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:12.113624 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4f7902-f427-4981-94df-3fc946ebc81a admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:12.115682 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0feb8-5489-4d3c-ac9e-e80b4e43964d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:12.116688 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0feb8-5489-4d3c-ac9e-e80b4e43964d service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:12.117317 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0feb8-5489-4d3c-ac9e-e80b4e43964d service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:12.117673 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0feb8-5489-4d3c-ac9e-e80b4e43964d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:12.131089 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0feb8-5489-4d3c-ac9e-e80b4e43964d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:12.132502 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0feb8-5489-4d3c-ac9e-e80b4e43964d service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:12.135127 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1109/2197] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:31:12 2022] PUT /identity/v3/projects/7ca38a9f4b8a41a78bcef272aeacf9d9/users/8b5937e905a749f9b9de7b79cfb73111/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:31:12.145840 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e8946-bcdb-4e48-9247-81f87bf7198b None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:12.146599 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e8946-bcdb-4e48-9247-81f87bf7198b None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:12.147274 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e8946-bcdb-4e48-9247-81f87bf7198b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:12.151417 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1089/2198] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:31:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 15:31:12.177250 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:31:12.193572 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-3e3e8946-bcdb-4e48-9247-81f87bf7198b None None] MFA Rules not processed for user `8b5937e905a749f9b9de7b79cfb73111`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:31:12.196074 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-3e3e8946-bcdb-4e48-9247-81f87bf7198b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:12.274400 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1110/2199] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:31:12 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:31:12.286384 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0feb8-5489-4d3c-ac9e-e80b4e43964d service neutron] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:12.348305 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0feb8-5489-4d3c-ac9e-e80b4e43964d service neutron] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:12.404234 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:31:12.411308 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12db1965-c430-4459-8c54-cbef044de5c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:12.411914 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db1965-c430-4459-8c54-cbef044de5c6 service cinder] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:12.412329 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db1965-c430-4459-8c54-cbef044de5c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:12.412662 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db1965-c430-4459-8c54-cbef044de5c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:12.425993 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12db1965-c430-4459-8c54-cbef044de5c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:12.427566 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12db1965-c430-4459-8c54-cbef044de5c6 service cinder] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:12.439513 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1090/2200] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:31:12 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 15:31:12.468691 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e8946-bcdb-4e48-9247-81f87bf7198b None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:12.546803 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e8946-bcdb-4e48-9247-81f87bf7198b None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:12.551790 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbedba2-e6fe-4ed3-ba89-9a4286cce408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:12.552521 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbedba2-e6fe-4ed3-ba89-9a4286cce408 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:12.552803 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbedba2-e6fe-4ed3-ba89-9a4286cce408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:12.553175 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbedba2-e6fe-4ed3-ba89-9a4286cce408 admin admin] PATH_INFO: `/v3/users/54b8bf3d581f43f893aa03c94b47ade2` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:12.554339 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbedba2-e6fe-4ed3-ba89-9a4286cce408 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54b8bf3d581f43f893aa03c94b47ade2)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:12.556643 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbedba2-e6fe-4ed3-ba89-9a4286cce408 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:12.611731 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-0fbedba2-e6fe-4ed3-ba89-9a4286cce408 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54b8bf3d581f43f893aa03c94b47ade2'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:12.625012 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-0fbedba2-e6fe-4ed3-ba89-9a4286cce408 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54b8bf3d581f43f893aa03c94b47ade2'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:12.626013 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-0fbedba2-e6fe-4ed3-ba89-9a4286cce408 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54b8bf3d581f43f893aa03c94b47ade2'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:12.633206 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-0fbedba2-e6fe-4ed3-ba89-9a4286cce408 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54b8bf3d581f43f893aa03c94b47ade2'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:12.641907 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-0fbedba2-e6fe-4ed3-ba89-9a4286cce408 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54b8bf3d581f43f893aa03c94b47ade2'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:12.648598 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1111/2201] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:31:12 2022] DELETE /identity/v3/users/54b8bf3d581f43f893aa03c94b47ade2 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:31:12.653784 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d38d6-5bc4-47e7-9ab5-ef9a075cce98 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:12.654078 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d38d6-5bc4-47e7-9ab5-ef9a075cce98 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:12.654353 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d38d6-5bc4-47e7-9ab5-ef9a075cce98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:12.674845 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-ac7d38d6-5bc4-47e7-9ab5-ef9a075cce98 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:31:12.676132 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-ac7d38d6-5bc4-47e7-9ab5-ef9a075cce98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:12.743501 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1091/2202] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:31:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:31:12.755340 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbedba2-e6fe-4ed3-ba89-9a4286cce408 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:12.756916 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-0fbedba2-e6fe-4ed3-ba89-9a4286cce408 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:12.784478 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:31:12.838470 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbedba2-e6fe-4ed3-ba89-9a4286cce408 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:12.843249 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cfc61e-222c-4287-b221-2dde0cac086b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:12.844013 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cfc61e-222c-4287-b221-2dde0cac086b service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:12.844309 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cfc61e-222c-4287-b221-2dde0cac086b service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:12.844589 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cfc61e-222c-4287-b221-2dde0cac086b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:12.858245 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cfc61e-222c-4287-b221-2dde0cac086b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:12.859818 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cfc61e-222c-4287-b221-2dde0cac086b service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:12.871705 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1112/2203] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:31:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:31:13.894152 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7d38d6-5bc4-47e7-9ab5-ef9a075cce98 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:13.895861 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-ac7d38d6-5bc4-47e7-9ab5-ef9a075cce98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:13.912484 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7d38d6-5bc4-47e7-9ab5-ef9a075cce98 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:13.941107 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb8c45f-9440-4e98-87c9-a659bd670943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:13.942943 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb8c45f-9440-4e98-87c9-a659bd670943 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:13.944021 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb8c45f-9440-4e98-87c9-a659bd670943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:13.982887 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb8c45f-9440-4e98-87c9-a659bd670943 admin admin] PATH_INFO: `/v3/projects/ee05d3e2e90d4727bf5a13fa198b27e1` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:13.994685 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb8c45f-9440-4e98-87c9-a659bd670943 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee05d3e2e90d4727bf5a13fa198b27e1)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:13.994685 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb8c45f-9440-4e98-87c9-a659bd670943 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:14.090942 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-dcb8c45f-9440-4e98-87c9-a659bd670943 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee05d3e2e90d4727bf5a13fa198b27e1', 'request_id': 'req-dcb8c45f-9440-4e98-87c9-a659bd670943'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:14.101139 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-dcb8c45f-9440-4e98-87c9-a659bd670943 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee05d3e2e90d4727bf5a13fa198b27e1', 'request_id': 'req-dcb8c45f-9440-4e98-87c9-a659bd670943'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:14.117876 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-dcb8c45f-9440-4e98-87c9-a659bd670943 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee05d3e2e90d4727bf5a13fa198b27e1', 'request_id': 'req-dcb8c45f-9440-4e98-87c9-a659bd670943'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:14.142758 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-dcb8c45f-9440-4e98-87c9-a659bd670943 admin admin] The token cache is being invalidate because project ee05d3e2e90d4727bf5a13fa198b27e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80360) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:31:14.142968 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-dcb8c45f-9440-4e98-87c9-a659bd670943 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:14.157481 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-dcb8c45f-9440-4e98-87c9-a659bd670943 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:14.157481 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1092/2204] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:31:13 2022] DELETE /identity/v3/projects/ee05d3e2e90d4727bf5a13fa198b27e1 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:31:14.162358 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cfc61e-222c-4287-b221-2dde0cac086b service neutron] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:14.180827 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cfc61e-222c-4287-b221-2dde0cac086b service neutron] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:14.266593 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e067bf2-7c84-41b8-b943-35c2dfa1bf2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:14.267367 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e067bf2-7c84-41b8-b943-35c2dfa1bf2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:14.267851 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e067bf2-7c84-41b8-b943-35c2dfa1bf2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:14.268371 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e067bf2-7c84-41b8-b943-35c2dfa1bf2d admin admin] PATH_INFO: `/v3/users/8b5937e905a749f9b9de7b79cfb73111` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:14.269679 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e067bf2-7c84-41b8-b943-35c2dfa1bf2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b5937e905a749f9b9de7b79cfb73111)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:14.271743 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e067bf2-7c84-41b8-b943-35c2dfa1bf2d admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:14.366565 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-5e067bf2-7c84-41b8-b943-35c2dfa1bf2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b5937e905a749f9b9de7b79cfb73111'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:14.383668 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-5e067bf2-7c84-41b8-b943-35c2dfa1bf2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b5937e905a749f9b9de7b79cfb73111'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:14.384430 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-5e067bf2-7c84-41b8-b943-35c2dfa1bf2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b5937e905a749f9b9de7b79cfb73111'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:14.392411 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-5e067bf2-7c84-41b8-b943-35c2dfa1bf2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b5937e905a749f9b9de7b79cfb73111'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:14.400247 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-5e067bf2-7c84-41b8-b943-35c2dfa1bf2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b5937e905a749f9b9de7b79cfb73111'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:14.407780 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1113/2205] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:31:14 2022] DELETE /identity/v3/users/8b5937e905a749f9b9de7b79cfb73111 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:31:15.640164 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb8c45f-9440-4e98-87c9-a659bd670943 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:15.643328 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-dcb8c45f-9440-4e98-87c9-a659bd670943 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:15.691399 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb8c45f-9440-4e98-87c9-a659bd670943 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:15.824322 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e42933-89a6-4f8d-a087-2932233b6c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:15.825232 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e42933-89a6-4f8d-a087-2932233b6c4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:15.825623 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e42933-89a6-4f8d-a087-2932233b6c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:15.826898 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e42933-89a6-4f8d-a087-2932233b6c4d admin admin] PATH_INFO: `/v3/projects/7ca38a9f4b8a41a78bcef272aeacf9d9` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:15.827975 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e42933-89a6-4f8d-a087-2932233b6c4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ca38a9f4b8a41a78bcef272aeacf9d9)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:15.830368 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e42933-89a6-4f8d-a087-2932233b6c4d admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:15.849374 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:31:15.932474 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-18e42933-89a6-4f8d-a087-2932233b6c4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ca38a9f4b8a41a78bcef272aeacf9d9', 'request_id': 'req-18e42933-89a6-4f8d-a087-2932233b6c4d'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:15.947923 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-18e42933-89a6-4f8d-a087-2932233b6c4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ca38a9f4b8a41a78bcef272aeacf9d9', 'request_id': 'req-18e42933-89a6-4f8d-a087-2932233b6c4d'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:15.968020 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-18e42933-89a6-4f8d-a087-2932233b6c4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ca38a9f4b8a41a78bcef272aeacf9d9', 'request_id': 'req-18e42933-89a6-4f8d-a087-2932233b6c4d'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:15.996516 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-18e42933-89a6-4f8d-a087-2932233b6c4d admin admin] The token cache is being invalidate because project 7ca38a9f4b8a41a78bcef272aeacf9d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80360) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:31:15.996815 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-18e42933-89a6-4f8d-a087-2932233b6c4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:16.000369 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-18e42933-89a6-4f8d-a087-2932233b6c4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:16.004301 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1093/2206] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:31:15 2022] DELETE /identity/v3/projects/7ca38a9f4b8a41a78bcef272aeacf9d9 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:31:16.010150 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef2449-0203-4ef3-a850-9bfdaf14c389 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:16.010713 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef2449-0203-4ef3-a850-9bfdaf14c389 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:16.010804 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef2449-0203-4ef3-a850-9bfdaf14c389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:16.077039 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-ecef2449-0203-4ef3-a850-9bfdaf14c389 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:31:16.078751 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-ecef2449-0203-4ef3-a850-9bfdaf14c389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:16.209688 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:31:16.271183 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1114/2207] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:31:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:31:16.281600 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7859a8d-e16d-4ed7-8a44-74411b196ac3 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:16.282731 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7859a8d-e16d-4ed7-8a44-74411b196ac3 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:16.283016 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7859a8d-e16d-4ed7-8a44-74411b196ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:16.330320 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-a7859a8d-e16d-4ed7-8a44-74411b196ac3 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:31:16.331626 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-a7859a8d-e16d-4ed7-8a44-74411b196ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:16.353764 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1094/2208] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:31:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:31:16.358665 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef2449-0203-4ef3-a850-9bfdaf14c389 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:16.378760 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef2449-0203-4ef3-a850-9bfdaf14c389 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:16.388908 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a6c63-78d9-40eb-b6a2-ba0f70db5fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:16.389829 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a6c63-78d9-40eb-b6a2-ba0f70db5fc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:16.390211 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a6c63-78d9-40eb-b6a2-ba0f70db5fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:16.390603 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a6c63-78d9-40eb-b6a2-ba0f70db5fc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:16.391508 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32a6c63-78d9-40eb-b6a2-ba0f70db5fc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:31:16.391909 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32a6c63-78d9-40eb-b6a2-ba0f70db5fc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:16.398372 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32a6c63-78d9-40eb-b6a2-ba0f70db5fc0 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:16.456015 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1115/2209] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 2 15:31:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:31:16.459988 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7859a8d-e16d-4ed7-8a44-74411b196ac3 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:16.483994 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7859a8d-e16d-4ed7-8a44-74411b196ac3 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:16.510837 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a638bd8c-3f70-4f8f-b98e-71effe1a2e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:16.511838 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638bd8c-3f70-4f8f-b98e-71effe1a2e8c admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:16.512738 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638bd8c-3f70-4f8f-b98e-71effe1a2e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:16.515433 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638bd8c-3f70-4f8f-b98e-71effe1a2e8c admin admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:16.519903 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a638bd8c-3f70-4f8f-b98e-71effe1a2e8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:16.529179 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a638bd8c-3f70-4f8f-b98e-71effe1a2e8c admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:16.640193 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1095/2210] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:31:16 2022] POST /identity/v3/projects => generated 373 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:31:16.648948 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a6c63-78d9-40eb-b6a2-ba0f70db5fc0 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:16.669640 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a6c63-78d9-40eb-b6a2-ba0f70db5fc0 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:16.825787 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab0ffc-2789-41e2-8a6d-05846c7c63c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:16.826421 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab0ffc-2789-41e2-8a6d-05846c7c63c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:16.827421 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab0ffc-2789-41e2-8a6d-05846c7c63c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:16.827712 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab0ffc-2789-41e2-8a6d-05846c7c63c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:16.828398 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab0ffc-2789-41e2-8a6d-05846c7c63c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:16.833836 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab0ffc-2789-41e2-8a6d-05846c7c63c4 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:16.895264 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1116/2211] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:31:16 2022] POST /identity/v3/users => generated 287 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:31:16.901169 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a638bd8c-3f70-4f8f-b98e-71effe1a2e8c admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:16.925128 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a638bd8c-3f70-4f8f-b98e-71effe1a2e8c admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:16.930649 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01d8aa0-23fb-45c7-84ef-a40ca79f0afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:16.931435 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d8aa0-23fb-45c7-84ef-a40ca79f0afa admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:16.931814 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d8aa0-23fb-45c7-84ef-a40ca79f0afa admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:16.933188 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d8aa0-23fb-45c7-84ef-a40ca79f0afa admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:16.934569 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01d8aa0-23fb-45c7-84ef-a40ca79f0afa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:16.936628 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01d8aa0-23fb-45c7-84ef-a40ca79f0afa admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:16.953058 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1096/2212] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:31:16 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:31:16.954585 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab0ffc-2789-41e2-8a6d-05846c7c63c4 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:16.965284 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab0ffc-2789-41e2-8a6d-05846c7c63c4 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:16.972634 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65195870-627f-4996-976d-d703568f4f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:16.973710 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65195870-627f-4996-976d-d703568f4f35 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:16.974220 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65195870-627f-4996-976d-d703568f4f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:16.975047 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65195870-627f-4996-976d-d703568f4f35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:16.976236 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65195870-627f-4996-976d-d703568f4f35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:16.987368 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65195870-627f-4996-976d-d703568f4f35 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:17.016658 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01d8aa0-23fb-45c7-84ef-a40ca79f0afa admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:17.016823 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1117/2213] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:31:16 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:31:17.040830 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01d8aa0-23fb-45c7-84ef-a40ca79f0afa admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:17.048005 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86efa5b-894c-4486-89d6-6d35e1e7f6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:17.048736 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86efa5b-894c-4486-89d6-6d35e1e7f6ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:17.049022 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86efa5b-894c-4486-89d6-6d35e1e7f6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:17.049304 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86efa5b-894c-4486-89d6-6d35e1e7f6ec admin admin] PATH_INFO: `/v3/projects/3ddf50e8b48340bd89092e6a392bcaad/users/0d9c08085375447d854b2865eb94c3bf/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:17.070146 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86efa5b-894c-4486-89d6-6d35e1e7f6ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ddf50e8b48340bd89092e6a392bcaad, user_id=0d9c08085375447d854b2865eb94c3bf, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:17.073368 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86efa5b-894c-4486-89d6-6d35e1e7f6ec admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:17.113109 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1097/2214] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:31:17 2022] PUT /identity/v3/projects/3ddf50e8b48340bd89092e6a392bcaad/users/0d9c08085375447d854b2865eb94c3bf/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:31:17.115201 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b5d66-9abe-45df-b7f4-c636a68b2718 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:17.115841 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b5d66-9abe-45df-b7f4-c636a68b2718 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:17.116410 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b5d66-9abe-45df-b7f4-c636a68b2718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:17.192146 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-003b5d66-9abe-45df-b7f4-c636a68b2718 None None] MFA Rules not processed for user `0d9c08085375447d854b2865eb94c3bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:31:17.199710 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-003b5d66-9abe-45df-b7f4-c636a68b2718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:17.386871 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1118/2215] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:31:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:31:17.391175 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86efa5b-894c-4486-89d6-6d35e1e7f6ec admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:17.506816 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86efa5b-894c-4486-89d6-6d35e1e7f6ec admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:17.518976 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f84a90-7c17-41fe-981f-b2951847bebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:17.520104 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f84a90-7c17-41fe-981f-b2951847bebb admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:17.520501 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f84a90-7c17-41fe-981f-b2951847bebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:17.520874 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f84a90-7c17-41fe-981f-b2951847bebb admin admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:17.521900 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f84a90-7c17-41fe-981f-b2951847bebb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:17.525074 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f84a90-7c17-41fe-981f-b2951847bebb admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:17.558832 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1098/2216] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:31:17 2022] POST /identity/v3/projects => generated 375 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 15:31:17.563511 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b5d66-9abe-45df-b7f4-c636a68b2718 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:17.584517 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b5d66-9abe-45df-b7f4-c636a68b2718 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:17.629585 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:31:17.701898 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd712d-2a8e-4888-8728-be97ed40e754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:17.704469 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd712d-2a8e-4888-8728-be97ed40e754 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:17.707297 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd712d-2a8e-4888-8728-be97ed40e754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:17.707297 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd712d-2a8e-4888-8728-be97ed40e754 admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:17.707297 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bd712d-2a8e-4888-8728-be97ed40e754 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:17.710163 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bd712d-2a8e-4888-8728-be97ed40e754 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:17.756503 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1119/2217] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:31:17 2022] POST /identity/v3/users => generated 294 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:31:17.760701 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f84a90-7c17-41fe-981f-b2951847bebb admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:17.788688 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f84a90-7c17-41fe-981f-b2951847bebb admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:17.843195 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9c1f66-f4e1-44b4-89ff-6b31fa588b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:17.844074 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c1f66-f4e1-44b4-89ff-6b31fa588b10 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:17.844646 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c1f66-f4e1-44b4-89ff-6b31fa588b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:17.847178 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c1f66-f4e1-44b4-89ff-6b31fa588b10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:17.848051 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9c1f66-f4e1-44b4-89ff-6b31fa588b10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:17.849558 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9c1f66-f4e1-44b4-89ff-6b31fa588b10 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:17.911309 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1099/2218] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:31:17.912554 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd712d-2a8e-4888-8728-be97ed40e754 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:17.939727 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd712d-2a8e-4888-8728-be97ed40e754 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:17.960736 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a21eab-e20f-4254-b77b-78c45af01d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:17.961504 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a21eab-e20f-4254-b77b-78c45af01d43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:17.961851 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a21eab-e20f-4254-b77b-78c45af01d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:17.962193 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a21eab-e20f-4254-b77b-78c45af01d43 admin admin] PATH_INFO: `/v3/projects/c119e8edf085459989052addb1acd396/users/59f4d820eba44316800516a731f313d6/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:17.990814 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a21eab-e20f-4254-b77b-78c45af01d43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c119e8edf085459989052addb1acd396, user_id=59f4d820eba44316800516a731f313d6, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:17.997211 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a21eab-e20f-4254-b77b-78c45af01d43 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:18.025769 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1120/2219] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:31:17 2022] PUT /identity/v3/projects/c119e8edf085459989052addb1acd396/users/59f4d820eba44316800516a731f313d6/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:31:18.028456 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9c1f66-f4e1-44b4-89ff-6b31fa588b10 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:18.046252 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9c1f66-f4e1-44b4-89ff-6b31fa588b10 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:18.069638 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:31:18.190646 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee7d665-d0c8-4e17-a3ea-b72c10dc5bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:18.196278 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7d665-d0c8-4e17-a3ea-b72c10dc5bc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:18.196570 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7d665-d0c8-4e17-a3ea-b72c10dc5bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:18.196851 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7d665-d0c8-4e17-a3ea-b72c10dc5bc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:18.197671 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee7d665-d0c8-4e17-a3ea-b72c10dc5bc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:18.200013 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee7d665-d0c8-4e17-a3ea-b72c10dc5bc7 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:18.210850 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1100/2220] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:31:18 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 15:31:18.216174 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a21eab-e20f-4254-b77b-78c45af01d43 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:18.230599 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a21eab-e20f-4254-b77b-78c45af01d43 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:18.234122 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea42d206-21bc-4260-8caf-c7edbfa564e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:18.234982 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42d206-21bc-4260-8caf-c7edbfa564e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:18.235948 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42d206-21bc-4260-8caf-c7edbfa564e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:18.235948 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42d206-21bc-4260-8caf-c7edbfa564e3 admin admin] PATH_INFO: `/v3/projects/c119e8edf085459989052addb1acd396/users/59f4d820eba44316800516a731f313d6/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:18.237917 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea42d206-21bc-4260-8caf-c7edbfa564e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c119e8edf085459989052addb1acd396, user_id=59f4d820eba44316800516a731f313d6, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:18.245432 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea42d206-21bc-4260-8caf-c7edbfa564e3 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:18.305047 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1121/2221] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:31:18 2022] PUT /identity/v3/projects/c119e8edf085459989052addb1acd396/users/59f4d820eba44316800516a731f313d6/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:31:18.307160 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e155adc-6356-4f1c-9059-bbf8864356f2 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:18.307659 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e155adc-6356-4f1c-9059-bbf8864356f2 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:18.308051 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e155adc-6356-4f1c-9059-bbf8864356f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:18.392400 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-8e155adc-6356-4f1c-9059-bbf8864356f2 None None] MFA Rules not processed for user `59f4d820eba44316800516a731f313d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:31:18.393792 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-8e155adc-6356-4f1c-9059-bbf8864356f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:18.562239 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1101/2222] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:31:18 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:31:18.571889 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea42d206-21bc-4260-8caf-c7edbfa564e3 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:18.574373 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-ea42d206-21bc-4260-8caf-c7edbfa564e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:18.667289 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea42d206-21bc-4260-8caf-c7edbfa564e3 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:18.671308 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b2d3f9-fed1-4e73-b43d-b98c93168f4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:18.671944 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2d3f9-fed1-4e73-b43d-b98c93168f4d service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:18.672227 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2d3f9-fed1-4e73-b43d-b98c93168f4d service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:18.672499 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2d3f9-fed1-4e73-b43d-b98c93168f4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:18.785433 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b2d3f9-fed1-4e73-b43d-b98c93168f4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:18.790230 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b2d3f9-fed1-4e73-b43d-b98c93168f4d service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:18.823423 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1122/2223] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:31:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:31:18.965874 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e155adc-6356-4f1c-9059-bbf8864356f2 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:18.967903 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-8e155adc-6356-4f1c-9059-bbf8864356f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:19.096024 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e155adc-6356-4f1c-9059-bbf8864356f2 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:19.104421 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efda3a6-1b9d-4633-9993-faca3465f37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:19.105164 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efda3a6-1b9d-4633-9993-faca3465f37e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:19.105451 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efda3a6-1b9d-4633-9993-faca3465f37e admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:19.105727 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efda3a6-1b9d-4633-9993-faca3465f37e admin admin] PATH_INFO: `/v3/users/a3a26ab281074e2b84ed1f354129ff3d` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:19.107188 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efda3a6-1b9d-4633-9993-faca3465f37e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3a26ab281074e2b84ed1f354129ff3d)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:19.109458 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efda3a6-1b9d-4633-9993-faca3465f37e admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:19.193048 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:31:19.212688 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713a73e-aafc-48c8-bbe2-7b5bfe4fd27e None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:19.213810 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713a73e-aafc-48c8-bbe2-7b5bfe4fd27e None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:19.215608 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713a73e-aafc-48c8-bbe2-7b5bfe4fd27e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:19.217903 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-9efda3a6-1b9d-4633-9993-faca3465f37e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3a26ab281074e2b84ed1f354129ff3d'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:19.232776 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-9efda3a6-1b9d-4633-9993-faca3465f37e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3a26ab281074e2b84ed1f354129ff3d'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:19.266259 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-c713a73e-aafc-48c8-bbe2-7b5bfe4fd27e None None] MFA Rules not processed for user `2802f9cc5f2044abafe63cb8c2d51864`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:31:19.268034 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-c713a73e-aafc-48c8-bbe2-7b5bfe4fd27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:19.270913 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-9efda3a6-1b9d-4633-9993-faca3465f37e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3a26ab281074e2b84ed1f354129ff3d'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:19.272083 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-9efda3a6-1b9d-4633-9993-faca3465f37e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3a26ab281074e2b84ed1f354129ff3d'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:19.276942 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-9efda3a6-1b9d-4633-9993-faca3465f37e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3a26ab281074e2b84ed1f354129ff3d'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:19.303486 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1102/2224] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:31:18 2022] DELETE /identity/v3/users/a3a26ab281074e2b84ed1f354129ff3d => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:31:19.310716 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:31:19.385917 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1123/2225] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:31:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:31:19.390137 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efda3a6-1b9d-4633-9993-faca3465f37e admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:19.392047 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-9efda3a6-1b9d-4633-9993-faca3465f37e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:19.501801 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efda3a6-1b9d-4633-9993-faca3465f37e admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:19.507634 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf4e4ae-d118-401d-ace1-b580a7f7ad5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:19.508510 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf4e4ae-d118-401d-ace1-b580a7f7ad5b admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:19.508819 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf4e4ae-d118-401d-ace1-b580a7f7ad5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:19.509064 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf4e4ae-d118-401d-ace1-b580a7f7ad5b admin admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:19.510873 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf4e4ae-d118-401d-ace1-b580a7f7ad5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:19.513502 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf4e4ae-d118-401d-ace1-b580a7f7ad5b admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:19.547569 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1103/2226] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:31:19 2022] POST /identity/v3/projects => generated 373 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:31:19.551202 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c713a73e-aafc-48c8-bbe2-7b5bfe4fd27e None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:19.563474 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c713a73e-aafc-48c8-bbe2-7b5bfe4fd27e None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:19.606555 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf4e4ae-d118-401d-ace1-b580a7f7ad5b admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:19.608497 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-abf4e4ae-d118-401d-ace1-b580a7f7ad5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:19.642485 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbdc39d-ddc9-4d1a-ad91-237f94672e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:19.643118 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbdc39d-ddc9-4d1a-ad91-237f94672e49 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:19.643437 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbdc39d-ddc9-4d1a-ad91-237f94672e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:19.643721 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbdc39d-ddc9-4d1a-ad91-237f94672e49 admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:19.644411 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbdc39d-ddc9-4d1a-ad91-237f94672e49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:19.646412 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbdc39d-ddc9-4d1a-ad91-237f94672e49 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:19.668214 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1124/2227] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:31:19 2022] POST /identity/v3/users => generated 293 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:31:19.672259 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbdc39d-ddc9-4d1a-ad91-237f94672e49 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:19.682808 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbdc39d-ddc9-4d1a-ad91-237f94672e49 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:19.683113 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf4e4ae-d118-401d-ace1-b580a7f7ad5b admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:19.688029 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ae368e-e374-4bc1-a3ff-1fbbcf0d7dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:19.688176 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e086ab3-dbaf-49bc-bb54-db28e98eb850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:19.688648 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae368e-e374-4bc1-a3ff-1fbbcf0d7dcc admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:19.688775 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e086ab3-dbaf-49bc-bb54-db28e98eb850 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:19.688935 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae368e-e374-4bc1-a3ff-1fbbcf0d7dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:19.689050 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e086ab3-dbaf-49bc-bb54-db28e98eb850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:19.689202 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae368e-e374-4bc1-a3ff-1fbbcf0d7dcc admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:19.689353 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e086ab3-dbaf-49bc-bb54-db28e98eb850 admin admin] PATH_INFO: `/v3/projects/c17d0272c13a4a35958e141d6571a627` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:19.689900 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ae368e-e374-4bc1-a3ff-1fbbcf0d7dcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:19.690520 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e086ab3-dbaf-49bc-bb54-db28e98eb850 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c17d0272c13a4a35958e141d6571a627)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:19.691592 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ae368e-e374-4bc1-a3ff-1fbbcf0d7dcc admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:19.692464 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e086ab3-dbaf-49bc-bb54-db28e98eb850 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:19.706001 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1125/2228] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:31:19.707687 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ae368e-e374-4bc1-a3ff-1fbbcf0d7dcc admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:19.719344 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ae368e-e374-4bc1-a3ff-1fbbcf0d7dcc admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:19.725608 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a1f2f6-6b62-4167-8be6-84627fb8d61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:19.726338 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1f2f6-6b62-4167-8be6-84627fb8d61a admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:19.726625 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1f2f6-6b62-4167-8be6-84627fb8d61a admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:19.726928 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1f2f6-6b62-4167-8be6-84627fb8d61a admin admin] PATH_INFO: `/v3/projects/9eef49c2f20d417a8b4733d1fc31162f/users/a8c65c0885f04b2fa70386345e17b1b1/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:19.738399 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:31:19.746465 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a1f2f6-6b62-4167-8be6-84627fb8d61a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9eef49c2f20d417a8b4733d1fc31162f, user_id=a8c65c0885f04b2fa70386345e17b1b1, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:19.746731 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-9e086ab3-dbaf-49bc-bb54-db28e98eb850 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c17d0272c13a4a35958e141d6571a627', 'request_id': 'req-9e086ab3-dbaf-49bc-bb54-db28e98eb850'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:19.749279 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a1f2f6-6b62-4167-8be6-84627fb8d61a admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:19.755491 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-9e086ab3-dbaf-49bc-bb54-db28e98eb850 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c17d0272c13a4a35958e141d6571a627', 'request_id': 'req-9e086ab3-dbaf-49bc-bb54-db28e98eb850'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:19.762845 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-9e086ab3-dbaf-49bc-bb54-db28e98eb850 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c17d0272c13a4a35958e141d6571a627', 'request_id': 'req-9e086ab3-dbaf-49bc-bb54-db28e98eb850'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:19.763010 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1126/2229] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:31:19 2022] PUT /identity/v3/projects/9eef49c2f20d417a8b4733d1fc31162f/users/a8c65c0885f04b2fa70386345e17b1b1/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 15:31:19.766747 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a1f2f6-6b62-4167-8be6-84627fb8d61a admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:19.773610 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-9e086ab3-dbaf-49bc-bb54-db28e98eb850 admin admin] The token cache is being invalidate because project c17d0272c13a4a35958e141d6571a627 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80360) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:31:19.773900 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-9e086ab3-dbaf-49bc-bb54-db28e98eb850 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:19.774567 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-9e086ab3-dbaf-49bc-bb54-db28e98eb850 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:19.776448 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1104/2230] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:31:19 2022] DELETE /identity/v3/projects/c17d0272c13a4a35958e141d6571a627 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 15:31:19.781508 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d79d5a-f31e-4984-8790-452210424c8b None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:19.781779 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d79d5a-f31e-4984-8790-452210424c8b None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:19.782065 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d79d5a-f31e-4984-8790-452210424c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:19.804785 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-e5d79d5a-f31e-4984-8790-452210424c8b None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:31:19.806035 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-e5d79d5a-f31e-4984-8790-452210424c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:19.842637 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a1f2f6-6b62-4167-8be6-84627fb8d61a admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:19.850192 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3465e0aa-a1f5-42b9-a350-274c05a0503e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:19.850826 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465e0aa-a1f5-42b9-a350-274c05a0503e admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:19.851110 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465e0aa-a1f5-42b9-a350-274c05a0503e admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:19.851440 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465e0aa-a1f5-42b9-a350-274c05a0503e admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:19.852141 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3465e0aa-a1f5-42b9-a350-274c05a0503e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:19.853786 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3465e0aa-a1f5-42b9-a350-274c05a0503e admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:19.868028 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1127/2231] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 15:31:19.870109 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3465e0aa-a1f5-42b9-a350-274c05a0503e admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:19.871858 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-3465e0aa-a1f5-42b9-a350-274c05a0503e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:19.885856 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3465e0aa-a1f5-42b9-a350-274c05a0503e admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:19.892095 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1105/2232] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:31:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:31:19.893315 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2253a764-4d5f-402f-9bf2-92baddee17db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:19.894831 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2253a764-4d5f-402f-9bf2-92baddee17db admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:19.894960 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2253a764-4d5f-402f-9bf2-92baddee17db admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:19.895199 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2253a764-4d5f-402f-9bf2-92baddee17db admin admin] PATH_INFO: `/v3/projects/9eef49c2f20d417a8b4733d1fc31162f/users/a8c65c0885f04b2fa70386345e17b1b1/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:19.898099 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2253a764-4d5f-402f-9bf2-92baddee17db admin admin] RBAC: Authorizing `identity:create_grant(project_id=9eef49c2f20d417a8b4733d1fc31162f, user_id=a8c65c0885f04b2fa70386345e17b1b1, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:19.900552 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2253a764-4d5f-402f-9bf2-92baddee17db admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:19.901237 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394625ea-26ba-47ae-ab67-701de7744926 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:19.901567 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394625ea-26ba-47ae-ab67-701de7744926 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:19.901865 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394625ea-26ba-47ae-ab67-701de7744926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:19.914792 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1128/2233] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:31:19 2022] PUT /identity/v3/projects/9eef49c2f20d417a8b4733d1fc31162f/users/a8c65c0885f04b2fa70386345e17b1b1/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:31:19.928161 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-394625ea-26ba-47ae-ab67-701de7744926 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:31:19.929381 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-394625ea-26ba-47ae-ab67-701de7744926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:20.006154 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1106/2234] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:31:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:31:20.011095 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2253a764-4d5f-402f-9bf2-92baddee17db admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:20.025405 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2253a764-4d5f-402f-9bf2-92baddee17db admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:20.031466 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e47e6-0263-4d4a-b7b3-1359a1f69503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:20.032117 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e47e6-0263-4d4a-b7b3-1359a1f69503 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:20.032395 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e47e6-0263-4d4a-b7b3-1359a1f69503 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:20.032771 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e47e6-0263-4d4a-b7b3-1359a1f69503 admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:20.033491 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499e47e6-0263-4d4a-b7b3-1359a1f69503 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:31:20.034090 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499e47e6-0263-4d4a-b7b3-1359a1f69503 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:20.036770 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499e47e6-0263-4d4a-b7b3-1359a1f69503 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:20.041067 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:31:20.061060 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1129/2235] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 2 15:31:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:31:20.062412 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394625ea-26ba-47ae-ab67-701de7744926 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:20.077342 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394625ea-26ba-47ae-ab67-701de7744926 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:20.083506 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800695b0-74e1-4111-97d9-dba77e6252df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:20.084371 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800695b0-74e1-4111-97d9-dba77e6252df admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:20.084657 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800695b0-74e1-4111-97d9-dba77e6252df admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:20.084938 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800695b0-74e1-4111-97d9-dba77e6252df admin admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:20.085624 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800695b0-74e1-4111-97d9-dba77e6252df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:20.088704 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800695b0-74e1-4111-97d9-dba77e6252df admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:20.134847 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1107/2236] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:31:20 2022] POST /identity/v3/projects => generated 371 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:31:20.139114 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e47e6-0263-4d4a-b7b3-1359a1f69503 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:20.182848 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e47e6-0263-4d4a-b7b3-1359a1f69503 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:20.299828 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0800fa4-3786-46e9-9898-cd55daa4fbb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:20.300707 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0800fa4-3786-46e9-9898-cd55daa4fbb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:20.301007 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0800fa4-3786-46e9-9898-cd55daa4fbb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:20.301334 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0800fa4-3786-46e9-9898-cd55daa4fbb1 admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:20.302457 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0800fa4-3786-46e9-9898-cd55daa4fbb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:20.304480 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0800fa4-3786-46e9-9898-cd55daa4fbb1 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:20.331252 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1130/2237] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:31:20 2022] POST /identity/v3/users => generated 286 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 15:31:20.332553 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800695b0-74e1-4111-97d9-dba77e6252df admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:20.344427 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800695b0-74e1-4111-97d9-dba77e6252df admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:20.350798 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429df7c-39a3-4469-ba97-023423392ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:20.351671 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429df7c-39a3-4469-ba97-023423392ab3 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:20.352111 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429df7c-39a3-4469-ba97-023423392ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:20.352720 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429df7c-39a3-4469-ba97-023423392ab3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:20.353443 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6429df7c-39a3-4469-ba97-023423392ab3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:20.355373 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6429df7c-39a3-4469-ba97-023423392ab3 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:20.369325 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1108/2238] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:31:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:31:20.370366 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0800fa4-3786-46e9-9898-cd55daa4fbb1 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:20.380726 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0800fa4-3786-46e9-9898-cd55daa4fbb1 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:20.386905 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a70beb-5625-429a-aa8d-7f1f9345a666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:20.387758 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a70beb-5625-429a-aa8d-7f1f9345a666 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:20.388324 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a70beb-5625-429a-aa8d-7f1f9345a666 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:20.388692 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a70beb-5625-429a-aa8d-7f1f9345a666 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:20.389636 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a70beb-5625-429a-aa8d-7f1f9345a666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:20.393560 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a70beb-5625-429a-aa8d-7f1f9345a666 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:20.407896 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1131/2239] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:31:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:31:20.412228 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429df7c-39a3-4469-ba97-023423392ab3 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:20.422954 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429df7c-39a3-4469-ba97-023423392ab3 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:20.428326 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c2d3d1-55d8-4089-9a44-a11ab1e04a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:20.429092 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c2d3d1-55d8-4089-9a44-a11ab1e04a60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:20.429450 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c2d3d1-55d8-4089-9a44-a11ab1e04a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:20.429825 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c2d3d1-55d8-4089-9a44-a11ab1e04a60 admin admin] PATH_INFO: `/v3/projects/d9b70c63fdf743cbb9609271545ea933/users/b63c233c9f5b4bfa8a6a834c769a2041/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:20.449786 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c2d3d1-55d8-4089-9a44-a11ab1e04a60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9b70c63fdf743cbb9609271545ea933, user_id=b63c233c9f5b4bfa8a6a834c769a2041, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:20.452796 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c2d3d1-55d8-4089-9a44-a11ab1e04a60 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:20.471046 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1109/2240] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:31:20 2022] PUT /identity/v3/projects/d9b70c63fdf743cbb9609271545ea933/users/b63c233c9f5b4bfa8a6a834c769a2041/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:31:20.481383 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df013e3-a1ce-4395-be31-f74996912410 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:20.481678 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df013e3-a1ce-4395-be31-f74996912410 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:20.482023 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df013e3-a1ce-4395-be31-f74996912410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:20.521385 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-2df013e3-a1ce-4395-be31-f74996912410 None None] MFA Rules not processed for user `b63c233c9f5b4bfa8a6a834c769a2041`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:31:20.522494 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-2df013e3-a1ce-4395-be31-f74996912410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:20.622184 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1132/2241] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:31:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:31:20.635984 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c2d3d1-55d8-4089-9a44-a11ab1e04a60 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:20.638087 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-e4c2d3d1-55d8-4089-9a44-a11ab1e04a60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:20.672677 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:31:20.757305 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c2d3d1-55d8-4089-9a44-a11ab1e04a60 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:20.766740 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10663af-32f0-4150-9912-af2b46d9e682 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0865af59bf43dfa4c84213d7db53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:20.767535 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10663af-32f0-4150-9912-af2b46d9e682 service nova] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:20.768203 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10663af-32f0-4150-9912-af2b46d9e682 service nova] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:20.768203 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10663af-32f0-4150-9912-af2b46d9e682 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:20.780387 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10663af-32f0-4150-9912-af2b46d9e682 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:20.782174 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10663af-32f0-4150-9912-af2b46d9e682 service nova] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:20.810133 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1110/2242] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:31:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:31:21.310197 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df013e3-a1ce-4395-be31-f74996912410 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:21.433679 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df013e3-a1ce-4395-be31-f74996912410 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:21.440494 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984d6c89-4c7a-4be3-9e4a-57e7d572680f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:21.441622 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d6c89-4c7a-4be3-9e4a-57e7d572680f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:21.442071 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d6c89-4c7a-4be3-9e4a-57e7d572680f admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:21.442415 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d6c89-4c7a-4be3-9e4a-57e7d572680f admin admin] PATH_INFO: `/v3/users/b63c233c9f5b4bfa8a6a834c769a2041` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:21.445191 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984d6c89-4c7a-4be3-9e4a-57e7d572680f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b63c233c9f5b4bfa8a6a834c769a2041)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:21.448461 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984d6c89-4c7a-4be3-9e4a-57e7d572680f admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:21.451838 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:31:21.518929 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-984d6c89-4c7a-4be3-9e4a-57e7d572680f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b63c233c9f5b4bfa8a6a834c769a2041'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:21.535908 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-984d6c89-4c7a-4be3-9e4a-57e7d572680f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b63c233c9f5b4bfa8a6a834c769a2041'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:21.537286 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-984d6c89-4c7a-4be3-9e4a-57e7d572680f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b63c233c9f5b4bfa8a6a834c769a2041'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:21.559108 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-984d6c89-4c7a-4be3-9e4a-57e7d572680f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b63c233c9f5b4bfa8a6a834c769a2041'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:21.575347 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-984d6c89-4c7a-4be3-9e4a-57e7d572680f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b63c233c9f5b4bfa8a6a834c769a2041'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:21.592773 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1133/2243] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:31:21 2022] DELETE /identity/v3/users/b63c233c9f5b4bfa8a6a834c769a2041 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 15:31:21.603012 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3c885-9a78-44db-b4ea-952d105284ce None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:21.603012 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3c885-9a78-44db-b4ea-952d105284ce None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:21.603012 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3c885-9a78-44db-b4ea-952d105284ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:21.633511 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-eba3c885-9a78-44db-b4ea-952d105284ce None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:31:21.634776 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-eba3c885-9a78-44db-b4ea-952d105284ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:21.780753 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1111/2244] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:31:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:31:21.806028 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984d6c89-4c7a-4be3-9e4a-57e7d572680f admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:21.808767 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-984d6c89-4c7a-4be3-9e4a-57e7d572680f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:21.992363 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984d6c89-4c7a-4be3-9e4a-57e7d572680f admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:21.997005 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a6e965-5117-43db-a820-8efa06f2c322 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:21.997637 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6e965-5117-43db-a820-8efa06f2c322 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:21.997919 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6e965-5117-43db-a820-8efa06f2c322 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:21.998194 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6e965-5117-43db-a820-8efa06f2c322 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:22.008877 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a6e965-5117-43db-a820-8efa06f2c322 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:22.010394 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a6e965-5117-43db-a820-8efa06f2c322 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:22.030785 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1134/2245] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:31:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:31:22.632133 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba3c885-9a78-44db-b4ea-952d105284ce None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:22.634522 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-eba3c885-9a78-44db-b4ea-952d105284ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:22.656469 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba3c885-9a78-44db-b4ea-952d105284ce None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:22.691313 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f480cd72-aee6-4e60-8c51-02c13e2eb090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:22.692347 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480cd72-aee6-4e60-8c51-02c13e2eb090 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:22.692851 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480cd72-aee6-4e60-8c51-02c13e2eb090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:22.693355 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480cd72-aee6-4e60-8c51-02c13e2eb090 admin admin] PATH_INFO: `/v3/projects/d9b70c63fdf743cbb9609271545ea933` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:22.706421 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f480cd72-aee6-4e60-8c51-02c13e2eb090 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9b70c63fdf743cbb9609271545ea933)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:22.708419 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f480cd72-aee6-4e60-8c51-02c13e2eb090 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:22.812049 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-f480cd72-aee6-4e60-8c51-02c13e2eb090 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9b70c63fdf743cbb9609271545ea933', 'request_id': 'req-f480cd72-aee6-4e60-8c51-02c13e2eb090'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:22.826122 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-f480cd72-aee6-4e60-8c51-02c13e2eb090 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9b70c63fdf743cbb9609271545ea933', 'request_id': 'req-f480cd72-aee6-4e60-8c51-02c13e2eb090'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:22.840242 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-f480cd72-aee6-4e60-8c51-02c13e2eb090 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9b70c63fdf743cbb9609271545ea933', 'request_id': 'req-f480cd72-aee6-4e60-8c51-02c13e2eb090'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:22.863724 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-f480cd72-aee6-4e60-8c51-02c13e2eb090 admin admin] The token cache is being invalidate because project d9b70c63fdf743cbb9609271545ea933 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80360) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:31:22.864030 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-f480cd72-aee6-4e60-8c51-02c13e2eb090 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:22.865634 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-f480cd72-aee6-4e60-8c51-02c13e2eb090 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:22.874997 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1112/2246] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:31:22 2022] DELETE /identity/v3/projects/d9b70c63fdf743cbb9609271545ea933 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:31:22.880127 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77fae2f-8736-464e-8b72-75d08aed569d None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:22.880656 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77fae2f-8736-464e-8b72-75d08aed569d None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:22.880749 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77fae2f-8736-464e-8b72-75d08aed569d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:22.919052 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-f77fae2f-8736-464e-8b72-75d08aed569d None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:31:22.923284 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-f77fae2f-8736-464e-8b72-75d08aed569d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:23.052619 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1135/2247] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:31:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:31:23.054263 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef56c6c1-6176-4e91-b770-75a3d4c243af None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:23.054719 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef56c6c1-6176-4e91-b770-75a3d4c243af None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:23.055009 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef56c6c1-6176-4e91-b770-75a3d4c243af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:23.083045 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-ef56c6c1-6176-4e91-b770-75a3d4c243af None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:31:23.084990 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-ef56c6c1-6176-4e91-b770-75a3d4c243af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:23.098542 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1113/2248] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:31:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:31:23.102984 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77fae2f-8736-464e-8b72-75d08aed569d None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:23.114701 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77fae2f-8736-464e-8b72-75d08aed569d None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:23.125199 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e5a28-3cd2-48d8-8026-2bae70242dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:23.125846 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e5a28-3cd2-48d8-8026-2bae70242dfa admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:23.126134 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e5a28-3cd2-48d8-8026-2bae70242dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:23.126414 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e5a28-3cd2-48d8-8026-2bae70242dfa admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:23.127126 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277e5a28-3cd2-48d8-8026-2bae70242dfa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:31:23.127518 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277e5a28-3cd2-48d8-8026-2bae70242dfa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:23.129192 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277e5a28-3cd2-48d8-8026-2bae70242dfa admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:23.163816 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef56c6c1-6176-4e91-b770-75a3d4c243af None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:23.165704 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1136/2249] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 2 15:31:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:31:23.188851 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef56c6c1-6176-4e91-b770-75a3d4c243af None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:23.208582 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd672e7-8726-49f4-befa-109d0ec33554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:23.209525 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd672e7-8726-49f4-befa-109d0ec33554 admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:23.209975 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd672e7-8726-49f4-befa-109d0ec33554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:23.210814 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd672e7-8726-49f4-befa-109d0ec33554 admin admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:23.211578 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd672e7-8726-49f4-befa-109d0ec33554 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:23.214810 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd672e7-8726-49f4-befa-109d0ec33554 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:23.251694 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:31:23.281054 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1114/2250] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:31:23 2022] POST /identity/v3/projects => generated 375 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:31:23.286000 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e5a28-3cd2-48d8-8026-2bae70242dfa admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:23.301408 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e5a28-3cd2-48d8-8026-2bae70242dfa admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:23.322936 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:31:23.396173 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac766c-c93b-4396-a78e-c336865d7b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:23.396671 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac766c-c93b-4396-a78e-c336865d7b0b admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:23.396957 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac766c-c93b-4396-a78e-c336865d7b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:23.397386 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac766c-c93b-4396-a78e-c336865d7b0b admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:23.398064 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ac766c-c93b-4396-a78e-c336865d7b0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:23.400059 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ac766c-c93b-4396-a78e-c336865d7b0b admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:23.441664 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1137/2251] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:31:23 2022] POST /identity/v3/users => generated 288 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:31:23.447159 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd672e7-8726-49f4-befa-109d0ec33554 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:23.463272 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd672e7-8726-49f4-befa-109d0ec33554 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:23.469679 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab01858-7f44-4c3c-b928-534361ded427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:23.470963 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab01858-7f44-4c3c-b928-534361ded427 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:23.471279 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab01858-7f44-4c3c-b928-534361ded427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:23.471734 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab01858-7f44-4c3c-b928-534361ded427 admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:23.472629 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab01858-7f44-4c3c-b928-534361ded427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:23.474262 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab01858-7f44-4c3c-b928-534361ded427 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:23.496203 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1115/2252] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:31:23.496674 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac766c-c93b-4396-a78e-c336865d7b0b admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:23.508798 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac766c-c93b-4396-a78e-c336865d7b0b admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:23.516597 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2703dd7d-bb17-40c5-9965-5c0f10533cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:23.517239 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2703dd7d-bb17-40c5-9965-5c0f10533cb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:23.517598 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2703dd7d-bb17-40c5-9965-5c0f10533cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:23.517860 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2703dd7d-bb17-40c5-9965-5c0f10533cb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:23.518627 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2703dd7d-bb17-40c5-9965-5c0f10533cb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:23.520475 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2703dd7d-bb17-40c5-9965-5c0f10533cb9 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:23.536855 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1138/2253] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:31:23.537848 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab01858-7f44-4c3c-b928-534361ded427 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:23.568012 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab01858-7f44-4c3c-b928-534361ded427 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:23.584595 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233717c2-00fc-42cc-b452-f729f58b6f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:23.585537 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233717c2-00fc-42cc-b452-f729f58b6f82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:23.585955 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233717c2-00fc-42cc-b452-f729f58b6f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:23.586496 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233717c2-00fc-42cc-b452-f729f58b6f82 admin admin] PATH_INFO: `/v3/projects/4ff38d10ea954f33be99ed18f3e4902c/users/c5f4cbb0d2984f5998057cf1f1dae13e/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:23.615703 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233717c2-00fc-42cc-b452-f729f58b6f82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ff38d10ea954f33be99ed18f3e4902c, user_id=c5f4cbb0d2984f5998057cf1f1dae13e, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:23.619280 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233717c2-00fc-42cc-b452-f729f58b6f82 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:23.649657 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1116/2254] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:31:23 2022] PUT /identity/v3/projects/4ff38d10ea954f33be99ed18f3e4902c/users/c5f4cbb0d2984f5998057cf1f1dae13e/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 15:31:23.663853 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce973f44-2b4b-4c21-b08f-fa689df87245 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:23.664857 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce973f44-2b4b-4c21-b08f-fa689df87245 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:23.665150 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce973f44-2b4b-4c21-b08f-fa689df87245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:23.710785 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-ce973f44-2b4b-4c21-b08f-fa689df87245 None None] MFA Rules not processed for user `c5f4cbb0d2984f5998057cf1f1dae13e`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:31:23.712252 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-ce973f44-2b4b-4c21-b08f-fa689df87245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:23.824794 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1139/2255] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:31:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:31:23.829268 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233717c2-00fc-42cc-b452-f729f58b6f82 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:23.977274 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233717c2-00fc-42cc-b452-f729f58b6f82 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:23.989708 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ae47f-1d32-430f-b5ef-131fbc01b6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:23.990866 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ae47f-1d32-430f-b5ef-131fbc01b6b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:23.991436 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ae47f-1d32-430f-b5ef-131fbc01b6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:23.991934 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ae47f-1d32-430f-b5ef-131fbc01b6b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:23.992813 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84ae47f-1d32-430f-b5ef-131fbc01b6b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:23.995344 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84ae47f-1d32-430f-b5ef-131fbc01b6b1 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:24.042752 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1117/2256] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:31:23 2022] POST /identity/v3/projects => generated 375 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:31:24.047117 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce973f44-2b4b-4c21-b08f-fa689df87245 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:24.059582 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce973f44-2b4b-4c21-b08f-fa689df87245 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:24.153805 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd790e7e-60e1-4988-85e8-de8366b12d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:24.154583 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd790e7e-60e1-4988-85e8-de8366b12d92 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:24.154922 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd790e7e-60e1-4988-85e8-de8366b12d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:24.155199 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd790e7e-60e1-4988-85e8-de8366b12d92 admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:24.156071 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd790e7e-60e1-4988-85e8-de8366b12d92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:24.158226 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd790e7e-60e1-4988-85e8-de8366b12d92 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:24.184844 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1140/2257] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:31:24 2022] POST /identity/v3/users => generated 294 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:31:24.188739 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ae47f-1d32-430f-b5ef-131fbc01b6b1 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:24.200748 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ae47f-1d32-430f-b5ef-131fbc01b6b1 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:24.210490 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf6fba4-6ec3-422c-88fb-ffe2731b2219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:24.211266 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6fba4-6ec3-422c-88fb-ffe2731b2219 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:24.211994 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6fba4-6ec3-422c-88fb-ffe2731b2219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:24.212158 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6fba4-6ec3-422c-88fb-ffe2731b2219 admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:24.212931 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf6fba4-6ec3-422c-88fb-ffe2731b2219 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:24.214921 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf6fba4-6ec3-422c-88fb-ffe2731b2219 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:24.231268 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1118/2258] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:31:24 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:31:24.234066 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd790e7e-60e1-4988-85e8-de8366b12d92 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:24.249991 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd790e7e-60e1-4988-85e8-de8366b12d92 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:24.256887 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d4785a-63e9-46a8-b49b-2640358cb243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:24.258585 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4785a-63e9-46a8-b49b-2640358cb243 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:24.258585 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4785a-63e9-46a8-b49b-2640358cb243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:24.258729 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4785a-63e9-46a8-b49b-2640358cb243 admin admin] PATH_INFO: `/v3/projects/0110950506e848c29e11648fa49ace04/users/1d6b9ee48d704416a53eacd49dc73d41/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:24.263125 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:31:24.283469 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d4785a-63e9-46a8-b49b-2640358cb243 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0110950506e848c29e11648fa49ace04, user_id=1d6b9ee48d704416a53eacd49dc73d41, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:24.286085 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d4785a-63e9-46a8-b49b-2640358cb243 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:24.313866 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1141/2259] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:31:24 2022] PUT /identity/v3/projects/0110950506e848c29e11648fa49ace04/users/1d6b9ee48d704416a53eacd49dc73d41/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 15:31:24.318075 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf6fba4-6ec3-422c-88fb-ffe2731b2219 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:24.332085 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf6fba4-6ec3-422c-88fb-ffe2731b2219 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:24.406974 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b115df83-cf8a-45b1-b9e7-27a3e67f9498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:24.407875 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115df83-cf8a-45b1-b9e7-27a3e67f9498 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:24.408239 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115df83-cf8a-45b1-b9e7-27a3e67f9498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:24.408586 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115df83-cf8a-45b1-b9e7-27a3e67f9498 admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:24.409504 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b115df83-cf8a-45b1-b9e7-27a3e67f9498 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:24.411327 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b115df83-cf8a-45b1-b9e7-27a3e67f9498 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:24.430779 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1119/2260] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:31:24 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:31:24.436195 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d4785a-63e9-46a8-b49b-2640358cb243 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:24.451982 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d4785a-63e9-46a8-b49b-2640358cb243 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:24.462141 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed3d936-514c-479b-b537-61e633f8acbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:24.462840 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3d936-514c-479b-b537-61e633f8acbf admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:24.463205 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3d936-514c-479b-b537-61e633f8acbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:24.463579 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3d936-514c-479b-b537-61e633f8acbf admin admin] PATH_INFO: `/v3/projects/0110950506e848c29e11648fa49ace04/users/1d6b9ee48d704416a53eacd49dc73d41/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:24.466665 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed3d936-514c-479b-b537-61e633f8acbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=0110950506e848c29e11648fa49ace04, user_id=1d6b9ee48d704416a53eacd49dc73d41, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:24.471435 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed3d936-514c-479b-b537-61e633f8acbf admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:24.494085 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1142/2261] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:31:24 2022] PUT /identity/v3/projects/0110950506e848c29e11648fa49ace04/users/1d6b9ee48d704416a53eacd49dc73d41/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:31:24.504909 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398285d-55a3-4548-aa79-7a4d9807f646 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:24.505514 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398285d-55a3-4548-aa79-7a4d9807f646 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:24.505870 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398285d-55a3-4548-aa79-7a4d9807f646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:24.539689 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-2398285d-55a3-4548-aa79-7a4d9807f646 None None] MFA Rules not processed for user `1d6b9ee48d704416a53eacd49dc73d41`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:31:24.541757 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-2398285d-55a3-4548-aa79-7a4d9807f646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:24.563979 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:31:24.646358 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1120/2262] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:31:24 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:31:24.658071 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed3d936-514c-479b-b537-61e633f8acbf admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:24.660253 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-9ed3d936-514c-479b-b537-61e633f8acbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:24.736673 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed3d936-514c-479b-b537-61e633f8acbf admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:24.742270 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f4ec6a-7583-4ec3-8cd6-d7194cf44752 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:24.743102 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4ec6a-7583-4ec3-8cd6-d7194cf44752 service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:24.743560 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4ec6a-7583-4ec3-8cd6-d7194cf44752 service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:24.744027 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4ec6a-7583-4ec3-8cd6-d7194cf44752 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:24.826058 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f4ec6a-7583-4ec3-8cd6-d7194cf44752 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:24.828081 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f4ec6a-7583-4ec3-8cd6-d7194cf44752 service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:24.840881 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1143/2263] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:31:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:31:25.676550 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e951b-d091-40d9-8e18-9303fd8ea4b2 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:25.676997 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e951b-d091-40d9-8e18-9303fd8ea4b2 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:25.677095 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e951b-d091-40d9-8e18-9303fd8ea4b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:25.712363 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-260e951b-d091-40d9-8e18-9303fd8ea4b2 None None] MFA Rules not processed for user `a8c65c0885f04b2fa70386345e17b1b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:31:25.713550 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-260e951b-d091-40d9-8e18-9303fd8ea4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:25.796480 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1121/2264] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:31:25 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:31:25.811013 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f4ec6a-7583-4ec3-8cd6-d7194cf44752 service cinder] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:25.812562 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-d5f4ec6a-7583-4ec3-8cd6-d7194cf44752 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:25.914007 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f4ec6a-7583-4ec3-8cd6-d7194cf44752 service cinder] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:25.921477 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a67a25-4c1c-4d35-a6dc-ac16d94aa2f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0865af59bf43dfa4c84213d7db53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:25.921939 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a67a25-4c1c-4d35-a6dc-ac16d94aa2f3 service nova] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:25.922227 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a67a25-4c1c-4d35-a6dc-ac16d94aa2f3 service nova] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:25.924196 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a67a25-4c1c-4d35-a6dc-ac16d94aa2f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:25.924476 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-62a67a25-4c1c-4d35-a6dc-ac16d94aa2f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:25.961440 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:31:26.013191 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a67a25-4c1c-4d35-a6dc-ac16d94aa2f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:26.013191 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a67a25-4c1c-4d35-a6dc-ac16d94aa2f3 service nova] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:26.033511 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1144/2265] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:31:25 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:31:27.346933 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e951b-d091-40d9-8e18-9303fd8ea4b2 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:27.349008 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-260e951b-d091-40d9-8e18-9303fd8ea4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:27.470542 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e951b-d091-40d9-8e18-9303fd8ea4b2 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:27.485397 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3526f2c-f4f1-45b4-a1b4-ed79684b7954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:27.486093 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3526f2c-f4f1-45b4-a1b4-ed79684b7954 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:27.486780 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3526f2c-f4f1-45b4-a1b4-ed79684b7954 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:27.487208 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3526f2c-f4f1-45b4-a1b4-ed79684b7954 admin admin] PATH_INFO: `/v3/users/0d9c08085375447d854b2865eb94c3bf` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:27.488479 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3526f2c-f4f1-45b4-a1b4-ed79684b7954 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d9c08085375447d854b2865eb94c3bf)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:27.490670 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3526f2c-f4f1-45b4-a1b4-ed79684b7954 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:27.567207 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:31:27.581049 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-e3526f2c-f4f1-45b4-a1b4-ed79684b7954 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d9c08085375447d854b2865eb94c3bf'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:27.606270 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79eea3-3b0c-4382-8ce6-b5906b065a6b None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:27.609907 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79eea3-3b0c-4382-8ce6-b5906b065a6b None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:27.610190 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79eea3-3b0c-4382-8ce6-b5906b065a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:27.613763 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-e3526f2c-f4f1-45b4-a1b4-ed79684b7954 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d9c08085375447d854b2865eb94c3bf'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:27.643297 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-4b79eea3-3b0c-4382-8ce6-b5906b065a6b None None] MFA Rules not processed for user `2802f9cc5f2044abafe63cb8c2d51864`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:31:27.645023 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-4b79eea3-3b0c-4382-8ce6-b5906b065a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:27.646492 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-e3526f2c-f4f1-45b4-a1b4-ed79684b7954 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d9c08085375447d854b2865eb94c3bf'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:27.647751 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-e3526f2c-f4f1-45b4-a1b4-ed79684b7954 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d9c08085375447d854b2865eb94c3bf'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:27.648428 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-e3526f2c-f4f1-45b4-a1b4-ed79684b7954 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d9c08085375447d854b2865eb94c3bf'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:27.653474 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1145/2266] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:31:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:31:27.672451 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1122/2267] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:31:27 2022] DELETE /identity/v3/users/0d9c08085375447d854b2865eb94c3bf => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:31:27.677065 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341c9bb-cbdc-49e7-a1c1-346109f5f3f9 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:27.677352 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341c9bb-cbdc-49e7-a1c1-346109f5f3f9 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:27.677667 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341c9bb-cbdc-49e7-a1c1-346109f5f3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:27.698754 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-3341c9bb-cbdc-49e7-a1c1-346109f5f3f9 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:31:27.700270 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-3341c9bb-cbdc-49e7-a1c1-346109f5f3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:27.784945 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1146/2268] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:31:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:31:27.799556 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3526f2c-f4f1-45b4-a1b4-ed79684b7954 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:27.800970 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-e3526f2c-f4f1-45b4-a1b4-ed79684b7954 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:27.873762 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3526f2c-f4f1-45b4-a1b4-ed79684b7954 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:27.877741 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e7e6c-589c-4194-9909-4ef50faff609 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:27.878529 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e7e6c-589c-4194-9909-4ef50faff609 service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:27.878820 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e7e6c-589c-4194-9909-4ef50faff609 service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:27.879099 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e7e6c-589c-4194-9909-4ef50faff609 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:27.893760 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698e7e6c-589c-4194-9909-4ef50faff609 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:27.895130 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698e7e6c-589c-4194-9909-4ef50faff609 service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:27.907609 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1123/2269] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:31:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:31:28.190385 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3341c9bb-cbdc-49e7-a1c1-346109f5f3f9 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:28.191908 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-3341c9bb-cbdc-49e7-a1c1-346109f5f3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:28.207144 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3341c9bb-cbdc-49e7-a1c1-346109f5f3f9 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:28.211889 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e05aa67-a54b-4c37-875a-e4e9cd1b28b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:28.212553 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e05aa67-a54b-4c37-875a-e4e9cd1b28b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:28.212834 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e05aa67-a54b-4c37-875a-e4e9cd1b28b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:28.213312 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e05aa67-a54b-4c37-875a-e4e9cd1b28b7 admin admin] PATH_INFO: `/v3/projects/3ddf50e8b48340bd89092e6a392bcaad` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:28.215266 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e05aa67-a54b-4c37-875a-e4e9cd1b28b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ddf50e8b48340bd89092e6a392bcaad)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:28.217403 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e05aa67-a54b-4c37-875a-e4e9cd1b28b7 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:28.273313 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-0e05aa67-a54b-4c37-875a-e4e9cd1b28b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ddf50e8b48340bd89092e6a392bcaad', 'request_id': 'req-0e05aa67-a54b-4c37-875a-e4e9cd1b28b7'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:28.281984 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-0e05aa67-a54b-4c37-875a-e4e9cd1b28b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ddf50e8b48340bd89092e6a392bcaad', 'request_id': 'req-0e05aa67-a54b-4c37-875a-e4e9cd1b28b7'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:28.289231 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-0e05aa67-a54b-4c37-875a-e4e9cd1b28b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ddf50e8b48340bd89092e6a392bcaad', 'request_id': 'req-0e05aa67-a54b-4c37-875a-e4e9cd1b28b7'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:28.300236 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-0e05aa67-a54b-4c37-875a-e4e9cd1b28b7 admin admin] The token cache is being invalidate because project 3ddf50e8b48340bd89092e6a392bcaad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:31:28.300564 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-0e05aa67-a54b-4c37-875a-e4e9cd1b28b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:28.301196 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-0e05aa67-a54b-4c37-875a-e4e9cd1b28b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:28.302841 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1147/2270] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:31:28 2022] DELETE /identity/v3/projects/3ddf50e8b48340bd89092e6a392bcaad => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:31:28.307058 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e7e6c-589c-4194-9909-4ef50faff609 service neutron] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:28.316894 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e7e6c-589c-4194-9909-4ef50faff609 service neutron] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:28.373653 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b6495-7169-45e7-a051-88aaa40be7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:28.374350 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b6495-7169-45e7-a051-88aaa40be7fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:28.374567 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b6495-7169-45e7-a051-88aaa40be7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:28.374842 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b6495-7169-45e7-a051-88aaa40be7fd admin admin] PATH_INFO: `/v3/users/59f4d820eba44316800516a731f313d6` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:28.376041 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28b6495-7169-45e7-a051-88aaa40be7fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=59f4d820eba44316800516a731f313d6)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:28.377942 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28b6495-7169-45e7-a051-88aaa40be7fd admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:28.429220 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-d28b6495-7169-45e7-a051-88aaa40be7fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59f4d820eba44316800516a731f313d6'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:28.436347 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-d28b6495-7169-45e7-a051-88aaa40be7fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59f4d820eba44316800516a731f313d6'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:28.441602 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:31:28.450392 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-d28b6495-7169-45e7-a051-88aaa40be7fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59f4d820eba44316800516a731f313d6'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:28.451209 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-d28b6495-7169-45e7-a051-88aaa40be7fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59f4d820eba44316800516a731f313d6'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:28.451953 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-d28b6495-7169-45e7-a051-88aaa40be7fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59f4d820eba44316800516a731f313d6'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:28.465777 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1124/2271] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:31:28 2022] DELETE /identity/v3/users/59f4d820eba44316800516a731f313d6 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 15:31:28.743632 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e05aa67-a54b-4c37-875a-e4e9cd1b28b7 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:28.745578 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-0e05aa67-a54b-4c37-875a-e4e9cd1b28b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:28.759106 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e05aa67-a54b-4c37-875a-e4e9cd1b28b7 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:28.810661 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:31:28.832757 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff8861-2390-4b40-b6b2-a57acbec1915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:28.833421 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff8861-2390-4b40-b6b2-a57acbec1915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:28.833703 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff8861-2390-4b40-b6b2-a57acbec1915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:28.833975 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff8861-2390-4b40-b6b2-a57acbec1915 admin admin] PATH_INFO: `/v3/projects/c119e8edf085459989052addb1acd396` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:28.835117 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ff8861-2390-4b40-b6b2-a57acbec1915 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c119e8edf085459989052addb1acd396)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:28.837040 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ff8861-2390-4b40-b6b2-a57acbec1915 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:28.882506 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-14ff8861-2390-4b40-b6b2-a57acbec1915 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c119e8edf085459989052addb1acd396', 'request_id': 'req-14ff8861-2390-4b40-b6b2-a57acbec1915'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:28.890068 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-14ff8861-2390-4b40-b6b2-a57acbec1915 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c119e8edf085459989052addb1acd396', 'request_id': 'req-14ff8861-2390-4b40-b6b2-a57acbec1915'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:28.896160 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-14ff8861-2390-4b40-b6b2-a57acbec1915 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c119e8edf085459989052addb1acd396', 'request_id': 'req-14ff8861-2390-4b40-b6b2-a57acbec1915'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:28.907911 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-14ff8861-2390-4b40-b6b2-a57acbec1915 admin admin] The token cache is being invalidate because project c119e8edf085459989052addb1acd396 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:31:28.908208 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-14ff8861-2390-4b40-b6b2-a57acbec1915 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:28.909044 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-14ff8861-2390-4b40-b6b2-a57acbec1915 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:28.910572 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1148/2272] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:31:28 2022] DELETE /identity/v3/projects/c119e8edf085459989052addb1acd396 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:31:28.915501 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390689b9-aee7-494d-bead-83479b1fe3f3 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:28.915789 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390689b9-aee7-494d-bead-83479b1fe3f3 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:28.916090 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390689b9-aee7-494d-bead-83479b1fe3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:28.937274 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-390689b9-aee7-494d-bead-83479b1fe3f3 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:31:28.938416 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-390689b9-aee7-494d-bead-83479b1fe3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:29.000648 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1125/2273] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:31:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:31:29.009472 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24888975-1682-431b-a27c-1f76d98c4971 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:29.009756 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24888975-1682-431b-a27c-1f76d98c4971 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:29.010068 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24888975-1682-431b-a27c-1f76d98c4971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:29.029551 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-24888975-1682-431b-a27c-1f76d98c4971 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:31:29.030753 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-24888975-1682-431b-a27c-1f76d98c4971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:29.038540 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1149/2274] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:31:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:31:29.043382 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390689b9-aee7-494d-bead-83479b1fe3f3 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:29.053277 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390689b9-aee7-494d-bead-83479b1fe3f3 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:29.058712 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49226f6a-eb70-4127-a646-b4d16325f831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:29.059365 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49226f6a-eb70-4127-a646-b4d16325f831 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:29.059645 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49226f6a-eb70-4127-a646-b4d16325f831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:29.059918 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49226f6a-eb70-4127-a646-b4d16325f831 admin admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:29.060600 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49226f6a-eb70-4127-a646-b4d16325f831 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:31:29.060903 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49226f6a-eb70-4127-a646-b4d16325f831 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:29.062514 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49226f6a-eb70-4127-a646-b4d16325f831 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:29.074080 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1126/2275] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 2 15:31:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:31:29.078262 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24888975-1682-431b-a27c-1f76d98c4971 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:29.087497 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24888975-1682-431b-a27c-1f76d98c4971 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:29.092269 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd5530e-4076-4164-8d7d-19ac8e4d74c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:29.092872 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5530e-4076-4164-8d7d-19ac8e4d74c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:29.093152 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5530e-4076-4164-8d7d-19ac8e4d74c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:29.093426 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5530e-4076-4164-8d7d-19ac8e4d74c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:29.094112 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd5530e-4076-4164-8d7d-19ac8e4d74c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:29.096106 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd5530e-4076-4164-8d7d-19ac8e4d74c1 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:29.124457 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1150/2276] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:31:29 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:31:29.128556 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49226f6a-eb70-4127-a646-b4d16325f831 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:29.138795 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49226f6a-eb70-4127-a646-b4d16325f831 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:29.198690 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f0d327-c11d-4332-afb0-ea6a60a5ec27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:29.199098 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0d327-c11d-4332-afb0-ea6a60a5ec27 admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:29.199588 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0d327-c11d-4332-afb0-ea6a60a5ec27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:29.199870 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0d327-c11d-4332-afb0-ea6a60a5ec27 admin admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:29.200564 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f0d327-c11d-4332-afb0-ea6a60a5ec27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:29.202499 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f0d327-c11d-4332-afb0-ea6a60a5ec27 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:29.225347 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1127/2277] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:31:29 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 15:31:29.230120 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd5530e-4076-4164-8d7d-19ac8e4d74c1 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:29.241142 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd5530e-4076-4164-8d7d-19ac8e4d74c1 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:29.246984 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e641d04d-56ef-4a57-9b4c-41a3d56dbc07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:29.247640 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641d04d-56ef-4a57-9b4c-41a3d56dbc07 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:29.247927 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641d04d-56ef-4a57-9b4c-41a3d56dbc07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:29.248206 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641d04d-56ef-4a57-9b4c-41a3d56dbc07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:29.248908 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e641d04d-56ef-4a57-9b4c-41a3d56dbc07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:29.250555 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e641d04d-56ef-4a57-9b4c-41a3d56dbc07 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:29.263294 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1151/2278] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:31:29.267304 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f0d327-c11d-4332-afb0-ea6a60a5ec27 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:29.277397 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f0d327-c11d-4332-afb0-ea6a60a5ec27 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:29.282102 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5808c-cb50-43e1-8485-ba291850b96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:29.282710 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5808c-cb50-43e1-8485-ba291850b96d admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:29.282993 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5808c-cb50-43e1-8485-ba291850b96d admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:29.283313 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5808c-cb50-43e1-8485-ba291850b96d admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:29.284030 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab5808c-cb50-43e1-8485-ba291850b96d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:29.285621 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab5808c-cb50-43e1-8485-ba291850b96d admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:29.297006 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1128/2279] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:31:29.301274 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e641d04d-56ef-4a57-9b4c-41a3d56dbc07 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:29.311807 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e641d04d-56ef-4a57-9b4c-41a3d56dbc07 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:29.316394 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c6c86a-4fe4-44a3-8c2f-1ebcbd7b0230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:29.317044 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6c86a-4fe4-44a3-8c2f-1ebcbd7b0230 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:29.317319 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6c86a-4fe4-44a3-8c2f-1ebcbd7b0230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:29.317597 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6c86a-4fe4-44a3-8c2f-1ebcbd7b0230 admin admin] PATH_INFO: `/v3/projects/2ea01e42fb794285bdf94faa38ef7168/users/19af8152b54d4ac5be90c46ad92ce859/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:29.331932 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c6c86a-4fe4-44a3-8c2f-1ebcbd7b0230 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ea01e42fb794285bdf94faa38ef7168, user_id=19af8152b54d4ac5be90c46ad92ce859, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:29.334568 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c6c86a-4fe4-44a3-8c2f-1ebcbd7b0230 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:29.348818 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1152/2280] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:31:29 2022] PUT /identity/v3/projects/2ea01e42fb794285bdf94faa38ef7168/users/19af8152b54d4ac5be90c46ad92ce859/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:31:29.359823 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd36dec-5cc0-49ec-9ac0-8e32a5ff84cb None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:29.360124 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd36dec-5cc0-49ec-9ac0-8e32a5ff84cb None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:29.360403 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd36dec-5cc0-49ec-9ac0-8e32a5ff84cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:29.387780 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-5fd36dec-5cc0-49ec-9ac0-8e32a5ff84cb None None] MFA Rules not processed for user `19af8152b54d4ac5be90c46ad92ce859`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:31:29.389006 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-5fd36dec-5cc0-49ec-9ac0-8e32a5ff84cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:29.425788 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:31:29.460479 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1129/2281] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:31:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:31:29.471656 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c6c86a-4fe4-44a3-8c2f-1ebcbd7b0230 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:29.473500 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-70c6c86a-4fe4-44a3-8c2f-1ebcbd7b0230 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:29.534879 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c6c86a-4fe4-44a3-8c2f-1ebcbd7b0230 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:29.538598 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd99932-d99d-428e-8526-5279903f128e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:29.539230 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd99932-d99d-428e-8526-5279903f128e service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:29.539535 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd99932-d99d-428e-8526-5279903f128e service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:29.539819 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd99932-d99d-428e-8526-5279903f128e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:29.549600 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd99932-d99d-428e-8526-5279903f128e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:29.551090 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd99932-d99d-428e-8526-5279903f128e service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:29.560315 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1153/2282] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:31:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:31:30.939180 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd36dec-5cc0-49ec-9ac0-8e32a5ff84cb None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:30.949052 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd36dec-5cc0-49ec-9ac0-8e32a5ff84cb None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:30.952679 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db9d5c-a7d6-4f16-8a4a-6502c764de7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:30.953297 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db9d5c-a7d6-4f16-8a4a-6502c764de7f service cinder] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:30.953581 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db9d5c-a7d6-4f16-8a4a-6502c764de7f service cinder] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:30.953856 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db9d5c-a7d6-4f16-8a4a-6502c764de7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:30.956095 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-a8db9d5c-a7d6-4f16-8a4a-6502c764de7f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:31.038511 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8db9d5c-a7d6-4f16-8a4a-6502c764de7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:31.039905 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8db9d5c-a7d6-4f16-8a4a-6502c764de7f service cinder] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:31.050686 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1130/2283] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:31:30 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:31:36.555332 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd99932-d99d-428e-8526-5279903f128e service cinder] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:36.569691 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:31:36.628389 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd99932-d99d-428e-8526-5279903f128e service cinder] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:36.633252 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d5f9e-dbba-4aa2-ba00-95bb5734a341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:36.633916 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d5f9e-dbba-4aa2-ba00-95bb5734a341 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:36.634199 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d5f9e-dbba-4aa2-ba00-95bb5734a341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:36.634478 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d5f9e-dbba-4aa2-ba00-95bb5734a341 admin admin] PATH_INFO: `/v3/users/19af8152b54d4ac5be90c46ad92ce859` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:36.635768 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1d5f9e-dbba-4aa2-ba00-95bb5734a341 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19af8152b54d4ac5be90c46ad92ce859)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:36.637785 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1d5f9e-dbba-4aa2-ba00-95bb5734a341 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:36.691098 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-5d1d5f9e-dbba-4aa2-ba00-95bb5734a341 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19af8152b54d4ac5be90c46ad92ce859'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:36.705093 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-5d1d5f9e-dbba-4aa2-ba00-95bb5734a341 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19af8152b54d4ac5be90c46ad92ce859'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:36.705825 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-5d1d5f9e-dbba-4aa2-ba00-95bb5734a341 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19af8152b54d4ac5be90c46ad92ce859'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:36.712695 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-5d1d5f9e-dbba-4aa2-ba00-95bb5734a341 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19af8152b54d4ac5be90c46ad92ce859'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:36.720374 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-5d1d5f9e-dbba-4aa2-ba00-95bb5734a341 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19af8152b54d4ac5be90c46ad92ce859'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:36.726574 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1154/2284] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:31:36 2022] DELETE /identity/v3/users/19af8152b54d4ac5be90c46ad92ce859 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:31:36.732104 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e338c-598e-4120-9493-c2a5da3cd955 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:36.732567 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e338c-598e-4120-9493-c2a5da3cd955 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:36.732658 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e338c-598e-4120-9493-c2a5da3cd955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:36.755558 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-9f0e338c-598e-4120-9493-c2a5da3cd955 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:31:36.756840 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-9f0e338c-598e-4120-9493-c2a5da3cd955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:36.777426 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d5f9e-dbba-4aa2-ba00-95bb5734a341 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:36.779175 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-5d1d5f9e-dbba-4aa2-ba00-95bb5734a341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:36.824484 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1131/2285] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:31:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:31:36.836858 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e338c-598e-4120-9493-c2a5da3cd955 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:36.838850 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-9f0e338c-598e-4120-9493-c2a5da3cd955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:36.857835 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d5f9e-dbba-4aa2-ba00-95bb5734a341 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:36.864231 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5bf9b9-bebb-42eb-85e8-e6ac66a34bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:36.868216 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bf9b9-bebb-42eb-85e8-e6ac66a34bf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:36.871602 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bf9b9-bebb-42eb-85e8-e6ac66a34bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:36.871961 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bf9b9-bebb-42eb-85e8-e6ac66a34bf4 admin admin] PATH_INFO: `/v3/users/5945ee6ff83c44f0b3985156702d137f` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:36.875817 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5bf9b9-bebb-42eb-85e8-e6ac66a34bf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5945ee6ff83c44f0b3985156702d137f)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:36.878245 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5bf9b9-bebb-42eb-85e8-e6ac66a34bf4 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:36.913861 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e338c-598e-4120-9493-c2a5da3cd955 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:36.918810 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec405e7-e0a5-4ecd-89e6-2b6ea01767a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:36.919693 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec405e7-e0a5-4ecd-89e6-2b6ea01767a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:36.920107 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec405e7-e0a5-4ecd-89e6-2b6ea01767a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:36.920532 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec405e7-e0a5-4ecd-89e6-2b6ea01767a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:36.932841 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:31:36.935912 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec405e7-e0a5-4ecd-89e6-2b6ea01767a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:36.937401 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec405e7-e0a5-4ecd-89e6-2b6ea01767a0 service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:36.951027 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1132/2286] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:31:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 15:31:36.955253 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-3f5bf9b9-bebb-42eb-85e8-e6ac66a34bf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5945ee6ff83c44f0b3985156702d137f'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:36.972551 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-3f5bf9b9-bebb-42eb-85e8-e6ac66a34bf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5945ee6ff83c44f0b3985156702d137f'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:36.973397 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-3f5bf9b9-bebb-42eb-85e8-e6ac66a34bf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5945ee6ff83c44f0b3985156702d137f'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:36.988516 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-3f5bf9b9-bebb-42eb-85e8-e6ac66a34bf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5945ee6ff83c44f0b3985156702d137f'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:37.011794 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-3f5bf9b9-bebb-42eb-85e8-e6ac66a34bf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5945ee6ff83c44f0b3985156702d137f'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:37.025148 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1155/2287] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:31:36 2022] DELETE /identity/v3/users/5945ee6ff83c44f0b3985156702d137f => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 15:31:37.026385 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49dd1bf-c3fb-41c7-9f35-83ca140b933c None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:37.026680 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49dd1bf-c3fb-41c7-9f35-83ca140b933c None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:37.026979 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49dd1bf-c3fb-41c7-9f35-83ca140b933c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:37.061782 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-d49dd1bf-c3fb-41c7-9f35-83ca140b933c None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:31:37.063034 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-d49dd1bf-c3fb-41c7-9f35-83ca140b933c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:37.074269 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:31:37.204121 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1133/2288] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:31:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:31:37.219931 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5bf9b9-bebb-42eb-85e8-e6ac66a34bf4 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:37.221792 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-3f5bf9b9-bebb-42eb-85e8-e6ac66a34bf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:37.310869 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49dd1bf-c3fb-41c7-9f35-83ca140b933c None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:37.314935 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-d49dd1bf-c3fb-41c7-9f35-83ca140b933c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:37.344082 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49dd1bf-c3fb-41c7-9f35-83ca140b933c None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:37.347452 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5bf9b9-bebb-42eb-85e8-e6ac66a34bf4 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:37.353576 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf200ff4-2100-4411-b9a7-7a5143cd01a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:37.354463 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46935c56-4161-4ac1-a145-c52f486e726a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:37.354961 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf200ff4-2100-4411-b9a7-7a5143cd01a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:37.355349 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf200ff4-2100-4411-b9a7-7a5143cd01a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:37.355546 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46935c56-4161-4ac1-a145-c52f486e726a service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:37.355837 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46935c56-4161-4ac1-a145-c52f486e726a service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:37.356032 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf200ff4-2100-4411-b9a7-7a5143cd01a2 admin admin] PATH_INFO: `/v3/projects/2ea01e42fb794285bdf94faa38ef7168` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:37.356170 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46935c56-4161-4ac1-a145-c52f486e726a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:37.357493 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf200ff4-2100-4411-b9a7-7a5143cd01a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ea01e42fb794285bdf94faa38ef7168)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:37.360356 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf200ff4-2100-4411-b9a7-7a5143cd01a2 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:37.369576 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46935c56-4161-4ac1-a145-c52f486e726a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:37.375805 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46935c56-4161-4ac1-a145-c52f486e726a service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:37.403643 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1156/2289] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:31:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:31:37.454438 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-bf200ff4-2100-4411-b9a7-7a5143cd01a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ea01e42fb794285bdf94faa38ef7168', 'request_id': 'req-bf200ff4-2100-4411-b9a7-7a5143cd01a2'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:37.465911 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-bf200ff4-2100-4411-b9a7-7a5143cd01a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ea01e42fb794285bdf94faa38ef7168', 'request_id': 'req-bf200ff4-2100-4411-b9a7-7a5143cd01a2'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:37.480205 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-bf200ff4-2100-4411-b9a7-7a5143cd01a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ea01e42fb794285bdf94faa38ef7168', 'request_id': 'req-bf200ff4-2100-4411-b9a7-7a5143cd01a2'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:37.493458 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-bf200ff4-2100-4411-b9a7-7a5143cd01a2 admin admin] The token cache is being invalidate because project 2ea01e42fb794285bdf94faa38ef7168 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80360) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:31:37.493755 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-bf200ff4-2100-4411-b9a7-7a5143cd01a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:37.495156 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-bf200ff4-2100-4411-b9a7-7a5143cd01a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:37.496774 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1134/2290] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:31:37 2022] DELETE /identity/v3/projects/2ea01e42fb794285bdf94faa38ef7168 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 15:31:37.505988 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52350de8-976c-4318-ab08-407f6d2c07a5 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:37.506240 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52350de8-976c-4318-ab08-407f6d2c07a5 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:37.506445 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52350de8-976c-4318-ab08-407f6d2c07a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:37.529983 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-52350de8-976c-4318-ab08-407f6d2c07a5 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:31:37.531831 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-52350de8-976c-4318-ab08-407f6d2c07a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:37.629506 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1157/2291] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:31:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:31:37.641279 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a163c6-89e0-4822-8e48-2879f7da2b51 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:37.642400 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a163c6-89e0-4822-8e48-2879f7da2b51 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:37.642822 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a163c6-89e0-4822-8e48-2879f7da2b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:37.679070 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-09a163c6-89e0-4822-8e48-2879f7da2b51 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:31:37.680628 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-09a163c6-89e0-4822-8e48-2879f7da2b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:37.691831 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1135/2292] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:31:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:31:37.696322 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52350de8-976c-4318-ab08-407f6d2c07a5 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:37.712093 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52350de8-976c-4318-ab08-407f6d2c07a5 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:37.719269 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3dc02e-6e15-49be-9491-88028f136771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:37.719269 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3dc02e-6e15-49be-9491-88028f136771 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:37.719269 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3dc02e-6e15-49be-9491-88028f136771 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:37.719618 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3dc02e-6e15-49be-9491-88028f136771 admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:37.720216 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3dc02e-6e15-49be-9491-88028f136771 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:31:37.720521 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3dc02e-6e15-49be-9491-88028f136771 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:37.722352 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3dc02e-6e15-49be-9491-88028f136771 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:37.737581 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1158/2293] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 2 15:31:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:31:37.741631 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a163c6-89e0-4822-8e48-2879f7da2b51 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:37.752582 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a163c6-89e0-4822-8e48-2879f7da2b51 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:37.764042 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d10e0-3d6b-4ec4-9d05-b239fb324cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:37.765071 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d10e0-3d6b-4ec4-9d05-b239fb324cd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:37.765431 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d10e0-3d6b-4ec4-9d05-b239fb324cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:37.765740 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d10e0-3d6b-4ec4-9d05-b239fb324cd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:37.766529 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2d10e0-3d6b-4ec4-9d05-b239fb324cd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:37.768896 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2d10e0-3d6b-4ec4-9d05-b239fb324cd5 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:37.811905 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1136/2294] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:31:37 2022] POST /identity/v3/projects => generated 373 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:31:37.813814 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3dc02e-6e15-49be-9491-88028f136771 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:37.837414 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3dc02e-6e15-49be-9491-88028f136771 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:37.842177 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d10e0-3d6b-4ec4-9d05-b239fb324cd5 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:37.844989 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-de2d10e0-3d6b-4ec4-9d05-b239fb324cd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:37.883115 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:31:37.914335 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1407d52-8b61-4240-b8db-9002e4379f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:37.914957 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1407d52-8b61-4240-b8db-9002e4379f2f admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:37.915342 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1407d52-8b61-4240-b8db-9002e4379f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:37.915627 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1407d52-8b61-4240-b8db-9002e4379f2f admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:37.916292 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1407d52-8b61-4240-b8db-9002e4379f2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:37.918769 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1407d52-8b61-4240-b8db-9002e4379f2f admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:37.926466 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d10e0-3d6b-4ec4-9d05-b239fb324cd5 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:37.931443 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b812ded9-cce0-426e-a1c3-8d9a233370e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:37.932802 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812ded9-cce0-426e-a1c3-8d9a233370e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:37.933275 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812ded9-cce0-426e-a1c3-8d9a233370e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:37.933556 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812ded9-cce0-426e-a1c3-8d9a233370e9 admin admin] PATH_INFO: `/v3/projects/567455fc1a3d4fc9b81d10b46d4fcc0a` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:37.934915 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b812ded9-cce0-426e-a1c3-8d9a233370e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=567455fc1a3d4fc9b81d10b46d4fcc0a)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:37.936962 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b812ded9-cce0-426e-a1c3-8d9a233370e9 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:37.942238 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1159/2295] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:31:37 2022] POST /identity/v3/users => generated 287 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:31:37.946162 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1407d52-8b61-4240-b8db-9002e4379f2f admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:37.949926 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:31:37.956131 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1407d52-8b61-4240-b8db-9002e4379f2f admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:37.961693 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a659b-051e-4f45-b5c1-99e2e3741179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:37.962423 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a659b-051e-4f45-b5c1-99e2e3741179 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:37.962658 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a659b-051e-4f45-b5c1-99e2e3741179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:37.963102 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a659b-051e-4f45-b5c1-99e2e3741179 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:37.964308 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72a659b-051e-4f45-b5c1-99e2e3741179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:37.966268 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72a659b-051e-4f45-b5c1-99e2e3741179 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:37.983297 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1160/2296] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:31:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 15:31:37.986403 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a659b-051e-4f45-b5c1-99e2e3741179 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:37.990527 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-b812ded9-cce0-426e-a1c3-8d9a233370e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '567455fc1a3d4fc9b81d10b46d4fcc0a', 'request_id': 'req-b812ded9-cce0-426e-a1c3-8d9a233370e9'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:38.000813 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-b812ded9-cce0-426e-a1c3-8d9a233370e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '567455fc1a3d4fc9b81d10b46d4fcc0a', 'request_id': 'req-b812ded9-cce0-426e-a1c3-8d9a233370e9'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:38.001708 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a659b-051e-4f45-b5c1-99e2e3741179 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:38.009670 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-b812ded9-cce0-426e-a1c3-8d9a233370e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '567455fc1a3d4fc9b81d10b46d4fcc0a', 'request_id': 'req-b812ded9-cce0-426e-a1c3-8d9a233370e9'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:38.020697 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-b812ded9-cce0-426e-a1c3-8d9a233370e9 admin admin] The token cache is being invalidate because project 567455fc1a3d4fc9b81d10b46d4fcc0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80360) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:31:38.021073 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-b812ded9-cce0-426e-a1c3-8d9a233370e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:38.021763 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-b812ded9-cce0-426e-a1c3-8d9a233370e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:31:38.023334 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1137/2297] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:31:37 2022] DELETE /identity/v3/projects/567455fc1a3d4fc9b81d10b46d4fcc0a => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:31:38.028292 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852fe67-7a31-4b20-92b9-d0e2b5436307 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:38.028583 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852fe67-7a31-4b20-92b9-d0e2b5436307 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:38.028879 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852fe67-7a31-4b20-92b9-d0e2b5436307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:38.051565 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-0852fe67-7a31-4b20-92b9-d0e2b5436307 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:31:38.052799 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-0852fe67-7a31-4b20-92b9-d0e2b5436307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:38.076771 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3824e124-2649-4fda-b5b7-156ac717eb64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:38.077493 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824e124-2649-4fda-b5b7-156ac717eb64 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:38.077738 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824e124-2649-4fda-b5b7-156ac717eb64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:38.078010 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824e124-2649-4fda-b5b7-156ac717eb64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:38.078745 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3824e124-2649-4fda-b5b7-156ac717eb64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:38.080376 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3824e124-2649-4fda-b5b7-156ac717eb64 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:38.090561 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1161/2298] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:31:37 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:31:38.094773 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3824e124-2649-4fda-b5b7-156ac717eb64 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:38.096572 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-3824e124-2649-4fda-b5b7-156ac717eb64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:38.109770 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3824e124-2649-4fda-b5b7-156ac717eb64 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:38.114370 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69c2e70-ce98-4a3e-8f0d-3c61955a9229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:38.115025 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c2e70-ce98-4a3e-8f0d-3c61955a9229 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:38.115341 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c2e70-ce98-4a3e-8f0d-3c61955a9229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:38.115619 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c2e70-ce98-4a3e-8f0d-3c61955a9229 admin admin] PATH_INFO: `/v3/projects/f6e62db963a84b69b7c07a136fe5476f/users/73208e627bdc4315b4e1eed3a96a2b10/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:38.115841 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1138/2299] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:31:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:31:38.134196 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69c2e70-ce98-4a3e-8f0d-3c61955a9229 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6e62db963a84b69b7c07a136fe5476f, user_id=73208e627bdc4315b4e1eed3a96a2b10, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:38.137340 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69c2e70-ce98-4a3e-8f0d-3c61955a9229 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:38.153900 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1162/2300] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:31:38 2022] PUT /identity/v3/projects/f6e62db963a84b69b7c07a136fe5476f/users/73208e627bdc4315b4e1eed3a96a2b10/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:31:38.164879 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eebaef-1b0d-461f-b988-b5b72bd30d21 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:38.165157 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eebaef-1b0d-461f-b988-b5b72bd30d21 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:38.165435 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eebaef-1b0d-461f-b988-b5b72bd30d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:38.186721 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-a8eebaef-1b0d-461f-b988-b5b72bd30d21 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:31:38.187972 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-a8eebaef-1b0d-461f-b988-b5b72bd30d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:38.189981 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a952db2f-96a6-4a58-a07e-b9c3db9f4ec8 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:38.190268 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a952db2f-96a6-4a58-a07e-b9c3db9f4ec8 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:38.190547 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a952db2f-96a6-4a58-a07e-b9c3db9f4ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:38.210816 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-a952db2f-96a6-4a58-a07e-b9c3db9f4ec8 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:31:38.212058 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-a952db2f-96a6-4a58-a07e-b9c3db9f4ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:38.255110 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1139/2301] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:31:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:31:38.265252 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eebaef-1b0d-461f-b988-b5b72bd30d21 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:38.266655 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-a8eebaef-1b0d-461f-b988-b5b72bd30d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:38.276719 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1163/2302] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:31:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:31:38.280203 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a952db2f-96a6-4a58-a07e-b9c3db9f4ec8 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:38.289593 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a952db2f-96a6-4a58-a07e-b9c3db9f4ec8 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:38.295055 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c37cfc-0184-455b-a30d-22521e34f564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:38.295973 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c37cfc-0184-455b-a30d-22521e34f564 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:38.296511 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c37cfc-0184-455b-a30d-22521e34f564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:38.296511 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c37cfc-0184-455b-a30d-22521e34f564 admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:38.297192 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c37cfc-0184-455b-a30d-22521e34f564 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:31:38.297496 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c37cfc-0184-455b-a30d-22521e34f564 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:38.299095 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c37cfc-0184-455b-a30d-22521e34f564 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:38.317380 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1164/2303] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 2 15:31:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:31:38.319097 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c37cfc-0184-455b-a30d-22521e34f564 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:38.320815 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:31:38.330608 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c37cfc-0184-455b-a30d-22521e34f564 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:38.336061 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dbf99a-5f55-47d2-ba4c-ee9586bb13c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:38.336675 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbf99a-5f55-47d2-ba4c-ee9586bb13c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:38.336811 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eebaef-1b0d-461f-b988-b5b72bd30d21 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:38.336961 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbf99a-5f55-47d2-ba4c-ee9586bb13c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:38.337264 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbf99a-5f55-47d2-ba4c-ee9586bb13c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:38.337931 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dbf99a-5f55-47d2-ba4c-ee9586bb13c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:38.340455 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dbf99a-5f55-47d2-ba4c-ee9586bb13c8 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:38.341091 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b322f10-fe1e-43eb-b50a-4e5ad7b74a62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:38.341713 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b322f10-fe1e-43eb-b50a-4e5ad7b74a62 service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:38.341986 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b322f10-fe1e-43eb-b50a-4e5ad7b74a62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:38.342260 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b322f10-fe1e-43eb-b50a-4e5ad7b74a62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:38.351750 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b322f10-fe1e-43eb-b50a-4e5ad7b74a62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:38.353157 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b322f10-fe1e-43eb-b50a-4e5ad7b74a62 service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:38.356251 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:31:38.363976 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1140/2304] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:31:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 15:31:38.371246 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1165/2305] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:31:38 2022] POST /identity/v3/projects => generated 379 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 15:31:38.373895 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b322f10-fe1e-43eb-b50a-4e5ad7b74a62 service neutron] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:38.383701 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b322f10-fe1e-43eb-b50a-4e5ad7b74a62 service neutron] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:38.451884 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b64d7e-7d95-415d-aa57-c035c134e062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:38.452977 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b64d7e-7d95-415d-aa57-c035c134e062 admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:38.453767 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b64d7e-7d95-415d-aa57-c035c134e062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:38.455472 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b64d7e-7d95-415d-aa57-c035c134e062 admin admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:38.461037 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b64d7e-7d95-415d-aa57-c035c134e062 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:38.464160 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b64d7e-7d95-415d-aa57-c035c134e062 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:38.495165 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1141/2306] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:31:38 2022] POST /identity/v3/users => generated 290 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 15:31:38.499195 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dbf99a-5f55-47d2-ba4c-ee9586bb13c8 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:38.514222 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dbf99a-5f55-47d2-ba4c-ee9586bb13c8 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:38.521123 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b93164-2cb4-4f23-9995-6ca918127f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:38.522155 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b93164-2cb4-4f23-9995-6ca918127f98 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:38.522445 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b93164-2cb4-4f23-9995-6ca918127f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:38.522713 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b93164-2cb4-4f23-9995-6ca918127f98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:38.523446 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b93164-2cb4-4f23-9995-6ca918127f98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:38.525274 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b93164-2cb4-4f23-9995-6ca918127f98 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:38.538655 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1166/2307] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:31:38 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:31:38.543906 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b64d7e-7d95-415d-aa57-c035c134e062 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:38.570222 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b64d7e-7d95-415d-aa57-c035c134e062 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:38.587684 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb9281c-c837-4e09-a45f-621096c9d12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:38.588945 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9281c-c837-4e09-a45f-621096c9d12d admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:38.589229 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9281c-c837-4e09-a45f-621096c9d12d admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:38.589508 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9281c-c837-4e09-a45f-621096c9d12d admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:38.590224 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb9281c-c837-4e09-a45f-621096c9d12d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:38.591878 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb9281c-c837-4e09-a45f-621096c9d12d admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:38.605456 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1142/2308] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:31:38 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 15:31:38.609394 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b93164-2cb4-4f23-9995-6ca918127f98 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:38.620510 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b93164-2cb4-4f23-9995-6ca918127f98 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:38.625986 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d19854-d415-4787-8223-0ddb8abdb893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:38.626990 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d19854-d415-4787-8223-0ddb8abdb893 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:38.627467 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d19854-d415-4787-8223-0ddb8abdb893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:38.627898 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d19854-d415-4787-8223-0ddb8abdb893 admin admin] PATH_INFO: `/v3/projects/812d2ec949d447c7b68157d968bcfa7e/users/cfb5e907ac594ba6a93d88d665c1d740/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:38.644669 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d19854-d415-4787-8223-0ddb8abdb893 admin admin] RBAC: Authorizing `identity:create_grant(project_id=812d2ec949d447c7b68157d968bcfa7e, user_id=cfb5e907ac594ba6a93d88d665c1d740, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:38.647387 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d19854-d415-4787-8223-0ddb8abdb893 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:38.663190 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1167/2309] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:31:38 2022] PUT /identity/v3/projects/812d2ec949d447c7b68157d968bcfa7e/users/cfb5e907ac594ba6a93d88d665c1d740/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:31:38.669310 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c03bcb-e33b-4a6d-82de-78a5c53bf20c None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:38.669604 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c03bcb-e33b-4a6d-82de-78a5c53bf20c None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:38.669892 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c03bcb-e33b-4a6d-82de-78a5c53bf20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:38.691058 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-68c03bcb-e33b-4a6d-82de-78a5c53bf20c None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:31:38.692314 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-68c03bcb-e33b-4a6d-82de-78a5c53bf20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:38.758798 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1143/2310] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:31:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:31:38.770377 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d19854-d415-4787-8223-0ddb8abdb893 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:38.772179 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-16d19854-d415-4787-8223-0ddb8abdb893 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:38.842967 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d19854-d415-4787-8223-0ddb8abdb893 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:38.848022 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d84324c-b452-481a-ab36-ebe50a6bd062 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:38.849112 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84324c-b452-481a-ab36-ebe50a6bd062 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:38.850008 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84324c-b452-481a-ab36-ebe50a6bd062 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:38.850008 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84324c-b452-481a-ab36-ebe50a6bd062 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:38.860887 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d84324c-b452-481a-ab36-ebe50a6bd062 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:38.862320 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d84324c-b452-481a-ab36-ebe50a6bd062 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:38.872935 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1168/2311] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:31:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:31:39.514462 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f4e8a-c7c9-4ef5-bcbb-33a59646c1cc None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:39.514888 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f4e8a-c7c9-4ef5-bcbb-33a59646c1cc None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:39.515797 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f4e8a-c7c9-4ef5-bcbb-33a59646c1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:39.560996 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-428f4e8a-c7c9-4ef5-bcbb-33a59646c1cc None None] MFA Rules not processed for user `73208e627bdc4315b4e1eed3a96a2b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:31:39.562311 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-428f4e8a-c7c9-4ef5-bcbb-33a59646c1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:39.664236 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:31:39.695677 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1144/2312] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:31:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:31:39.708894 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d84324c-b452-481a-ab36-ebe50a6bd062 service neutron] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:39.710333 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-1d84324c-b452-481a-ab36-ebe50a6bd062 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:39.782049 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d84324c-b452-481a-ab36-ebe50a6bd062 service neutron] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:39.785953 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0159932d-cfe8-439d-a114-77acc5987fa7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:39.786583 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0159932d-cfe8-439d-a114-77acc5987fa7 service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:39.787137 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0159932d-cfe8-439d-a114-77acc5987fa7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:39.787451 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0159932d-cfe8-439d-a114-77acc5987fa7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:39.797877 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0159932d-cfe8-439d-a114-77acc5987fa7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:39.799380 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0159932d-cfe8-439d-a114-77acc5987fa7 service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:39.809836 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1169/2313] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:31:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:31:42.373307 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73827b2-a583-4af9-a6da-c60eb184a17b None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:42.373845 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73827b2-a583-4af9-a6da-c60eb184a17b None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:42.374004 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73827b2-a583-4af9-a6da-c60eb184a17b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:42.395941 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-c73827b2-a583-4af9-a6da-c60eb184a17b None None] MFA Rules not processed for user `73208e627bdc4315b4e1eed3a96a2b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:31:42.397831 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-c73827b2-a583-4af9-a6da-c60eb184a17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:42.406057 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1145/2314] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:31:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:31:44.728560 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347eeb77-8721-477f-96e7-c31ee6c49b3e None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:44.729403 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347eeb77-8721-477f-96e7-c31ee6c49b3e None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:44.729720 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347eeb77-8721-477f-96e7-c31ee6c49b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:44.765249 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-347eeb77-8721-477f-96e7-c31ee6c49b3e None None] MFA Rules not processed for user `cfb5e907ac594ba6a93d88d665c1d740`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:31:44.766457 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-347eeb77-8721-477f-96e7-c31ee6c49b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:44.827151 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:31:44.843526 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1170/2315] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:31:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:31:44.848000 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73827b2-a583-4af9-a6da-c60eb184a17b None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:44.859302 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73827b2-a583-4af9-a6da-c60eb184a17b None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:44.864038 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1df124f-2f8b-40db-868b-bb739dc31e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:44.864661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df124f-2f8b-40db-868b-bb739dc31e4a admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:44.864943 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df124f-2f8b-40db-868b-bb739dc31e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:44.865248 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df124f-2f8b-40db-868b-bb739dc31e4a admin admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:44.865890 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1df124f-2f8b-40db-868b-bb739dc31e4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:44.867858 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1df124f-2f8b-40db-868b-bb739dc31e4a admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:44.899366 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1146/2316] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:31:44 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:31:44.904155 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347eeb77-8721-477f-96e7-c31ee6c49b3e None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:44.918002 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347eeb77-8721-477f-96e7-c31ee6c49b3e None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:44.977431 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ee7d3-b3d3-4004-b28e-920cf9e335ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:44.978045 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ee7d3-b3d3-4004-b28e-920cf9e335ae admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:44.978326 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ee7d3-b3d3-4004-b28e-920cf9e335ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:44.978596 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ee7d3-b3d3-4004-b28e-920cf9e335ae admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:44.979322 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951ee7d3-b3d3-4004-b28e-920cf9e335ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:44.981410 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951ee7d3-b3d3-4004-b28e-920cf9e335ae admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:45.003479 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1171/2317] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:31:44 2022] POST /identity/v3/users => generated 295 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:31:45.008022 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1df124f-2f8b-40db-868b-bb739dc31e4a admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:45.022186 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1df124f-2f8b-40db-868b-bb739dc31e4a admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:45.029566 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a97736e-7508-4a20-b0cc-e6a2425fa843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:45.030255 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97736e-7508-4a20-b0cc-e6a2425fa843 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:45.030726 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97736e-7508-4a20-b0cc-e6a2425fa843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:45.031185 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97736e-7508-4a20-b0cc-e6a2425fa843 admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:45.032125 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a97736e-7508-4a20-b0cc-e6a2425fa843 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:45.033810 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a97736e-7508-4a20-b0cc-e6a2425fa843 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:45.062269 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1147/2318] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:31:45 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:31:45.066742 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ee7d3-b3d3-4004-b28e-920cf9e335ae admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:45.079026 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ee7d3-b3d3-4004-b28e-920cf9e335ae admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:45.083799 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5dfd29-5c0a-48f8-a02c-5e6849f8837e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:45.084474 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5dfd29-5c0a-48f8-a02c-5e6849f8837e admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:45.084767 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5dfd29-5c0a-48f8-a02c-5e6849f8837e admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:45.085045 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5dfd29-5c0a-48f8-a02c-5e6849f8837e admin admin] PATH_INFO: `/v3/projects/89748fd810df46aaa0b74e73962fd19c/users/3fc311b3746c4cf4ac17571d39f00683/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:45.100694 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5dfd29-5c0a-48f8-a02c-5e6849f8837e admin admin] RBAC: Authorizing `identity:create_grant(project_id=89748fd810df46aaa0b74e73962fd19c, user_id=3fc311b3746c4cf4ac17571d39f00683, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:45.103422 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5dfd29-5c0a-48f8-a02c-5e6849f8837e admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:45.116335 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1172/2319] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:31:45 2022] PUT /identity/v3/projects/89748fd810df46aaa0b74e73962fd19c/users/3fc311b3746c4cf4ac17571d39f00683/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:31:45.120869 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a97736e-7508-4a20-b0cc-e6a2425fa843 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:45.132799 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a97736e-7508-4a20-b0cc-e6a2425fa843 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:45.192210 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e2ddd-8481-4e3a-894b-b9c55171bc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:45.192829 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e2ddd-8481-4e3a-894b-b9c55171bc94 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:45.193111 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e2ddd-8481-4e3a-894b-b9c55171bc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:45.193387 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e2ddd-8481-4e3a-894b-b9c55171bc94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:45.194076 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2e2ddd-8481-4e3a-894b-b9c55171bc94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:45.195711 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2e2ddd-8481-4e3a-894b-b9c55171bc94 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:45.206867 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1148/2320] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:31:45 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:31:45.211314 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5dfd29-5c0a-48f8-a02c-5e6849f8837e admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:45.222133 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5dfd29-5c0a-48f8-a02c-5e6849f8837e admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:45.226816 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12680365-ca0a-4928-87e7-eea0d2132c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:45.227527 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12680365-ca0a-4928-87e7-eea0d2132c74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:45.227814 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12680365-ca0a-4928-87e7-eea0d2132c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:45.228093 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12680365-ca0a-4928-87e7-eea0d2132c74 admin admin] PATH_INFO: `/v3/projects/89748fd810df46aaa0b74e73962fd19c/users/3fc311b3746c4cf4ac17571d39f00683/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:45.230420 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12680365-ca0a-4928-87e7-eea0d2132c74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89748fd810df46aaa0b74e73962fd19c, user_id=3fc311b3746c4cf4ac17571d39f00683, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:45.233745 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12680365-ca0a-4928-87e7-eea0d2132c74 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:45.244674 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1173/2321] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:31:45 2022] PUT /identity/v3/projects/89748fd810df46aaa0b74e73962fd19c/users/3fc311b3746c4cf4ac17571d39f00683/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:31:50.561717 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4e378-0fcc-4a41-b147-0a9931acac82 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:50.562248 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4e378-0fcc-4a41-b147-0a9931acac82 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:50.562381 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4e378-0fcc-4a41-b147-0a9931acac82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:50.658913 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-2bc4e378-0fcc-4a41-b147-0a9931acac82 None None] MFA Rules not processed for user `3fc311b3746c4cf4ac17571d39f00683`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:31:50.660879 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-2bc4e378-0fcc-4a41-b147-0a9931acac82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:50.792012 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1149/2322] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:31:50 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:31:50.841919 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12680365-ca0a-4928-87e7-eea0d2132c74 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:31:50.843923 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-12680365-ca0a-4928-87e7-eea0d2132c74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:31:50.930469 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12680365-ca0a-4928-87e7-eea0d2132c74 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:31:50.936584 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2bc910-bb48-43af-92c1-b522710dd7c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0865af59bf43dfa4c84213d7db53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:31:50.937213 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2bc910-bb48-43af-92c1-b522710dd7c4 service nova] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:31:50.937495 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2bc910-bb48-43af-92c1-b522710dd7c4 service nova] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:31:50.937768 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2bc910-bb48-43af-92c1-b522710dd7c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:31:50.990022 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:31:51.026936 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2bc910-bb48-43af-92c1-b522710dd7c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:31:51.029028 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2bc910-bb48-43af-92c1-b522710dd7c4 service nova] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:31:51.046248 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1174/2323] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:31:50 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:32:00.789558 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=84,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:32:01.040283 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=8 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:32:03.414795 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc4e378-0fcc-4a41-b147-0a9931acac82 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:03.416893 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-2bc4e378-0fcc-4a41-b147-0a9931acac82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:03.483018 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc4e378-0fcc-4a41-b147-0a9931acac82 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:03.487549 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ac4c7-31a1-4d88-bf83-d1e221537a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:03.488199 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ac4c7-31a1-4d88-bf83-d1e221537a02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:03.488479 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ac4c7-31a1-4d88-bf83-d1e221537a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:03.488751 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ac4c7-31a1-4d88-bf83-d1e221537a02 admin admin] PATH_INFO: `/v3/users/9fe8adf42f9c4e3a839a8ad81321bf73` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:03.489906 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90ac4c7-31a1-4d88-bf83-d1e221537a02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fe8adf42f9c4e3a839a8ad81321bf73)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:03.491856 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90ac4c7-31a1-4d88-bf83-d1e221537a02 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:03.542435 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-a90ac4c7-31a1-4d88-bf83-d1e221537a02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fe8adf42f9c4e3a839a8ad81321bf73'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:03.549654 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-a90ac4c7-31a1-4d88-bf83-d1e221537a02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fe8adf42f9c4e3a839a8ad81321bf73'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:03.562505 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-a90ac4c7-31a1-4d88-bf83-d1e221537a02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fe8adf42f9c4e3a839a8ad81321bf73'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:03.563429 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-a90ac4c7-31a1-4d88-bf83-d1e221537a02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fe8adf42f9c4e3a839a8ad81321bf73'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:03.564044 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-a90ac4c7-31a1-4d88-bf83-d1e221537a02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fe8adf42f9c4e3a839a8ad81321bf73'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:03.577907 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1150/2324] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:32:03 2022] DELETE /identity/v3/users/9fe8adf42f9c4e3a839a8ad81321bf73 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:32:03.582562 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20045c9d-8bab-453a-9f3d-691d1a3fc6e0 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:03.583080 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20045c9d-8bab-453a-9f3d-691d1a3fc6e0 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:03.583167 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20045c9d-8bab-453a-9f3d-691d1a3fc6e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:03.605282 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-20045c9d-8bab-453a-9f3d-691d1a3fc6e0 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:32:03.606560 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-20045c9d-8bab-453a-9f3d-691d1a3fc6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:03.684778 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1175/2325] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:32:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:32:03.694673 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ac4c7-31a1-4d88-bf83-d1e221537a02 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:03.696141 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-a90ac4c7-31a1-4d88-bf83-d1e221537a02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:03.767925 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ac4c7-31a1-4d88-bf83-d1e221537a02 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:03.776468 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151bb533-73b4-4485-ae4a-56e90ae6cc66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:03.777173 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151bb533-73b4-4485-ae4a-56e90ae6cc66 service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:03.777462 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151bb533-73b4-4485-ae4a-56e90ae6cc66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:03.777737 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151bb533-73b4-4485-ae4a-56e90ae6cc66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:03.789812 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151bb533-73b4-4485-ae4a-56e90ae6cc66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:03.792232 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151bb533-73b4-4485-ae4a-56e90ae6cc66 service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:03.809368 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1151/2326] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:32:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:32:04.094542 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20045c9d-8bab-453a-9f3d-691d1a3fc6e0 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:04.096095 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-20045c9d-8bab-453a-9f3d-691d1a3fc6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:04.109430 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20045c9d-8bab-453a-9f3d-691d1a3fc6e0 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:04.114623 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa896b17-5044-4c73-98f3-6be8b386b5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:04.115438 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa896b17-5044-4c73-98f3-6be8b386b5fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:04.115724 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa896b17-5044-4c73-98f3-6be8b386b5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:04.116003 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa896b17-5044-4c73-98f3-6be8b386b5fb admin admin] PATH_INFO: `/v3/projects/7627a044fd6d4821879d1ed30b1dc46f` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:04.117201 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa896b17-5044-4c73-98f3-6be8b386b5fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7627a044fd6d4821879d1ed30b1dc46f)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:04.119151 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa896b17-5044-4c73-98f3-6be8b386b5fb admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:04.188366 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-fa896b17-5044-4c73-98f3-6be8b386b5fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7627a044fd6d4821879d1ed30b1dc46f', 'request_id': 'req-fa896b17-5044-4c73-98f3-6be8b386b5fb'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:04.196668 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-fa896b17-5044-4c73-98f3-6be8b386b5fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7627a044fd6d4821879d1ed30b1dc46f', 'request_id': 'req-fa896b17-5044-4c73-98f3-6be8b386b5fb'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:04.205767 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-fa896b17-5044-4c73-98f3-6be8b386b5fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7627a044fd6d4821879d1ed30b1dc46f', 'request_id': 'req-fa896b17-5044-4c73-98f3-6be8b386b5fb'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:04.217649 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-fa896b17-5044-4c73-98f3-6be8b386b5fb admin admin] The token cache is being invalidate because project 7627a044fd6d4821879d1ed30b1dc46f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:32:04.217946 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-fa896b17-5044-4c73-98f3-6be8b386b5fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:04.218617 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-fa896b17-5044-4c73-98f3-6be8b386b5fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:04.220232 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1176/2327] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:32:04 2022] DELETE /identity/v3/projects/7627a044fd6d4821879d1ed30b1dc46f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:32:04.225311 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e101c1e-75dd-4060-8f36-04921db45f5e None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:04.225763 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e101c1e-75dd-4060-8f36-04921db45f5e None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:04.226042 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e101c1e-75dd-4060-8f36-04921db45f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:04.248128 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-5e101c1e-75dd-4060-8f36-04921db45f5e None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:32:04.249288 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-5e101c1e-75dd-4060-8f36-04921db45f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:04.269380 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:32:04.330992 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1152/2328] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:32:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:32:04.340399 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed9aed-fbf2-469b-9564-99ceb2535b51 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:04.340808 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed9aed-fbf2-469b-9564-99ceb2535b51 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:04.341159 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed9aed-fbf2-469b-9564-99ceb2535b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:04.362658 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-03ed9aed-fbf2-469b-9564-99ceb2535b51 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:32:04.363909 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-03ed9aed-fbf2-469b-9564-99ceb2535b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:04.377036 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1177/2329] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:32:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:32:04.381562 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e101c1e-75dd-4060-8f36-04921db45f5e None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:04.393789 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e101c1e-75dd-4060-8f36-04921db45f5e None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:04.401960 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3f80c6-a746-4f74-ba42-36a39989f62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:04.402698 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f80c6-a746-4f74-ba42-36a39989f62e admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:04.402981 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f80c6-a746-4f74-ba42-36a39989f62e admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:04.403501 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f80c6-a746-4f74-ba42-36a39989f62e admin admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:04.404749 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3f80c6-a746-4f74-ba42-36a39989f62e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:32:04.405101 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3f80c6-a746-4f74-ba42-36a39989f62e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:04.407879 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3f80c6-a746-4f74-ba42-36a39989f62e admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:04.421543 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1153/2330] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 2 15:32:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:32:04.426161 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed9aed-fbf2-469b-9564-99ceb2535b51 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:04.435524 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed9aed-fbf2-469b-9564-99ceb2535b51 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:04.440227 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073ad8cb-be3d-48fd-a542-7c4d1b2699ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:04.440832 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ad8cb-be3d-48fd-a542-7c4d1b2699ae admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:04.441118 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ad8cb-be3d-48fd-a542-7c4d1b2699ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:04.441390 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ad8cb-be3d-48fd-a542-7c4d1b2699ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:04.442057 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073ad8cb-be3d-48fd-a542-7c4d1b2699ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:04.443999 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073ad8cb-be3d-48fd-a542-7c4d1b2699ae admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:04.472780 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1178/2331] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:32:04 2022] POST /identity/v3/projects => generated 359 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:32:04.476985 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3f80c6-a746-4f74-ba42-36a39989f62e admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:04.487731 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3f80c6-a746-4f74-ba42-36a39989f62e admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:04.548714 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d8214a-ac01-4ece-a019-5d33c363c96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:04.549826 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8214a-ac01-4ece-a019-5d33c363c96b admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:04.550245 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8214a-ac01-4ece-a019-5d33c363c96b admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:04.550735 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8214a-ac01-4ece-a019-5d33c363c96b admin admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:04.551455 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d8214a-ac01-4ece-a019-5d33c363c96b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:04.553414 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d8214a-ac01-4ece-a019-5d33c363c96b admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:04.581036 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1154/2332] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:32:04 2022] POST /identity/v3/users => generated 280 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:32:04.588482 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073ad8cb-be3d-48fd-a542-7c4d1b2699ae admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:04.599963 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073ad8cb-be3d-48fd-a542-7c4d1b2699ae admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:04.605986 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de2e1c-8288-43dc-a1c8-3abd9eeb3135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:04.606779 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de2e1c-8288-43dc-a1c8-3abd9eeb3135 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:04.607083 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de2e1c-8288-43dc-a1c8-3abd9eeb3135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:04.607498 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de2e1c-8288-43dc-a1c8-3abd9eeb3135 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:04.608213 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de2e1c-8288-43dc-a1c8-3abd9eeb3135 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:04.609861 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de2e1c-8288-43dc-a1c8-3abd9eeb3135 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:04.621182 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1179/2333] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:32:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:32:04.625356 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d8214a-ac01-4ece-a019-5d33c363c96b admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:04.636463 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d8214a-ac01-4ece-a019-5d33c363c96b admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:04.641624 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4f74a1-7abd-4c1d-b26a-0aa06c1dc472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:04.642277 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f74a1-7abd-4c1d-b26a-0aa06c1dc472 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:04.642578 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f74a1-7abd-4c1d-b26a-0aa06c1dc472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:04.642870 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f74a1-7abd-4c1d-b26a-0aa06c1dc472 admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:04.643641 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4f74a1-7abd-4c1d-b26a-0aa06c1dc472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:04.645962 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4f74a1-7abd-4c1d-b26a-0aa06c1dc472 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:04.657573 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1155/2334] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:32:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:32:04.661908 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de2e1c-8288-43dc-a1c8-3abd9eeb3135 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:04.673294 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de2e1c-8288-43dc-a1c8-3abd9eeb3135 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:04.678505 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3715bb-cace-4b00-b9f9-4b17eb8056f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:04.679203 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3715bb-cace-4b00-b9f9-4b17eb8056f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:04.679511 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3715bb-cace-4b00-b9f9-4b17eb8056f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:04.679788 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3715bb-cace-4b00-b9f9-4b17eb8056f6 admin admin] PATH_INFO: `/v3/projects/ad4157f351c949e6a65c15e0291da7f8/users/611debe38dbc459096593c531389bdc7/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:04.698074 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3715bb-cace-4b00-b9f9-4b17eb8056f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad4157f351c949e6a65c15e0291da7f8, user_id=611debe38dbc459096593c531389bdc7, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:04.701136 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3715bb-cace-4b00-b9f9-4b17eb8056f6 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:04.730622 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1180/2335] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:32:04 2022] PUT /identity/v3/projects/ad4157f351c949e6a65c15e0291da7f8/users/611debe38dbc459096593c531389bdc7/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:32:04.741593 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e65f7-0a1f-4158-8c93-dc6c71e67920 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:04.741886 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e65f7-0a1f-4158-8c93-dc6c71e67920 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:04.742170 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e65f7-0a1f-4158-8c93-dc6c71e67920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:04.781623 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-719e65f7-0a1f-4158-8c93-dc6c71e67920 None None] MFA Rules not processed for user `611debe38dbc459096593c531389bdc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:32:04.783090 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-719e65f7-0a1f-4158-8c93-dc6c71e67920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:04.888378 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1156/2336] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:32:04 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:32:04.947851 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3715bb-cace-4b00-b9f9-4b17eb8056f6 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:04.953419 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-4c3715bb-cace-4b00-b9f9-4b17eb8056f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:04.977754 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:32:05.023787 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3715bb-cace-4b00-b9f9-4b17eb8056f6 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:05.028400 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf2f89-6dc5-4781-a858-2801cf324d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:05.029044 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf2f89-6dc5-4781-a858-2801cf324d6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:05.029334 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf2f89-6dc5-4781-a858-2801cf324d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:05.029609 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf2f89-6dc5-4781-a858-2801cf324d6a admin admin] PATH_INFO: `/v3/users/c5f4cbb0d2984f5998057cf1f1dae13e` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:05.030779 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaf2f89-6dc5-4781-a858-2801cf324d6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5f4cbb0d2984f5998057cf1f1dae13e)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:05.032725 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaf2f89-6dc5-4781-a858-2801cf324d6a admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:05.086224 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-ffaf2f89-6dc5-4781-a858-2801cf324d6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5f4cbb0d2984f5998057cf1f1dae13e'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:05.098607 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-ffaf2f89-6dc5-4781-a858-2801cf324d6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5f4cbb0d2984f5998057cf1f1dae13e'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:05.099920 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-ffaf2f89-6dc5-4781-a858-2801cf324d6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5f4cbb0d2984f5998057cf1f1dae13e'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:05.113213 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-ffaf2f89-6dc5-4781-a858-2801cf324d6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5f4cbb0d2984f5998057cf1f1dae13e'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:05.122107 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-ffaf2f89-6dc5-4781-a858-2801cf324d6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5f4cbb0d2984f5998057cf1f1dae13e'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:05.128788 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1181/2337] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:32:04 2022] DELETE /identity/v3/users/c5f4cbb0d2984f5998057cf1f1dae13e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:32:05.134320 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e4019-2450-452d-b5d1-7ac7839527d9 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:05.134615 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e4019-2450-452d-b5d1-7ac7839527d9 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:05.135044 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e4019-2450-452d-b5d1-7ac7839527d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:05.170151 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-f15e4019-2450-452d-b5d1-7ac7839527d9 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:32:05.173107 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-f15e4019-2450-452d-b5d1-7ac7839527d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:05.173722 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf2f89-6dc5-4781-a858-2801cf324d6a admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:05.180052 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-ffaf2f89-6dc5-4781-a858-2801cf324d6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:05.197361 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:32:05.289161 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1157/2338] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:32:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:32:05.298137 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15e4019-2450-452d-b5d1-7ac7839527d9 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:05.307047 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-f15e4019-2450-452d-b5d1-7ac7839527d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:05.351700 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf2f89-6dc5-4781-a858-2801cf324d6a admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:05.364461 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e3b8ca-e368-4e3c-aa37-29704a564d5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:05.365207 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3b8ca-e368-4e3c-aa37-29704a564d5c service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:05.365554 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3b8ca-e368-4e3c-aa37-29704a564d5c service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:05.365904 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3b8ca-e368-4e3c-aa37-29704a564d5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:05.368927 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-a9e3b8ca-e368-4e3c-aa37-29704a564d5c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:05.393249 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15e4019-2450-452d-b5d1-7ac7839527d9 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:05.397604 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cba9e73-bac3-4f8b-a691-c42fe0a8f6cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:05.398258 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba9e73-bac3-4f8b-a691-c42fe0a8f6cd service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:05.398544 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba9e73-bac3-4f8b-a691-c42fe0a8f6cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:05.398824 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba9e73-bac3-4f8b-a691-c42fe0a8f6cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:05.410838 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cba9e73-bac3-4f8b-a691-c42fe0a8f6cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:05.413148 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cba9e73-bac3-4f8b-a691-c42fe0a8f6cd service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:05.425629 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1158/2339] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:32:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 15:32:05.445436 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:32:05.452289 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e3b8ca-e368-4e3c-aa37-29704a564d5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:05.454792 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e3b8ca-e368-4e3c-aa37-29704a564d5c service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:05.468237 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1182/2340] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:32:05 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:32:05.486643 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cba9e73-bac3-4f8b-a691-c42fe0a8f6cd service neutron] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:05.488528 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-2cba9e73-bac3-4f8b-a691-c42fe0a8f6cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:05.505297 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cba9e73-bac3-4f8b-a691-c42fe0a8f6cd service neutron] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:05.511185 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc8745f-9a14-4739-9ef5-3b089cc5c1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:05.512043 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8745f-9a14-4739-9ef5-3b089cc5c1d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:05.512432 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8745f-9a14-4739-9ef5-3b089cc5c1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:05.512793 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8745f-9a14-4739-9ef5-3b089cc5c1d4 admin admin] PATH_INFO: `/v3/users/611debe38dbc459096593c531389bdc7` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:05.514108 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc8745f-9a14-4739-9ef5-3b089cc5c1d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=611debe38dbc459096593c531389bdc7)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:05.516788 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc8745f-9a14-4739-9ef5-3b089cc5c1d4 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:05.598420 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-7cc8745f-9a14-4739-9ef5-3b089cc5c1d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '611debe38dbc459096593c531389bdc7'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:05.613235 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-7cc8745f-9a14-4739-9ef5-3b089cc5c1d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '611debe38dbc459096593c531389bdc7'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:05.629295 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-7cc8745f-9a14-4739-9ef5-3b089cc5c1d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '611debe38dbc459096593c531389bdc7'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:05.630729 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-7cc8745f-9a14-4739-9ef5-3b089cc5c1d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '611debe38dbc459096593c531389bdc7'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:05.632006 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-7cc8745f-9a14-4739-9ef5-3b089cc5c1d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '611debe38dbc459096593c531389bdc7'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:05.647166 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1159/2341] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:32:05 2022] DELETE /identity/v3/users/611debe38dbc459096593c531389bdc7 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 15:32:05.652217 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7342835-9aca-444e-b735-58d4482e5c97 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:05.652724 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7342835-9aca-444e-b735-58d4482e5c97 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:05.652821 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7342835-9aca-444e-b735-58d4482e5c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:05.673562 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-f7342835-9aca-444e-b735-58d4482e5c97 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:32:05.674778 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-f7342835-9aca-444e-b735-58d4482e5c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:05.755525 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1183/2342] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:32:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:32:05.772865 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc8745f-9a14-4739-9ef5-3b089cc5c1d4 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:05.774776 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-7cc8745f-9a14-4739-9ef5-3b089cc5c1d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:05.816695 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:32:05.850924 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7342835-9aca-444e-b735-58d4482e5c97 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:05.852766 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-f7342835-9aca-444e-b735-58d4482e5c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:05.863561 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc8745f-9a14-4739-9ef5-3b089cc5c1d4 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:05.868133 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2925761c-042e-4958-bb23-d7af90822285 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:05.869224 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925761c-042e-4958-bb23-d7af90822285 service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:05.869567 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925761c-042e-4958-bb23-d7af90822285 service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:05.869888 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925761c-042e-4958-bb23-d7af90822285 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:05.871621 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7342835-9aca-444e-b735-58d4482e5c97 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:05.878081 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1eebe9-87b3-46b0-be60-2ee5eb7f59f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:05.878856 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1eebe9-87b3-46b0-be60-2ee5eb7f59f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:05.879143 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1eebe9-87b3-46b0-be60-2ee5eb7f59f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:05.879548 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1eebe9-87b3-46b0-be60-2ee5eb7f59f9 admin admin] PATH_INFO: `/v3/projects/4ff38d10ea954f33be99ed18f3e4902c` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:05.880258 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2925761c-042e-4958-bb23-d7af90822285 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:05.880749 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1eebe9-87b3-46b0-be60-2ee5eb7f59f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ff38d10ea954f33be99ed18f3e4902c)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:05.881708 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2925761c-042e-4958-bb23-d7af90822285 service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:05.882696 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1eebe9-87b3-46b0-be60-2ee5eb7f59f9 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:05.892651 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1160/2343] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:32:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:32:05.936010 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-de1eebe9-87b3-46b0-be60-2ee5eb7f59f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ff38d10ea954f33be99ed18f3e4902c', 'request_id': 'req-de1eebe9-87b3-46b0-be60-2ee5eb7f59f9'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:05.944973 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-de1eebe9-87b3-46b0-be60-2ee5eb7f59f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ff38d10ea954f33be99ed18f3e4902c', 'request_id': 'req-de1eebe9-87b3-46b0-be60-2ee5eb7f59f9'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:05.953911 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-de1eebe9-87b3-46b0-be60-2ee5eb7f59f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ff38d10ea954f33be99ed18f3e4902c', 'request_id': 'req-de1eebe9-87b3-46b0-be60-2ee5eb7f59f9'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:05.968733 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-de1eebe9-87b3-46b0-be60-2ee5eb7f59f9 admin admin] The token cache is being invalidate because project 4ff38d10ea954f33be99ed18f3e4902c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:32:05.969102 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-de1eebe9-87b3-46b0-be60-2ee5eb7f59f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:05.969965 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-de1eebe9-87b3-46b0-be60-2ee5eb7f59f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:05.971812 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1184/2344] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:32:05 2022] DELETE /identity/v3/projects/4ff38d10ea954f33be99ed18f3e4902c => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 15:32:05.975871 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2925761c-042e-4958-bb23-d7af90822285 service neutron] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:05.986233 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2925761c-042e-4958-bb23-d7af90822285 service neutron] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:06.055732 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae33738b-05a2-482e-9c2a-05be5682ad69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:06.056971 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33738b-05a2-482e-9c2a-05be5682ad69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:06.057257 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33738b-05a2-482e-9c2a-05be5682ad69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:06.057539 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33738b-05a2-482e-9c2a-05be5682ad69 admin admin] PATH_INFO: `/v3/users/1d6b9ee48d704416a53eacd49dc73d41` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:06.059435 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae33738b-05a2-482e-9c2a-05be5682ad69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d6b9ee48d704416a53eacd49dc73d41)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:06.060838 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae33738b-05a2-482e-9c2a-05be5682ad69 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:06.138945 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-ae33738b-05a2-482e-9c2a-05be5682ad69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d6b9ee48d704416a53eacd49dc73d41'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:06.148767 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-ae33738b-05a2-482e-9c2a-05be5682ad69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d6b9ee48d704416a53eacd49dc73d41'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:06.169974 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-ae33738b-05a2-482e-9c2a-05be5682ad69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d6b9ee48d704416a53eacd49dc73d41'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:06.171305 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-ae33738b-05a2-482e-9c2a-05be5682ad69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d6b9ee48d704416a53eacd49dc73d41'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:06.171966 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-ae33738b-05a2-482e-9c2a-05be5682ad69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d6b9ee48d704416a53eacd49dc73d41'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:06.188400 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1161/2345] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:32:05 2022] DELETE /identity/v3/users/1d6b9ee48d704416a53eacd49dc73d41 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:32:06.261289 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1eebe9-87b3-46b0-be60-2ee5eb7f59f9 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:06.262824 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-de1eebe9-87b3-46b0-be60-2ee5eb7f59f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:06.276513 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1eebe9-87b3-46b0-be60-2ee5eb7f59f9 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:06.360564 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc25dd7e-1e17-4707-b87d-614f1cb1e4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:06.361962 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc25dd7e-1e17-4707-b87d-614f1cb1e4b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:06.362394 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc25dd7e-1e17-4707-b87d-614f1cb1e4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:06.362697 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc25dd7e-1e17-4707-b87d-614f1cb1e4b2 admin admin] PATH_INFO: `/v3/projects/ad4157f351c949e6a65c15e0291da7f8` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:06.367245 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc25dd7e-1e17-4707-b87d-614f1cb1e4b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad4157f351c949e6a65c15e0291da7f8)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:06.369739 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc25dd7e-1e17-4707-b87d-614f1cb1e4b2 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:06.406841 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:32:06.456305 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-cc25dd7e-1e17-4707-b87d-614f1cb1e4b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad4157f351c949e6a65c15e0291da7f8', 'request_id': 'req-cc25dd7e-1e17-4707-b87d-614f1cb1e4b2'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:06.462103 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-cc25dd7e-1e17-4707-b87d-614f1cb1e4b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad4157f351c949e6a65c15e0291da7f8', 'request_id': 'req-cc25dd7e-1e17-4707-b87d-614f1cb1e4b2'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:06.469213 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-cc25dd7e-1e17-4707-b87d-614f1cb1e4b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad4157f351c949e6a65c15e0291da7f8', 'request_id': 'req-cc25dd7e-1e17-4707-b87d-614f1cb1e4b2'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:06.482814 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-cc25dd7e-1e17-4707-b87d-614f1cb1e4b2 admin admin] The token cache is being invalidate because project ad4157f351c949e6a65c15e0291da7f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:32:06.482975 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-cc25dd7e-1e17-4707-b87d-614f1cb1e4b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:06.483710 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-cc25dd7e-1e17-4707-b87d-614f1cb1e4b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:06.485496 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1185/2346] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:32:06 2022] DELETE /identity/v3/projects/ad4157f351c949e6a65c15e0291da7f8 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:32:06.490998 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ffe22e-667b-44c3-b12f-ba0758feeb33 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:06.491503 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ffe22e-667b-44c3-b12f-ba0758feeb33 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:06.491600 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ffe22e-667b-44c3-b12f-ba0758feeb33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:06.517487 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-f7ffe22e-667b-44c3-b12f-ba0758feeb33 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:32:06.518709 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-f7ffe22e-667b-44c3-b12f-ba0758feeb33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:06.571032 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc25dd7e-1e17-4707-b87d-614f1cb1e4b2 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:06.572512 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-cc25dd7e-1e17-4707-b87d-614f1cb1e4b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:06.592577 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:32:06.619455 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1162/2347] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:32:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:32:06.621558 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8aac1a-4e96-4775-abb4-c04ea266a4fd None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:06.621856 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8aac1a-4e96-4775-abb4-c04ea266a4fd None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:06.622423 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8aac1a-4e96-4775-abb4-c04ea266a4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:06.651383 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-6a8aac1a-4e96-4775-abb4-c04ea266a4fd None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:32:06.652606 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-6a8aac1a-4e96-4775-abb4-c04ea266a4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:06.667120 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1163/2348] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:32:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:32:06.668226 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8aac1a-4e96-4775-abb4-c04ea266a4fd None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:06.680024 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8aac1a-4e96-4775-abb4-c04ea266a4fd None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:06.683159 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc25dd7e-1e17-4707-b87d-614f1cb1e4b2 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:06.687778 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c50e3ba-cfff-4fde-bde9-84e9f5b73c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:06.688767 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50e3ba-cfff-4fde-bde9-84e9f5b73c41 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:06.689329 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50e3ba-cfff-4fde-bde9-84e9f5b73c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:06.689761 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50e3ba-cfff-4fde-bde9-84e9f5b73c41 admin admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:06.689891 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9949fee1-e410-431f-b36f-09753b6992da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:06.690703 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949fee1-e410-431f-b36f-09753b6992da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:06.691077 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949fee1-e410-431f-b36f-09753b6992da admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:06.691356 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c50e3ba-cfff-4fde-bde9-84e9f5b73c41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:32:06.691626 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949fee1-e410-431f-b36f-09753b6992da admin admin] PATH_INFO: `/v3/projects/0110950506e848c29e11648fa49ace04` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:06.692312 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c50e3ba-cfff-4fde-bde9-84e9f5b73c41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:06.693292 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9949fee1-e410-431f-b36f-09753b6992da admin admin] RBAC: Authorizing `identity:delete_project(project_id=0110950506e848c29e11648fa49ace04)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:06.695352 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c50e3ba-cfff-4fde-bde9-84e9f5b73c41 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:06.701742 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9949fee1-e410-431f-b36f-09753b6992da admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:06.710923 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1164/2349] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 2 15:32:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:32:06.716806 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c50e3ba-cfff-4fde-bde9-84e9f5b73c41 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:06.741380 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c50e3ba-cfff-4fde-bde9-84e9f5b73c41 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:06.750171 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8ad3ed-057f-4a8e-9eb3-1ba40e07d4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:06.751010 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ad3ed-057f-4a8e-9eb3-1ba40e07d4f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:06.751838 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ad3ed-057f-4a8e-9eb3-1ba40e07d4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:06.752225 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ad3ed-057f-4a8e-9eb3-1ba40e07d4f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:06.753183 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8ad3ed-057f-4a8e-9eb3-1ba40e07d4f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:06.755806 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8ad3ed-057f-4a8e-9eb3-1ba40e07d4f3 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:06.789846 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-9949fee1-e410-431f-b36f-09753b6992da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0110950506e848c29e11648fa49ace04', 'request_id': 'req-9949fee1-e410-431f-b36f-09753b6992da'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:06.795604 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1165/2350] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:32:06 2022] POST /identity/v3/projects => generated 397 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:32:06.801500 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8ad3ed-057f-4a8e-9eb3-1ba40e07d4f3 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:06.813810 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-9949fee1-e410-431f-b36f-09753b6992da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0110950506e848c29e11648fa49ace04', 'request_id': 'req-9949fee1-e410-431f-b36f-09753b6992da'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:06.824420 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-9949fee1-e410-431f-b36f-09753b6992da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0110950506e848c29e11648fa49ace04', 'request_id': 'req-9949fee1-e410-431f-b36f-09753b6992da'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:06.836728 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-9949fee1-e410-431f-b36f-09753b6992da admin admin] The token cache is being invalidate because project 0110950506e848c29e11648fa49ace04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:32:06.837053 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-9949fee1-e410-431f-b36f-09753b6992da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:06.838272 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-9949fee1-e410-431f-b36f-09753b6992da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:06.840668 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1186/2351] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:32:06 2022] DELETE /identity/v3/projects/0110950506e848c29e11648fa49ace04 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:32:06.847158 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7544e2-b157-4b4e-a7bf-b273fe8d59c7 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:06.848071 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7544e2-b157-4b4e-a7bf-b273fe8d59c7 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:06.848632 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7544e2-b157-4b4e-a7bf-b273fe8d59c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:06.882102 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-6a7544e2-b157-4b4e-a7bf-b273fe8d59c7 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:32:06.883377 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-6a7544e2-b157-4b4e-a7bf-b273fe8d59c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:06.892769 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8ad3ed-057f-4a8e-9eb3-1ba40e07d4f3 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:06.893435 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1187/2352] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:32:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:32:06.900032 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6002def6-ec7b-46bf-8824-06d2c39ec5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:06.901570 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd447511-1c54-4708-81e5-07e19227290a None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:06.901859 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd447511-1c54-4708-81e5-07e19227290a None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:06.902134 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd447511-1c54-4708-81e5-07e19227290a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:06.904006 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6002def6-ec7b-46bf-8824-06d2c39ec5c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:06.904396 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6002def6-ec7b-46bf-8824-06d2c39ec5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:06.904874 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6002def6-ec7b-46bf-8824-06d2c39ec5c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:06.905580 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6002def6-ec7b-46bf-8824-06d2c39ec5c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:06.907708 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6002def6-ec7b-46bf-8824-06d2c39ec5c2 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:06.924695 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-fd447511-1c54-4708-81e5-07e19227290a None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:32:06.926239 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-fd447511-1c54-4708-81e5-07e19227290a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:06.933990 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1166/2353] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:32:06 2022] POST /identity/v3/users => generated 299 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:32:06.935684 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1188/2354] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:32:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:32:06.937918 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6002def6-ec7b-46bf-8824-06d2c39ec5c2 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:06.939681 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd447511-1c54-4708-81e5-07e19227290a None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:06.940249 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-6002def6-ec7b-46bf-8824-06d2c39ec5c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:06.949641 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd447511-1c54-4708-81e5-07e19227290a None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:06.953496 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6002def6-ec7b-46bf-8824-06d2c39ec5c2 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:06.954514 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e19712-9ea8-4c36-8968-c07d7d6d0756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:06.955181 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e19712-9ea8-4c36-8968-c07d7d6d0756 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:06.955503 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e19712-9ea8-4c36-8968-c07d7d6d0756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:06.955934 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e19712-9ea8-4c36-8968-c07d7d6d0756 admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:06.956968 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e19712-9ea8-4c36-8968-c07d7d6d0756 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:32:06.957201 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e19712-9ea8-4c36-8968-c07d7d6d0756 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:06.958807 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e19712-9ea8-4c36-8968-c07d7d6d0756 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:06.959491 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7906a4b4-59df-4ad2-98bb-6e80ab3ff3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:06.960352 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7906a4b4-59df-4ad2-98bb-6e80ab3ff3cc admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:06.960716 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7906a4b4-59df-4ad2-98bb-6e80ab3ff3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:06.961052 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7906a4b4-59df-4ad2-98bb-6e80ab3ff3cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:06.962259 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7906a4b4-59df-4ad2-98bb-6e80ab3ff3cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:06.963709 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7906a4b4-59df-4ad2-98bb-6e80ab3ff3cc admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:06.972851 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1189/2355] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 2 15:32:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:32:06.977396 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1167/2356] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:32:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 15:32:06.977396 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7906a4b4-59df-4ad2-98bb-6e80ab3ff3cc admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:06.978759 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e19712-9ea8-4c36-8968-c07d7d6d0756 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:06.991155 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e19712-9ea8-4c36-8968-c07d7d6d0756 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:06.991519 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7906a4b4-59df-4ad2-98bb-6e80ab3ff3cc admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:06.997668 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e52234-a523-4c1c-bf2c-4cd2055b3b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:06.998321 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e52234-a523-4c1c-bf2c-4cd2055b3b34 admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:06.998429 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca368e8-5a36-44e5-8197-d9ba4f263489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:06.999119 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca368e8-5a36-44e5-8197-d9ba4f263489 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:06.999252 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e52234-a523-4c1c-bf2c-4cd2055b3b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:06.999510 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e52234-a523-4c1c-bf2c-4cd2055b3b34 admin admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:06.999614 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca368e8-5a36-44e5-8197-d9ba4f263489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:06.999873 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca368e8-5a36-44e5-8197-d9ba4f263489 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:07.000191 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e52234-a523-4c1c-bf2c-4cd2055b3b34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:07.001211 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca368e8-5a36-44e5-8197-d9ba4f263489 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:07.002120 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e52234-a523-4c1c-bf2c-4cd2055b3b34 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:07.002970 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca368e8-5a36-44e5-8197-d9ba4f263489 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:07.010091 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:32:07.017393 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1190/2357] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:32:06 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 15:32:07.020843 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca368e8-5a36-44e5-8197-d9ba4f263489 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:07.033697 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca368e8-5a36-44e5-8197-d9ba4f263489 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:07.048008 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7509628-be36-4e3d-a7fa-8a85a274fad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:07.048498 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7509628-be36-4e3d-a7fa-8a85a274fad1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:07.048775 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7509628-be36-4e3d-a7fa-8a85a274fad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:07.049047 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7509628-be36-4e3d-a7fa-8a85a274fad1 admin admin] PATH_INFO: `/v3/projects/130be770620d43a0bedf1ab1685b4197/users/f13894ba4f9c440c8e92b3e0ba32ee59/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:07.054247 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1168/2358] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:32:06 2022] POST /identity/v3/projects => generated 369 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 15:32:07.060119 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e52234-a523-4c1c-bf2c-4cd2055b3b34 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:07.067153 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7509628-be36-4e3d-a7fa-8a85a274fad1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=130be770620d43a0bedf1ab1685b4197, user_id=f13894ba4f9c440c8e92b3e0ba32ee59, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:07.069871 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7509628-be36-4e3d-a7fa-8a85a274fad1 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:07.084738 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1191/2359] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:32:07 2022] PUT /identity/v3/projects/130be770620d43a0bedf1ab1685b4197/users/f13894ba4f9c440c8e92b3e0ba32ee59/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:32:07.095107 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51bb2de-3736-450b-b594-07f40745f536 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:07.095423 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51bb2de-3736-450b-b594-07f40745f536 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:07.095705 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51bb2de-3736-450b-b594-07f40745f536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:07.123491 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-a51bb2de-3736-450b-b594-07f40745f536 None None] MFA Rules not processed for user `f13894ba4f9c440c8e92b3e0ba32ee59`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:32:07.124685 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-a51bb2de-3736-450b-b594-07f40745f536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:07.131462 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e52234-a523-4c1c-bf2c-4cd2055b3b34 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:07.145331 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:32:07.211009 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1192/2360] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:32:07 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:32:07.215556 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad54be1-7d40-4c4b-8f76-8afe0f36b04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:07.216187 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad54be1-7d40-4c4b-8f76-8afe0f36b04c admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:07.216469 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad54be1-7d40-4c4b-8f76-8afe0f36b04c admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:07.216773 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad54be1-7d40-4c4b-8f76-8afe0f36b04c admin admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:07.217398 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad54be1-7d40-4c4b-8f76-8afe0f36b04c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:07.219336 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad54be1-7d40-4c4b-8f76-8afe0f36b04c admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:07.223604 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51bb2de-3736-450b-b594-07f40745f536 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:07.225359 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-a51bb2de-3736-450b-b594-07f40745f536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:07.247917 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1169/2361] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:32:07 2022] POST /identity/v3/users => generated 285 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:32:07.251761 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad54be1-7d40-4c4b-8f76-8afe0f36b04c admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:07.264273 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad54be1-7d40-4c4b-8f76-8afe0f36b04c admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:07.273479 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d517a-aefd-4a60-a3c1-2d71b2c1df57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:07.274091 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d517a-aefd-4a60-a3c1-2d71b2c1df57 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:07.274685 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d517a-aefd-4a60-a3c1-2d71b2c1df57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:07.274685 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d517a-aefd-4a60-a3c1-2d71b2c1df57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:07.275490 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8d517a-aefd-4a60-a3c1-2d71b2c1df57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:07.277146 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8d517a-aefd-4a60-a3c1-2d71b2c1df57 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:07.291346 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1170/2362] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:32:07 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 15:32:07.295282 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d517a-aefd-4a60-a3c1-2d71b2c1df57 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:07.300991 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51bb2de-3736-450b-b594-07f40745f536 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:07.305360 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac8022e-4812-48f6-b2da-8d2f3b68773c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:07.306900 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8022e-4812-48f6-b2da-8d2f3b68773c service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:07.307190 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8022e-4812-48f6-b2da-8d2f3b68773c service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:07.307501 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8022e-4812-48f6-b2da-8d2f3b68773c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:07.317665 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac8022e-4812-48f6-b2da-8d2f3b68773c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:07.319138 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d517a-aefd-4a60-a3c1-2d71b2c1df57 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:07.319325 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac8022e-4812-48f6-b2da-8d2f3b68773c service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:07.324487 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e89b84-1359-4b07-a8d5-13ed0d92cbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:07.325350 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e89b84-1359-4b07-a8d5-13ed0d92cbd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:07.325670 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e89b84-1359-4b07-a8d5-13ed0d92cbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:07.325945 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e89b84-1359-4b07-a8d5-13ed0d92cbd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:07.326645 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e89b84-1359-4b07-a8d5-13ed0d92cbd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:07.328267 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e89b84-1359-4b07-a8d5-13ed0d92cbd4 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:07.341161 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1193/2363] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:32:07 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:32:07.343250 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1171/2364] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:32:07 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 15:32:07.346131 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac8022e-4812-48f6-b2da-8d2f3b68773c service cinder] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:07.360162 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac8022e-4812-48f6-b2da-8d2f3b68773c service cinder] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:07.363022 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f45c851-f600-4af8-a561-58659eca05bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:07.363724 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f45c851-f600-4af8-a561-58659eca05bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:07.364012 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f45c851-f600-4af8-a561-58659eca05bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:07.364293 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f45c851-f600-4af8-a561-58659eca05bf admin admin] PATH_INFO: `/v3/projects/82127bfc118b46a9acc91f993ce2f483/users/6a7e84f216b04eef8c0fc48fa6652458/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:07.380326 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f45c851-f600-4af8-a561-58659eca05bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=82127bfc118b46a9acc91f993ce2f483, user_id=6a7e84f216b04eef8c0fc48fa6652458, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:07.382980 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f45c851-f600-4af8-a561-58659eca05bf admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:07.397156 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1194/2365] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:32:07 2022] PUT /identity/v3/projects/82127bfc118b46a9acc91f993ce2f483/users/6a7e84f216b04eef8c0fc48fa6652458/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 15:32:07.407827 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12515fab-79f6-4fc6-b801-c1280bf56701 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:07.408121 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12515fab-79f6-4fc6-b801-c1280bf56701 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:07.408460 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12515fab-79f6-4fc6-b801-c1280bf56701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:07.442694 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-12515fab-79f6-4fc6-b801-c1280bf56701 None None] MFA Rules not processed for user `6a7e84f216b04eef8c0fc48fa6652458`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:32:07.443972 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-12515fab-79f6-4fc6-b801-c1280bf56701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:07.519406 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1172/2366] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:32:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:32:07.530538 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f45c851-f600-4af8-a561-58659eca05bf admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:07.583020 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:32:07.594579 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f45c851-f600-4af8-a561-58659eca05bf admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:07.598738 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6260019-7830-4351-8977-27b996ee397d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:07.599393 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6260019-7830-4351-8977-27b996ee397d service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:07.599680 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6260019-7830-4351-8977-27b996ee397d service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:07.599959 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6260019-7830-4351-8977-27b996ee397d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:07.609279 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6260019-7830-4351-8977-27b996ee397d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:07.610760 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6260019-7830-4351-8977-27b996ee397d service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:07.620512 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1195/2367] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:32:07 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:32:07.643849 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12515fab-79f6-4fc6-b801-c1280bf56701 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:07.717556 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12515fab-79f6-4fc6-b801-c1280bf56701 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:07.722491 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab965fe-65fa-44ef-ada8-972714163b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:07.723300 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab965fe-65fa-44ef-ada8-972714163b57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:07.723597 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab965fe-65fa-44ef-ada8-972714163b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:07.723863 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab965fe-65fa-44ef-ada8-972714163b57 admin admin] PATH_INFO: `/v3/users/6a7e84f216b04eef8c0fc48fa6652458` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:07.725228 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab965fe-65fa-44ef-ada8-972714163b57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a7e84f216b04eef8c0fc48fa6652458)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:07.727257 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab965fe-65fa-44ef-ada8-972714163b57 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:07.745147 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:32:07.813338 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-7ab965fe-65fa-44ef-ada8-972714163b57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a7e84f216b04eef8c0fc48fa6652458'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:07.830421 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-7ab965fe-65fa-44ef-ada8-972714163b57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a7e84f216b04eef8c0fc48fa6652458'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:07.850247 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-7ab965fe-65fa-44ef-ada8-972714163b57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a7e84f216b04eef8c0fc48fa6652458'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:07.851083 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-7ab965fe-65fa-44ef-ada8-972714163b57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a7e84f216b04eef8c0fc48fa6652458'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:07.851864 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-7ab965fe-65fa-44ef-ada8-972714163b57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a7e84f216b04eef8c0fc48fa6652458'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:07.868384 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1173/2368] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:32:07 2022] DELETE /identity/v3/users/6a7e84f216b04eef8c0fc48fa6652458 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:32:07.872991 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da40925-66a7-4158-a3bf-3bc23b6a6c7f None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:07.873448 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da40925-66a7-4158-a3bf-3bc23b6a6c7f None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:07.873633 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da40925-66a7-4158-a3bf-3bc23b6a6c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:07.892843 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-4da40925-66a7-4158-a3bf-3bc23b6a6c7f None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:32:07.894214 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-4da40925-66a7-4158-a3bf-3bc23b6a6c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:07.960430 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1196/2369] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:32:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:32:07.971390 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab965fe-65fa-44ef-ada8-972714163b57 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:07.972784 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-7ab965fe-65fa-44ef-ada8-972714163b57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:08.031206 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab965fe-65fa-44ef-ada8-972714163b57 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:08.035164 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154c587-4422-4e8d-8968-d19ec30d7351 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:08.035928 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154c587-4422-4e8d-8968-d19ec30d7351 service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:08.036239 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154c587-4422-4e8d-8968-d19ec30d7351 service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:08.036608 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154c587-4422-4e8d-8968-d19ec30d7351 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:08.048033 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e154c587-4422-4e8d-8968-d19ec30d7351 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:08.049505 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e154c587-4422-4e8d-8968-d19ec30d7351 service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:08.059485 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1174/2370] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:32:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:32:08.639530 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da40925-66a7-4158-a3bf-3bc23b6a6c7f None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:08.641253 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-4da40925-66a7-4158-a3bf-3bc23b6a6c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:08.653459 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da40925-66a7-4158-a3bf-3bc23b6a6c7f None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:08.658510 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae29a90-5366-4789-8cee-80b95c3a04ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:08.659158 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae29a90-5366-4789-8cee-80b95c3a04ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:08.659471 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae29a90-5366-4789-8cee-80b95c3a04ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:08.659751 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae29a90-5366-4789-8cee-80b95c3a04ad admin admin] PATH_INFO: `/v3/projects/82127bfc118b46a9acc91f993ce2f483` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:08.660986 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae29a90-5366-4789-8cee-80b95c3a04ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=82127bfc118b46a9acc91f993ce2f483)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:08.662944 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae29a90-5366-4789-8cee-80b95c3a04ad admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:08.715649 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-7ae29a90-5366-4789-8cee-80b95c3a04ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82127bfc118b46a9acc91f993ce2f483', 'request_id': 'req-7ae29a90-5366-4789-8cee-80b95c3a04ad'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:08.723874 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-7ae29a90-5366-4789-8cee-80b95c3a04ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82127bfc118b46a9acc91f993ce2f483', 'request_id': 'req-7ae29a90-5366-4789-8cee-80b95c3a04ad'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:08.730761 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-7ae29a90-5366-4789-8cee-80b95c3a04ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82127bfc118b46a9acc91f993ce2f483', 'request_id': 'req-7ae29a90-5366-4789-8cee-80b95c3a04ad'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:08.741252 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-7ae29a90-5366-4789-8cee-80b95c3a04ad admin admin] The token cache is being invalidate because project 82127bfc118b46a9acc91f993ce2f483 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:32:08.741540 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-7ae29a90-5366-4789-8cee-80b95c3a04ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:08.742183 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-7ae29a90-5366-4789-8cee-80b95c3a04ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:08.744388 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1197/2371] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:32:08 2022] DELETE /identity/v3/projects/82127bfc118b46a9acc91f993ce2f483 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:32:08.749724 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e942d2da-acb7-4940-93e6-db5425520b6e None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:08.750185 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e942d2da-acb7-4940-93e6-db5425520b6e None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:08.750280 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e942d2da-acb7-4940-93e6-db5425520b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:08.769958 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-e942d2da-acb7-4940-93e6-db5425520b6e None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:32:08.771163 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-e942d2da-acb7-4940-93e6-db5425520b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:08.831771 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1175/2372] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:32:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:32:08.839987 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0823893-2a4b-4880-bccf-f4a72d5264ba None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:08.839987 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0823893-2a4b-4880-bccf-f4a72d5264ba None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:08.840297 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0823893-2a4b-4880-bccf-f4a72d5264ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:08.862714 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-f0823893-2a4b-4880-bccf-f4a72d5264ba None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:32:08.864118 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-f0823893-2a4b-4880-bccf-f4a72d5264ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:08.874086 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1198/2373] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:32:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:32:08.878475 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e942d2da-acb7-4940-93e6-db5425520b6e None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:08.892200 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e942d2da-acb7-4940-93e6-db5425520b6e None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:08.894876 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b044397b-f8eb-41ab-8ef8-2ae73067ee02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:08.895557 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044397b-f8eb-41ab-8ef8-2ae73067ee02 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:08.895830 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044397b-f8eb-41ab-8ef8-2ae73067ee02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:08.896194 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044397b-f8eb-41ab-8ef8-2ae73067ee02 admin admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:08.897051 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b044397b-f8eb-41ab-8ef8-2ae73067ee02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:32:08.897382 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b044397b-f8eb-41ab-8ef8-2ae73067ee02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:08.899290 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b044397b-f8eb-41ab-8ef8-2ae73067ee02 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:08.924386 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1176/2374] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 2 15:32:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:32:08.925369 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0823893-2a4b-4880-bccf-f4a72d5264ba None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:08.935680 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0823893-2a4b-4880-bccf-f4a72d5264ba None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:08.941526 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076fedcf-ddfd-4fcd-9c31-8ff58183ddea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:08.942687 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076fedcf-ddfd-4fcd-9c31-8ff58183ddea admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:08.942977 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076fedcf-ddfd-4fcd-9c31-8ff58183ddea admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:08.943282 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076fedcf-ddfd-4fcd-9c31-8ff58183ddea admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:08.944002 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076fedcf-ddfd-4fcd-9c31-8ff58183ddea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:08.945938 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076fedcf-ddfd-4fcd-9c31-8ff58183ddea admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:08.984747 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1199/2375] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:32:08 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:32:08.986396 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b044397b-f8eb-41ab-8ef8-2ae73067ee02 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:08.997225 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b044397b-f8eb-41ab-8ef8-2ae73067ee02 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:09.019094 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:32:09.058345 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a10dac5-4a56-4f73-b625-1157ead17f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:09.058984 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10dac5-4a56-4f73-b625-1157ead17f84 admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:09.059290 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10dac5-4a56-4f73-b625-1157ead17f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:09.059567 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10dac5-4a56-4f73-b625-1157ead17f84 admin admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:09.060217 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a10dac5-4a56-4f73-b625-1157ead17f84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:09.062122 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a10dac5-4a56-4f73-b625-1157ead17f84 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:09.084084 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1177/2376] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:32:08 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:32:09.088755 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076fedcf-ddfd-4fcd-9c31-8ff58183ddea admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:09.098935 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076fedcf-ddfd-4fcd-9c31-8ff58183ddea admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:09.104057 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14676475-c1a3-4bf1-8e32-2a82ed979eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:09.104669 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14676475-c1a3-4bf1-8e32-2a82ed979eea admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:09.104953 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14676475-c1a3-4bf1-8e32-2a82ed979eea admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:09.105227 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14676475-c1a3-4bf1-8e32-2a82ed979eea admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:09.105943 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14676475-c1a3-4bf1-8e32-2a82ed979eea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:09.107583 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14676475-c1a3-4bf1-8e32-2a82ed979eea admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:09.117455 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1200/2377] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:32:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:32:09.121619 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a10dac5-4a56-4f73-b625-1157ead17f84 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:09.131706 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a10dac5-4a56-4f73-b625-1157ead17f84 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:09.136560 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b672df8-2129-440a-bcf5-92ebf82ffc23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:09.137176 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b672df8-2129-440a-bcf5-92ebf82ffc23 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:09.137462 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b672df8-2129-440a-bcf5-92ebf82ffc23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:09.137741 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b672df8-2129-440a-bcf5-92ebf82ffc23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:09.138431 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b672df8-2129-440a-bcf5-92ebf82ffc23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:09.140071 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b672df8-2129-440a-bcf5-92ebf82ffc23 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:09.152816 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1178/2378] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:32:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 15:32:09.157208 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14676475-c1a3-4bf1-8e32-2a82ed979eea admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:09.169389 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14676475-c1a3-4bf1-8e32-2a82ed979eea admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:09.177743 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef0691-a9ae-4738-8091-caf11644ecb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:09.178498 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef0691-a9ae-4738-8091-caf11644ecb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:09.178910 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef0691-a9ae-4738-8091-caf11644ecb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:09.179365 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef0691-a9ae-4738-8091-caf11644ecb4 admin admin] PATH_INFO: `/v3/projects/655b32d87dc341cc974a0a1f06c60b27/users/af64ae9d51114ac29dd5054088ad90ee/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:09.198063 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfef0691-a9ae-4738-8091-caf11644ecb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=655b32d87dc341cc974a0a1f06c60b27, user_id=af64ae9d51114ac29dd5054088ad90ee, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:09.200758 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfef0691-a9ae-4738-8091-caf11644ecb4 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:09.214936 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1201/2379] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:32:09 2022] PUT /identity/v3/projects/655b32d87dc341cc974a0a1f06c60b27/users/af64ae9d51114ac29dd5054088ad90ee/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:32:09.225123 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a85c3e-344d-4de4-91b9-1f3fba71c495 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:09.225411 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a85c3e-344d-4de4-91b9-1f3fba71c495 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:09.225689 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a85c3e-344d-4de4-91b9-1f3fba71c495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:09.256852 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-48a85c3e-344d-4de4-91b9-1f3fba71c495 None None] MFA Rules not processed for user `af64ae9d51114ac29dd5054088ad90ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:32:09.258088 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-48a85c3e-344d-4de4-91b9-1f3fba71c495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:09.335954 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1179/2380] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:32:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:32:09.341132 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef0691-a9ae-4738-8091-caf11644ecb4 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:09.350801 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:32:09.412857 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef0691-a9ae-4738-8091-caf11644ecb4 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:09.418145 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e37e54d-cf1e-4df8-86b3-a2c16107266f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:09.418768 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37e54d-cf1e-4df8-86b3-a2c16107266f admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:09.419049 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37e54d-cf1e-4df8-86b3-a2c16107266f admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:09.419352 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37e54d-cf1e-4df8-86b3-a2c16107266f admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:09.420011 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e37e54d-cf1e-4df8-86b3-a2c16107266f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:09.422169 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e37e54d-cf1e-4df8-86b3-a2c16107266f admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:09.449558 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1202/2381] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:32:09 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:32:09.453693 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a85c3e-344d-4de4-91b9-1f3fba71c495 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:09.465541 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a85c3e-344d-4de4-91b9-1f3fba71c495 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:09.522552 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92716981-c6a5-4073-bed5-42279bb11ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:09.523084 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92716981-c6a5-4073-bed5-42279bb11ab0 admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:09.523398 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92716981-c6a5-4073-bed5-42279bb11ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:09.523675 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92716981-c6a5-4073-bed5-42279bb11ab0 admin admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:09.524330 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92716981-c6a5-4073-bed5-42279bb11ab0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:09.526268 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92716981-c6a5-4073-bed5-42279bb11ab0 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:09.547405 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1180/2382] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:32:09 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:32:09.551427 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e37e54d-cf1e-4df8-86b3-a2c16107266f admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:09.562317 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e37e54d-cf1e-4df8-86b3-a2c16107266f admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:09.566974 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db4aa6-5dc2-4851-902b-d00a455e9ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:09.567616 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db4aa6-5dc2-4851-902b-d00a455e9ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:09.567907 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db4aa6-5dc2-4851-902b-d00a455e9ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:09.568184 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db4aa6-5dc2-4851-902b-d00a455e9ba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:09.568877 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5db4aa6-5dc2-4851-902b-d00a455e9ba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:09.570476 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5db4aa6-5dc2-4851-902b-d00a455e9ba6 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:09.583250 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1203/2383] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:32:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:32:09.586215 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92716981-c6a5-4073-bed5-42279bb11ab0 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:09.596136 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92716981-c6a5-4073-bed5-42279bb11ab0 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:09.602425 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa5b7f2-4d1b-4079-a9b9-648578b18b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:09.603655 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5b7f2-4d1b-4079-a9b9-648578b18b78 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:09.603938 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5b7f2-4d1b-4079-a9b9-648578b18b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:09.604217 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5b7f2-4d1b-4079-a9b9-648578b18b78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:09.604913 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa5b7f2-4d1b-4079-a9b9-648578b18b78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:09.606526 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa5b7f2-4d1b-4079-a9b9-648578b18b78 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:09.617616 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1181/2384] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:32:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:32:09.626787 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db4aa6-5dc2-4851-902b-d00a455e9ba6 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:09.637060 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db4aa6-5dc2-4851-902b-d00a455e9ba6 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:09.641646 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f64dba7-0ff0-4c74-addb-9ceb3c3ad17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:09.642314 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f64dba7-0ff0-4c74-addb-9ceb3c3ad17e admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:09.642594 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f64dba7-0ff0-4c74-addb-9ceb3c3ad17e admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:09.642873 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f64dba7-0ff0-4c74-addb-9ceb3c3ad17e admin admin] PATH_INFO: `/v3/projects/03dfa4827bfd46798d6ea5f7a111026f/users/e7e9b31c24bc49cda746c3c33df00840/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:09.657742 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f64dba7-0ff0-4c74-addb-9ceb3c3ad17e admin admin] RBAC: Authorizing `identity:create_grant(project_id=03dfa4827bfd46798d6ea5f7a111026f, user_id=e7e9b31c24bc49cda746c3c33df00840, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:09.660467 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f64dba7-0ff0-4c74-addb-9ceb3c3ad17e admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:09.679881 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1204/2385] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:32:09 2022] PUT /identity/v3/projects/03dfa4827bfd46798d6ea5f7a111026f/users/e7e9b31c24bc49cda746c3c33df00840/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:32:09.693297 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d28cbb-9e3c-4341-a5ad-1e8aad202a50 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:09.693588 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d28cbb-9e3c-4341-a5ad-1e8aad202a50 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:09.693879 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d28cbb-9e3c-4341-a5ad-1e8aad202a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:09.715770 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:32:09.724245 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-38d28cbb-9e3c-4341-a5ad-1e8aad202a50 None None] MFA Rules not processed for user `e7e9b31c24bc49cda746c3c33df00840`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:32:09.725835 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-38d28cbb-9e3c-4341-a5ad-1e8aad202a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:09.804099 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1182/2386] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:32:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:32:09.805408 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f64dba7-0ff0-4c74-addb-9ceb3c3ad17e admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:09.872021 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f64dba7-0ff0-4c74-addb-9ceb3c3ad17e admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:09.876863 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21ababa-7a46-4a83-93f9-224080ed44c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:09.877564 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ababa-7a46-4a83-93f9-224080ed44c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:09.877850 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ababa-7a46-4a83-93f9-224080ed44c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:09.878130 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ababa-7a46-4a83-93f9-224080ed44c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:09.878877 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21ababa-7a46-4a83-93f9-224080ed44c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:09.881075 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21ababa-7a46-4a83-93f9-224080ed44c1 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:09.924785 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1205/2387] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:32:09 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:32:09.929708 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d28cbb-9e3c-4341-a5ad-1e8aad202a50 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:09.943891 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d28cbb-9e3c-4341-a5ad-1e8aad202a50 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:10.010433 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf56f8a-d44b-4583-8ef5-273f33b9a001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:10.011353 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf56f8a-d44b-4583-8ef5-273f33b9a001 admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:10.011686 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf56f8a-d44b-4583-8ef5-273f33b9a001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:10.011967 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf56f8a-d44b-4583-8ef5-273f33b9a001 admin admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:10.012663 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf56f8a-d44b-4583-8ef5-273f33b9a001 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:10.014624 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf56f8a-d44b-4583-8ef5-273f33b9a001 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:10.036447 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1183/2388] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:32:09 2022] POST /identity/v3/users => generated 299 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:32:10.040450 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21ababa-7a46-4a83-93f9-224080ed44c1 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:10.050864 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21ababa-7a46-4a83-93f9-224080ed44c1 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:10.055693 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b472ee1d-e697-4617-a9b6-210355915203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:10.056781 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472ee1d-e697-4617-a9b6-210355915203 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:10.057068 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472ee1d-e697-4617-a9b6-210355915203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:10.057347 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472ee1d-e697-4617-a9b6-210355915203 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:10.058033 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b472ee1d-e697-4617-a9b6-210355915203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:10.059669 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b472ee1d-e697-4617-a9b6-210355915203 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:10.070115 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1206/2389] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:32:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:32:10.075036 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf56f8a-d44b-4583-8ef5-273f33b9a001 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:10.085119 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf56f8a-d44b-4583-8ef5-273f33b9a001 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:10.089869 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5390b7-ef8b-475f-bced-8752b7deb336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:10.090525 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5390b7-ef8b-475f-bced-8752b7deb336 admin admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:10.090810 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5390b7-ef8b-475f-bced-8752b7deb336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:10.091091 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5390b7-ef8b-475f-bced-8752b7deb336 admin admin] PATH_INFO: `/v3/projects/44e2001f0e88432d94e4c25902df2126/users/f768b84bef744be5b446c5b9defdeaea/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:10.105838 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5390b7-ef8b-475f-bced-8752b7deb336 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44e2001f0e88432d94e4c25902df2126, user_id=f768b84bef744be5b446c5b9defdeaea, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:10.108603 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5390b7-ef8b-475f-bced-8752b7deb336 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:10.121827 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1184/2390] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:32:10 2022] PUT /identity/v3/projects/44e2001f0e88432d94e4c25902df2126/users/f768b84bef744be5b446c5b9defdeaea/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:32:10.125855 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b472ee1d-e697-4617-a9b6-210355915203 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:10.136679 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b472ee1d-e697-4617-a9b6-210355915203 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:10.166636 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:32:10.195889 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e34553e-a772-436d-9185-deaf1ea158f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:10.196510 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34553e-a772-436d-9185-deaf1ea158f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:10.196817 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34553e-a772-436d-9185-deaf1ea158f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:10.197096 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34553e-a772-436d-9185-deaf1ea158f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:10.197856 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e34553e-a772-436d-9185-deaf1ea158f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:10.199478 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e34553e-a772-436d-9185-deaf1ea158f0 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:10.209323 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1207/2391] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:32:10 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:32:10.213706 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5390b7-ef8b-475f-bced-8752b7deb336 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:10.224957 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5390b7-ef8b-475f-bced-8752b7deb336 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:10.230120 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12b61df-a675-4425-829c-07014e9037a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:10.230779 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b61df-a675-4425-829c-07014e9037a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:10.231061 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b61df-a675-4425-829c-07014e9037a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:10.231377 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b61df-a675-4425-829c-07014e9037a7 admin admin] PATH_INFO: `/v3/projects/44e2001f0e88432d94e4c25902df2126/users/f768b84bef744be5b446c5b9defdeaea/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:10.233312 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12b61df-a675-4425-829c-07014e9037a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44e2001f0e88432d94e4c25902df2126, user_id=f768b84bef744be5b446c5b9defdeaea, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:10.235966 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12b61df-a675-4425-829c-07014e9037a7 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:10.247589 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1185/2392] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:32:10 2022] PUT /identity/v3/projects/44e2001f0e88432d94e4c25902df2126/users/f768b84bef744be5b446c5b9defdeaea/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:32:10.258064 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f7f3bc-8a85-49d4-813c-364bc317cb07 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:10.258361 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f7f3bc-8a85-49d4-813c-364bc317cb07 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:10.258647 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f7f3bc-8a85-49d4-813c-364bc317cb07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:10.288459 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-74f7f3bc-8a85-49d4-813c-364bc317cb07 None None] MFA Rules not processed for user `f768b84bef744be5b446c5b9defdeaea`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:32:10.289724 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-74f7f3bc-8a85-49d4-813c-364bc317cb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:10.360959 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1208/2393] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:32:10 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:32:10.372997 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12b61df-a675-4425-829c-07014e9037a7 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:10.374692 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-c12b61df-a675-4425-829c-07014e9037a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:10.432302 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12b61df-a675-4425-829c-07014e9037a7 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:10.435931 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ef3c0-a0a3-44a2-9b5e-69c3dac28b18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:10.436576 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ef3c0-a0a3-44a2-9b5e-69c3dac28b18 service cinder] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:10.436856 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ef3c0-a0a3-44a2-9b5e-69c3dac28b18 service cinder] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:10.437161 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ef3c0-a0a3-44a2-9b5e-69c3dac28b18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:10.443079 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:32:10.498932 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907ef3c0-a0a3-44a2-9b5e-69c3dac28b18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:10.498932 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907ef3c0-a0a3-44a2-9b5e-69c3dac28b18 service cinder] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:10.508314 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1186/2394] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:32:10 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:32:12.792902 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aaaeaa-d6cb-487e-a99f-039f0bc72ccb None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:12.793463 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aaaeaa-d6cb-487e-a99f-039f0bc72ccb None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:12.793670 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aaaeaa-d6cb-487e-a99f-039f0bc72ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:12.814702 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-d6aaaeaa-d6cb-487e-a99f-039f0bc72ccb None None] MFA Rules not processed for user `73208e627bdc4315b4e1eed3a96a2b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:32:12.816134 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-d6aaaeaa-d6cb-487e-a99f-039f0bc72ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:12.873196 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1209/2395] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:32:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:32:13.114074 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ef3c0-a0a3-44a2-9b5e-69c3dac28b18 service cinder] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:13.123498 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ef3c0-a0a3-44a2-9b5e-69c3dac28b18 service cinder] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:13.138293 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5010788-d8c5-41ef-a443-800569eabe1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:13.139110 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5010788-d8c5-41ef-a443-800569eabe1f service cinder] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:13.139629 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5010788-d8c5-41ef-a443-800569eabe1f service cinder] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:13.140092 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5010788-d8c5-41ef-a443-800569eabe1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:13.223648 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5010788-d8c5-41ef-a443-800569eabe1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:13.225156 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5010788-d8c5-41ef-a443-800569eabe1f service cinder] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:13.254695 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1187/2396] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:32:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:32:16.205237 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aaaeaa-d6cb-487e-a99f-039f0bc72ccb None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:16.214664 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aaaeaa-d6cb-487e-a99f-039f0bc72ccb None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:16.219170 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0603030e-e4be-4ef0-9268-38ef2d4c32bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:16.219802 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0603030e-e4be-4ef0-9268-38ef2d4c32bf service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:16.220086 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0603030e-e4be-4ef0-9268-38ef2d4c32bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:16.220359 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0603030e-e4be-4ef0-9268-38ef2d4c32bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:16.230202 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0603030e-e4be-4ef0-9268-38ef2d4c32bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:16.231678 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0603030e-e4be-4ef0-9268-38ef2d4c32bf service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:16.241480 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1210/2397] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:32:16 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:32:19.896740 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5010788-d8c5-41ef-a443-800569eabe1f service cinder] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:19.898410 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-e5010788-d8c5-41ef-a443-800569eabe1f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:19.998736 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5010788-d8c5-41ef-a443-800569eabe1f service cinder] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:20.003633 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbdeeb8-6a7b-4278-a7b5-7f3892d28cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:20.004357 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbdeeb8-6a7b-4278-a7b5-7f3892d28cc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:20.004718 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbdeeb8-6a7b-4278-a7b5-7f3892d28cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:20.005064 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbdeeb8-6a7b-4278-a7b5-7f3892d28cc8 admin admin] PATH_INFO: `/v3/users/f13894ba4f9c440c8e92b3e0ba32ee59` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:20.006320 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbdeeb8-6a7b-4278-a7b5-7f3892d28cc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f13894ba4f9c440c8e92b3e0ba32ee59)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:20.008520 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbdeeb8-6a7b-4278-a7b5-7f3892d28cc8 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:20.071970 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-2bbdeeb8-6a7b-4278-a7b5-7f3892d28cc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f13894ba4f9c440c8e92b3e0ba32ee59'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:20.073432 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:32:20.083233 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-2bbdeeb8-6a7b-4278-a7b5-7f3892d28cc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f13894ba4f9c440c8e92b3e0ba32ee59'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:20.099455 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-2bbdeeb8-6a7b-4278-a7b5-7f3892d28cc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f13894ba4f9c440c8e92b3e0ba32ee59'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:20.100298 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-2bbdeeb8-6a7b-4278-a7b5-7f3892d28cc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f13894ba4f9c440c8e92b3e0ba32ee59'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:20.100997 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-2bbdeeb8-6a7b-4278-a7b5-7f3892d28cc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f13894ba4f9c440c8e92b3e0ba32ee59'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:20.124650 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1188/2398] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:32:19 2022] DELETE /identity/v3/users/f13894ba4f9c440c8e92b3e0ba32ee59 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:32:20.129202 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ee130-da29-4789-afa4-c2c25c11fc83 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:20.129727 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ee130-da29-4789-afa4-c2c25c11fc83 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:20.129847 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ee130-da29-4789-afa4-c2c25c11fc83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:20.150328 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-f15ee130-da29-4789-afa4-c2c25c11fc83 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:32:20.153225 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-f15ee130-da29-4789-afa4-c2c25c11fc83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:20.196395 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:32:20.217424 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1211/2399] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:32:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:32:20.228875 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbdeeb8-6a7b-4278-a7b5-7f3892d28cc8 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:20.230912 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-2bbdeeb8-6a7b-4278-a7b5-7f3892d28cc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:20.301403 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbdeeb8-6a7b-4278-a7b5-7f3892d28cc8 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:20.305266 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f8ab13-7b63-40ad-9f02-af5033c77ad1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:20.305922 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8ab13-7b63-40ad-9f02-af5033c77ad1 service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:20.306188 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8ab13-7b63-40ad-9f02-af5033c77ad1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:20.306466 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8ab13-7b63-40ad-9f02-af5033c77ad1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:20.318404 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f8ab13-7b63-40ad-9f02-af5033c77ad1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:20.319892 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f8ab13-7b63-40ad-9f02-af5033c77ad1 service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:20.335159 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1189/2400] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:32:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 15:32:20.360403 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ee130-da29-4789-afa4-c2c25c11fc83 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:20.361841 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-f15ee130-da29-4789-afa4-c2c25c11fc83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:20.373722 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ee130-da29-4789-afa4-c2c25c11fc83 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:20.378449 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f909bc3-0f68-401f-981d-1c1af5cb53e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:20.379500 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f909bc3-0f68-401f-981d-1c1af5cb53e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:20.379937 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f909bc3-0f68-401f-981d-1c1af5cb53e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:20.380196 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f909bc3-0f68-401f-981d-1c1af5cb53e8 admin admin] PATH_INFO: `/v3/users/af64ae9d51114ac29dd5054088ad90ee` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:20.381573 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f909bc3-0f68-401f-981d-1c1af5cb53e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af64ae9d51114ac29dd5054088ad90ee)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:20.383737 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f909bc3-0f68-401f-981d-1c1af5cb53e8 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:20.444209 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-1f909bc3-0f68-401f-981d-1c1af5cb53e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af64ae9d51114ac29dd5054088ad90ee'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:20.460900 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-1f909bc3-0f68-401f-981d-1c1af5cb53e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af64ae9d51114ac29dd5054088ad90ee'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:20.462233 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-1f909bc3-0f68-401f-981d-1c1af5cb53e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af64ae9d51114ac29dd5054088ad90ee'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:20.474514 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-1f909bc3-0f68-401f-981d-1c1af5cb53e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af64ae9d51114ac29dd5054088ad90ee'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:20.485932 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-1f909bc3-0f68-401f-981d-1c1af5cb53e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af64ae9d51114ac29dd5054088ad90ee'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:20.502146 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1212/2401] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:32:20 2022] DELETE /identity/v3/users/af64ae9d51114ac29dd5054088ad90ee => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:32:20.506653 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242daf5-75c9-40c0-a1ef-4e573d1cc5c7 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:20.507008 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242daf5-75c9-40c0-a1ef-4e573d1cc5c7 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:20.507562 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242daf5-75c9-40c0-a1ef-4e573d1cc5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:20.533641 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-2242daf5-75c9-40c0-a1ef-4e573d1cc5c7 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:32:20.535070 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-2242daf5-75c9-40c0-a1ef-4e573d1cc5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:20.619308 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1190/2402] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:32:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:32:20.637286 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f909bc3-0f68-401f-981d-1c1af5cb53e8 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:20.639367 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-1f909bc3-0f68-401f-981d-1c1af5cb53e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:20.735929 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f909bc3-0f68-401f-981d-1c1af5cb53e8 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:20.743558 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d0644-dccb-49f0-ba20-08441af3080c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:20.744447 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d0644-dccb-49f0-ba20-08441af3080c service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:20.745322 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d0644-dccb-49f0-ba20-08441af3080c service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:20.745622 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d0644-dccb-49f0-ba20-08441af3080c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:20.755930 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2242daf5-75c9-40c0-a1ef-4e573d1cc5c7 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:20.756645 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552d0644-dccb-49f0-ba20-08441af3080c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:20.757451 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-2242daf5-75c9-40c0-a1ef-4e573d1cc5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:20.758209 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552d0644-dccb-49f0-ba20-08441af3080c service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:20.769849 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1213/2403] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:32:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:32:20.776757 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2242daf5-75c9-40c0-a1ef-4e573d1cc5c7 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:20.783187 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09625756-002f-4a3b-92a2-cf95d5244d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:20.784701 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09625756-002f-4a3b-92a2-cf95d5244d8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:20.785256 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09625756-002f-4a3b-92a2-cf95d5244d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:20.785626 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09625756-002f-4a3b-92a2-cf95d5244d8d admin admin] PATH_INFO: `/v3/projects/130be770620d43a0bedf1ab1685b4197` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:20.787119 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09625756-002f-4a3b-92a2-cf95d5244d8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=130be770620d43a0bedf1ab1685b4197)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:20.789407 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09625756-002f-4a3b-92a2-cf95d5244d8d admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:20.843702 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-09625756-002f-4a3b-92a2-cf95d5244d8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '130be770620d43a0bedf1ab1685b4197', 'request_id': 'req-09625756-002f-4a3b-92a2-cf95d5244d8d'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:20.852289 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-09625756-002f-4a3b-92a2-cf95d5244d8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '130be770620d43a0bedf1ab1685b4197', 'request_id': 'req-09625756-002f-4a3b-92a2-cf95d5244d8d'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:20.860099 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-09625756-002f-4a3b-92a2-cf95d5244d8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '130be770620d43a0bedf1ab1685b4197', 'request_id': 'req-09625756-002f-4a3b-92a2-cf95d5244d8d'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:20.862398 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:32:20.874177 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-09625756-002f-4a3b-92a2-cf95d5244d8d admin admin] The token cache is being invalidate because project 130be770620d43a0bedf1ab1685b4197 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80360) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:32:20.874786 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-09625756-002f-4a3b-92a2-cf95d5244d8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:20.875613 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-09625756-002f-4a3b-92a2-cf95d5244d8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:20.877309 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1191/2404] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:32:20 2022] DELETE /identity/v3/projects/130be770620d43a0bedf1ab1685b4197 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 15:32:21.100385 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d0644-dccb-49f0-ba20-08441af3080c service neutron] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:21.102058 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-552d0644-dccb-49f0-ba20-08441af3080c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:21.117169 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d0644-dccb-49f0-ba20-08441af3080c service neutron] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:21.198578 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de4e562-fae8-4e8f-ab51-c228c04b56ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:21.200073 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de4e562-fae8-4e8f-ab51-c228c04b56ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:21.200401 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de4e562-fae8-4e8f-ab51-c228c04b56ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:21.200689 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de4e562-fae8-4e8f-ab51-c228c04b56ee admin admin] PATH_INFO: `/v3/projects/655b32d87dc341cc974a0a1f06c60b27` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:21.202081 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de4e562-fae8-4e8f-ab51-c228c04b56ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=655b32d87dc341cc974a0a1f06c60b27)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:21.204365 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de4e562-fae8-4e8f-ab51-c228c04b56ee admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:21.206268 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:32:21.296865 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-0de4e562-fae8-4e8f-ab51-c228c04b56ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '655b32d87dc341cc974a0a1f06c60b27', 'request_id': 'req-0de4e562-fae8-4e8f-ab51-c228c04b56ee'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:21.306635 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-0de4e562-fae8-4e8f-ab51-c228c04b56ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '655b32d87dc341cc974a0a1f06c60b27', 'request_id': 'req-0de4e562-fae8-4e8f-ab51-c228c04b56ee'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:21.315103 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-0de4e562-fae8-4e8f-ab51-c228c04b56ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '655b32d87dc341cc974a0a1f06c60b27', 'request_id': 'req-0de4e562-fae8-4e8f-ab51-c228c04b56ee'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:21.327972 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-0de4e562-fae8-4e8f-ab51-c228c04b56ee admin admin] The token cache is being invalidate because project 655b32d87dc341cc974a0a1f06c60b27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:32:21.328484 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-0de4e562-fae8-4e8f-ab51-c228c04b56ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:21.329257 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-0de4e562-fae8-4e8f-ab51-c228c04b56ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:21.330832 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1214/2405] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:32:21 2022] DELETE /identity/v3/projects/655b32d87dc341cc974a0a1f06c60b27 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:32:21.335009 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09625756-002f-4a3b-92a2-cf95d5244d8d admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:21.338070 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-09625756-002f-4a3b-92a2-cf95d5244d8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:21.352968 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09625756-002f-4a3b-92a2-cf95d5244d8d admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:21.419602 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f1ed1-1211-4603-9b58-04a8cbeaafb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:21.420368 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f1ed1-1211-4603-9b58-04a8cbeaafb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:21.420920 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f1ed1-1211-4603-9b58-04a8cbeaafb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:21.421204 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f1ed1-1211-4603-9b58-04a8cbeaafb6 admin admin] PATH_INFO: `/v3/users/e7e9b31c24bc49cda746c3c33df00840` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:21.422488 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02f1ed1-1211-4603-9b58-04a8cbeaafb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7e9b31c24bc49cda746c3c33df00840)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:21.425106 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02f1ed1-1211-4603-9b58-04a8cbeaafb6 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:21.491855 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-b02f1ed1-1211-4603-9b58-04a8cbeaafb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7e9b31c24bc49cda746c3c33df00840'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:21.502447 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-b02f1ed1-1211-4603-9b58-04a8cbeaafb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7e9b31c24bc49cda746c3c33df00840'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:21.517829 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-b02f1ed1-1211-4603-9b58-04a8cbeaafb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7e9b31c24bc49cda746c3c33df00840'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:21.518575 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-b02f1ed1-1211-4603-9b58-04a8cbeaafb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7e9b31c24bc49cda746c3c33df00840'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:21.519358 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-b02f1ed1-1211-4603-9b58-04a8cbeaafb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7e9b31c24bc49cda746c3c33df00840'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:21.536909 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1192/2406] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:32:21 2022] DELETE /identity/v3/users/e7e9b31c24bc49cda746c3c33df00840 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:32:21.941571 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de4e562-fae8-4e8f-ab51-c228c04b56ee admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:21.943183 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-0de4e562-fae8-4e8f-ab51-c228c04b56ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:21.957529 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de4e562-fae8-4e8f-ab51-c228c04b56ee admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:22.040092 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6648625-6fcf-4ef3-9a95-ca65da49c1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:22.040784 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6648625-6fcf-4ef3-9a95-ca65da49c1a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:22.041065 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6648625-6fcf-4ef3-9a95-ca65da49c1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:22.041437 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6648625-6fcf-4ef3-9a95-ca65da49c1a1 admin admin] PATH_INFO: `/v3/projects/03dfa4827bfd46798d6ea5f7a111026f` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:22.043516 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6648625-6fcf-4ef3-9a95-ca65da49c1a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03dfa4827bfd46798d6ea5f7a111026f)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:22.045797 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6648625-6fcf-4ef3-9a95-ca65da49c1a1 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:22.118870 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-a6648625-6fcf-4ef3-9a95-ca65da49c1a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03dfa4827bfd46798d6ea5f7a111026f', 'request_id': 'req-a6648625-6fcf-4ef3-9a95-ca65da49c1a1'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:22.127738 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-a6648625-6fcf-4ef3-9a95-ca65da49c1a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03dfa4827bfd46798d6ea5f7a111026f', 'request_id': 'req-a6648625-6fcf-4ef3-9a95-ca65da49c1a1'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:22.137029 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-a6648625-6fcf-4ef3-9a95-ca65da49c1a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03dfa4827bfd46798d6ea5f7a111026f', 'request_id': 'req-a6648625-6fcf-4ef3-9a95-ca65da49c1a1'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:22.166489 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-a6648625-6fcf-4ef3-9a95-ca65da49c1a1 admin admin] The token cache is being invalidate because project 03dfa4827bfd46798d6ea5f7a111026f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:32:22.167428 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-a6648625-6fcf-4ef3-9a95-ca65da49c1a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:22.168057 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-a6648625-6fcf-4ef3-9a95-ca65da49c1a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:22.169648 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1215/2407] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:32:21 2022] DELETE /identity/v3/projects/03dfa4827bfd46798d6ea5f7a111026f => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 15:32:22.174588 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f1ed1-1211-4603-9b58-04a8cbeaafb6 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:22.178736 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-b02f1ed1-1211-4603-9b58-04a8cbeaafb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:22.233987 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f1ed1-1211-4603-9b58-04a8cbeaafb6 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:22.254283 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6648625-6fcf-4ef3-9a95-ca65da49c1a1 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:22.256308 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-a6648625-6fcf-4ef3-9a95-ca65da49c1a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:22.293571 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:32:22.391915 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d2ff87-1622-40be-aa5e-cb1545a2e543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:22.393465 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2ff87-1622-40be-aa5e-cb1545a2e543 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:22.393984 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2ff87-1622-40be-aa5e-cb1545a2e543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:22.396020 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2ff87-1622-40be-aa5e-cb1545a2e543 admin admin] PATH_INFO: `/v3/users/f768b84bef744be5b446c5b9defdeaea` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:22.398569 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d2ff87-1622-40be-aa5e-cb1545a2e543 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f768b84bef744be5b446c5b9defdeaea)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:22.401237 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d2ff87-1622-40be-aa5e-cb1545a2e543 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:22.404099 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6648625-6fcf-4ef3-9a95-ca65da49c1a1 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:22.417575 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae369cbf-f041-42ce-babf-945a29280d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:22.418301 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae369cbf-f041-42ce-babf-945a29280d1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:22.419798 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae369cbf-f041-42ce-babf-945a29280d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:22.420105 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae369cbf-f041-42ce-babf-945a29280d1c admin admin] PATH_INFO: `/v3/users/4fe40f90a9014a5380f5c6bd2688c5fa` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:22.423535 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae369cbf-f041-42ce-babf-945a29280d1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fe40f90a9014a5380f5c6bd2688c5fa)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:22.426035 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae369cbf-f041-42ce-babf-945a29280d1c admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:22.431315 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:32:22.513139 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-d2d2ff87-1622-40be-aa5e-cb1545a2e543 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f768b84bef744be5b446c5b9defdeaea'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:22.515243 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-ae369cbf-f041-42ce-babf-945a29280d1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fe40f90a9014a5380f5c6bd2688c5fa'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:22.531882 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-d2d2ff87-1622-40be-aa5e-cb1545a2e543 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f768b84bef744be5b446c5b9defdeaea'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:22.536701 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-ae369cbf-f041-42ce-babf-945a29280d1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fe40f90a9014a5380f5c6bd2688c5fa'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:22.537820 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-ae369cbf-f041-42ce-babf-945a29280d1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fe40f90a9014a5380f5c6bd2688c5fa'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:22.548455 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-ae369cbf-f041-42ce-babf-945a29280d1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fe40f90a9014a5380f5c6bd2688c5fa'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:22.560667 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-ae369cbf-f041-42ce-babf-945a29280d1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fe40f90a9014a5380f5c6bd2688c5fa'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:22.567785 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-d2d2ff87-1622-40be-aa5e-cb1545a2e543 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f768b84bef744be5b446c5b9defdeaea'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:22.568508 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-d2d2ff87-1622-40be-aa5e-cb1545a2e543 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f768b84bef744be5b446c5b9defdeaea'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:22.569113 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-d2d2ff87-1622-40be-aa5e-cb1545a2e543 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f768b84bef744be5b446c5b9defdeaea'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:22.583956 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1216/2408] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:32:22 2022] DELETE /identity/v3/users/4fe40f90a9014a5380f5c6bd2688c5fa => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 15:32:22.585848 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504724bd-a854-43d4-8bd2-d707f0959bb7 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:22.586231 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504724bd-a854-43d4-8bd2-d707f0959bb7 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:22.587629 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1193/2409] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:32:22 2022] DELETE /identity/v3/users/f768b84bef744be5b446c5b9defdeaea => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:32:22.588315 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504724bd-a854-43d4-8bd2-d707f0959bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:22.614647 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-504724bd-a854-43d4-8bd2-d707f0959bb7 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:32:22.616332 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-504724bd-a854-43d4-8bd2-d707f0959bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:22.711573 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1217/2410] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:32:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:32:22.724140 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d2ff87-1622-40be-aa5e-cb1545a2e543 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:22.725633 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-d2d2ff87-1622-40be-aa5e-cb1545a2e543 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:22.834557 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d2ff87-1622-40be-aa5e-cb1545a2e543 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:22.842177 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b564662-b1f6-4de0-a3d2-537b8df03419 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:22.843388 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b564662-b1f6-4de0-a3d2-537b8df03419 service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:22.843662 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b564662-b1f6-4de0-a3d2-537b8df03419 service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:22.844086 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b564662-b1f6-4de0-a3d2-537b8df03419 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:22.855947 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b564662-b1f6-4de0-a3d2-537b8df03419 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:22.856977 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b564662-b1f6-4de0-a3d2-537b8df03419 service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:22.868477 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1194/2411] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:32:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:32:23.059008 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504724bd-a854-43d4-8bd2-d707f0959bb7 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:23.060477 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-504724bd-a854-43d4-8bd2-d707f0959bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:23.074469 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504724bd-a854-43d4-8bd2-d707f0959bb7 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:23.079571 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613330a8-237b-4562-b432-3492910901e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:23.080277 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613330a8-237b-4562-b432-3492910901e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:23.080698 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613330a8-237b-4562-b432-3492910901e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:23.081125 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613330a8-237b-4562-b432-3492910901e9 admin admin] PATH_INFO: `/v3/projects/44e2001f0e88432d94e4c25902df2126` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:23.082500 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613330a8-237b-4562-b432-3492910901e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44e2001f0e88432d94e4c25902df2126)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:23.084933 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613330a8-237b-4562-b432-3492910901e9 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:23.134430 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:32:23.153786 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-613330a8-237b-4562-b432-3492910901e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44e2001f0e88432d94e4c25902df2126', 'request_id': 'req-613330a8-237b-4562-b432-3492910901e9'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:23.165356 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-613330a8-237b-4562-b432-3492910901e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44e2001f0e88432d94e4c25902df2126', 'request_id': 'req-613330a8-237b-4562-b432-3492910901e9'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:23.177651 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-613330a8-237b-4562-b432-3492910901e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44e2001f0e88432d94e4c25902df2126', 'request_id': 'req-613330a8-237b-4562-b432-3492910901e9'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:23.190990 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-613330a8-237b-4562-b432-3492910901e9 admin admin] The token cache is being invalidate because project 44e2001f0e88432d94e4c25902df2126 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:32:23.191333 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-613330a8-237b-4562-b432-3492910901e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:23.192119 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-613330a8-237b-4562-b432-3492910901e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:23.199618 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1218/2412] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:32:23 2022] DELETE /identity/v3/projects/44e2001f0e88432d94e4c25902df2126 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:32:23.208549 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a93023-96b2-4acd-9117-b977cbee4628 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:23.208967 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a93023-96b2-4acd-9117-b977cbee4628 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:23.209566 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a93023-96b2-4acd-9117-b977cbee4628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:23.265786 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-e9a93023-96b2-4acd-9117-b977cbee4628 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:32:23.267780 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-e9a93023-96b2-4acd-9117-b977cbee4628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:23.363360 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1195/2413] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:32:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:32:23.371603 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5465c0b8-949d-4266-a2fd-5de77c852eb1 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:23.372537 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5465c0b8-949d-4266-a2fd-5de77c852eb1 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:23.373567 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5465c0b8-949d-4266-a2fd-5de77c852eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:23.394174 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-5465c0b8-949d-4266-a2fd-5de77c852eb1 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:32:23.395434 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-5465c0b8-949d-4266-a2fd-5de77c852eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:23.404330 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1219/2414] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:32:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:32:23.408676 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a93023-96b2-4acd-9117-b977cbee4628 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:23.420802 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a93023-96b2-4acd-9117-b977cbee4628 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:23.427573 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b445bb-f3a6-4556-8ca7-060aa06d58c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:23.428414 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b445bb-f3a6-4556-8ca7-060aa06d58c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:23.428920 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b445bb-f3a6-4556-8ca7-060aa06d58c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:23.429071 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b445bb-f3a6-4556-8ca7-060aa06d58c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:23.430230 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b445bb-f3a6-4556-8ca7-060aa06d58c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:32:23.430538 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b445bb-f3a6-4556-8ca7-060aa06d58c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:23.432595 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b445bb-f3a6-4556-8ca7-060aa06d58c5 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:23.461528 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1196/2415] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 2 15:32:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:32:23.468976 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5465c0b8-949d-4266-a2fd-5de77c852eb1 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:23.488631 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5465c0b8-949d-4266-a2fd-5de77c852eb1 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:23.494327 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9f8e78-aeba-4e6d-8ccf-a6faf9845c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:23.495887 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f8e78-aeba-4e6d-8ccf-a6faf9845c87 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:23.496202 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f8e78-aeba-4e6d-8ccf-a6faf9845c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:23.496542 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f8e78-aeba-4e6d-8ccf-a6faf9845c87 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:23.497279 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9f8e78-aeba-4e6d-8ccf-a6faf9845c87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:23.504160 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9f8e78-aeba-4e6d-8ccf-a6faf9845c87 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:23.558682 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1220/2416] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:32:23 2022] POST /identity/v3/projects => generated 385 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:32:23.563342 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b445bb-f3a6-4556-8ca7-060aa06d58c5 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:23.584069 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b445bb-f3a6-4556-8ca7-060aa06d58c5 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:23.616253 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:32:23.625042 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9f8e78-aeba-4e6d-8ccf-a6faf9845c87 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:23.630469 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-8e9f8e78-aeba-4e6d-8ccf-a6faf9845c87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:23.689739 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ce927e-976d-462e-b339-7c61418d3c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:23.691659 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce927e-976d-462e-b339-7c61418d3c91 admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:23.691946 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce927e-976d-462e-b339-7c61418d3c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:23.692835 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce927e-976d-462e-b339-7c61418d3c91 admin admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:23.693555 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ce927e-976d-462e-b339-7c61418d3c91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:23.697269 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ce927e-976d-462e-b339-7c61418d3c91 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:23.723432 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1197/2417] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:32:23 2022] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:32:23.727838 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ce927e-976d-462e-b339-7c61418d3c91 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:23.740834 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ce927e-976d-462e-b339-7c61418d3c91 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:23.748559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe97ba19-2aca-4649-bfc0-d0784475e36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:23.749290 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97ba19-2aca-4649-bfc0-d0784475e36e admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:23.749579 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97ba19-2aca-4649-bfc0-d0784475e36e admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:23.749857 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97ba19-2aca-4649-bfc0-d0784475e36e admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:23.750564 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe97ba19-2aca-4649-bfc0-d0784475e36e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:23.752376 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe97ba19-2aca-4649-bfc0-d0784475e36e admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:23.757475 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9f8e78-aeba-4e6d-8ccf-a6faf9845c87 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:23.764530 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e014c-fc5d-42b2-9fff-c1946900ef64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:23.765031 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1198/2418] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 15:32:23.765262 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e014c-fc5d-42b2-9fff-c1946900ef64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:23.766073 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e014c-fc5d-42b2-9fff-c1946900ef64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:23.766073 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e014c-fc5d-42b2-9fff-c1946900ef64 admin admin] PATH_INFO: `/v3/projects/7b83e3e91bb0488cb5d32af310d6c202` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:23.767803 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9e014c-fc5d-42b2-9fff-c1946900ef64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b83e3e91bb0488cb5d32af310d6c202)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:23.769213 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe97ba19-2aca-4649-bfc0-d0784475e36e admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:23.769996 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9e014c-fc5d-42b2-9fff-c1946900ef64 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:23.792506 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe97ba19-2aca-4649-bfc0-d0784475e36e admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:23.813965 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62de9fa-bfbf-4fa5-b32b-8b5f19d6b256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:23.814600 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62de9fa-bfbf-4fa5-b32b-8b5f19d6b256 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:23.814880 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62de9fa-bfbf-4fa5-b32b-8b5f19d6b256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:23.815181 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62de9fa-bfbf-4fa5-b32b-8b5f19d6b256 admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:23.824078 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62de9fa-bfbf-4fa5-b32b-8b5f19d6b256 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:23.828421 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62de9fa-bfbf-4fa5-b32b-8b5f19d6b256 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:23.848959 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1199/2419] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:32:23.856220 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62de9fa-bfbf-4fa5-b32b-8b5f19d6b256 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:23.862095 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-cb9e014c-fc5d-42b2-9fff-c1946900ef64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b83e3e91bb0488cb5d32af310d6c202', 'request_id': 'req-cb9e014c-fc5d-42b2-9fff-c1946900ef64'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:23.872351 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-cb9e014c-fc5d-42b2-9fff-c1946900ef64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b83e3e91bb0488cb5d32af310d6c202', 'request_id': 'req-cb9e014c-fc5d-42b2-9fff-c1946900ef64'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:23.881835 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62de9fa-bfbf-4fa5-b32b-8b5f19d6b256 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:23.895247 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-cb9e014c-fc5d-42b2-9fff-c1946900ef64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b83e3e91bb0488cb5d32af310d6c202', 'request_id': 'req-cb9e014c-fc5d-42b2-9fff-c1946900ef64'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:23.906510 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-cb9e014c-fc5d-42b2-9fff-c1946900ef64 admin admin] The token cache is being invalidate because project 7b83e3e91bb0488cb5d32af310d6c202 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:32:23.907147 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-cb9e014c-fc5d-42b2-9fff-c1946900ef64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:23.908054 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-cb9e014c-fc5d-42b2-9fff-c1946900ef64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:32:23.913653 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1221/2420] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:32:23 2022] DELETE /identity/v3/projects/7b83e3e91bb0488cb5d32af310d6c202 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:32:23.915415 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3640d704-8a6f-46bb-8f24-2e74aad4296d None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:23.916196 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3640d704-8a6f-46bb-8f24-2e74aad4296d None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:23.916718 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3640d704-8a6f-46bb-8f24-2e74aad4296d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:23.944684 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-3640d704-8a6f-46bb-8f24-2e74aad4296d None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:32:23.946345 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-3640d704-8a6f-46bb-8f24-2e74aad4296d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:23.976124 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:32:24.014141 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc843bce-57b1-4504-aa0c-1513fb8f841b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:24.016102 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc843bce-57b1-4504-aa0c-1513fb8f841b admin admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:24.016389 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc843bce-57b1-4504-aa0c-1513fb8f841b admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:24.016721 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc843bce-57b1-4504-aa0c-1513fb8f841b admin admin] PATH_INFO: `/v3/projects/462acab2efc94922bf7567575accbd37/users/e2349bd756334f1885d30cfce2730297/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:24.047388 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc843bce-57b1-4504-aa0c-1513fb8f841b admin admin] RBAC: Authorizing `identity:create_grant(project_id=462acab2efc94922bf7567575accbd37, user_id=e2349bd756334f1885d30cfce2730297, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:24.050516 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc843bce-57b1-4504-aa0c-1513fb8f841b admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:24.068696 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1222/2421] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:32:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:32:24.077700 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a495f7-7370-4b72-bdb9-cf6940af6dcc None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:24.078811 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a495f7-7370-4b72-bdb9-cf6940af6dcc None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:24.078811 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a495f7-7370-4b72-bdb9-cf6940af6dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:24.082975 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1200/2422] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:32:23 2022] PUT /identity/v3/projects/462acab2efc94922bf7567575accbd37/users/e2349bd756334f1885d30cfce2730297/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:32:24.084622 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d42c75-ab31-4977-8d56-4f641191af3c None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:24.084911 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d42c75-ab31-4977-8d56-4f641191af3c None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:24.085277 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d42c75-ab31-4977-8d56-4f641191af3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:24.102553 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-d0a495f7-7370-4b72-bdb9-cf6940af6dcc None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:32:24.103919 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-d0a495f7-7370-4b72-bdb9-cf6940af6dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:24.115051 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-b9d42c75-ab31-4977-8d56-4f641191af3c None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:32:24.116619 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-b9d42c75-ab31-4977-8d56-4f641191af3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:24.209728 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1223/2423] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:32:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:32:24.210737 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a495f7-7370-4b72-bdb9-cf6940af6dcc None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:24.222598 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a495f7-7370-4b72-bdb9-cf6940af6dcc None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:24.228490 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e741935-2833-4308-888c-6adf7511aeca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:24.229516 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e741935-2833-4308-888c-6adf7511aeca admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:24.230095 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e741935-2833-4308-888c-6adf7511aeca admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:24.230436 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e741935-2833-4308-888c-6adf7511aeca admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:24.231514 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e741935-2833-4308-888c-6adf7511aeca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:32:24.231998 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e741935-2833-4308-888c-6adf7511aeca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:24.233000 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1201/2424] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:32:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:32:24.234410 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e741935-2833-4308-888c-6adf7511aeca admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:24.244548 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d42c75-ab31-4977-8d56-4f641191af3c None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:24.247522 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-b9d42c75-ab31-4977-8d56-4f641191af3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:24.258826 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1224/2425] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 2 15:32:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:32:24.261698 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e741935-2833-4308-888c-6adf7511aeca admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:24.278275 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:32:24.282161 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e741935-2833-4308-888c-6adf7511aeca admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:24.297846 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d94d69b-9fd5-4d88-bc50-a0ef49639731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:24.298490 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94d69b-9fd5-4d88-bc50-a0ef49639731 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:24.298777 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94d69b-9fd5-4d88-bc50-a0ef49639731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:24.299199 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94d69b-9fd5-4d88-bc50-a0ef49639731 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:24.299979 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d94d69b-9fd5-4d88-bc50-a0ef49639731 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:24.301920 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d94d69b-9fd5-4d88-bc50-a0ef49639731 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:24.347404 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d42c75-ab31-4977-8d56-4f641191af3c None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:24.355877 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb0f50-fc62-48d0-9b9a-c136fb44521e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:24.356968 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb0f50-fc62-48d0-9b9a-c136fb44521e service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:24.357461 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb0f50-fc62-48d0-9b9a-c136fb44521e service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:24.357938 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb0f50-fc62-48d0-9b9a-c136fb44521e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:24.366175 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1225/2426] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:32:24 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:32:24.370943 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eb0f50-fc62-48d0-9b9a-c136fb44521e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:24.371127 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d94d69b-9fd5-4d88-bc50-a0ef49639731 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:24.374740 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eb0f50-fc62-48d0-9b9a-c136fb44521e service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:24.391554 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1202/2427] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:32:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:32:24.457318 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d94d69b-9fd5-4d88-bc50-a0ef49639731 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:24.462668 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9391704d-69fa-4b9a-9a6d-f62632b7cd33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:24.462982 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391704d-69fa-4b9a-9a6d-f62632b7cd33 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:24.463301 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391704d-69fa-4b9a-9a6d-f62632b7cd33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:24.464232 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391704d-69fa-4b9a-9a6d-f62632b7cd33 admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:24.464920 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9391704d-69fa-4b9a-9a6d-f62632b7cd33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:24.469533 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9391704d-69fa-4b9a-9a6d-f62632b7cd33 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:24.497009 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1226/2428] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:32:24 2022] POST /identity/v3/users => generated 288 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 15:32:24.498663 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb0f50-fc62-48d0-9b9a-c136fb44521e service neutron] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:24.529020 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb0f50-fc62-48d0-9b9a-c136fb44521e service neutron] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:24.538350 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d75363-379a-4a85-a13d-ad363cef4d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:24.539073 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d75363-379a-4a85-a13d-ad363cef4d7a admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:24.540093 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d75363-379a-4a85-a13d-ad363cef4d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:24.540093 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d75363-379a-4a85-a13d-ad363cef4d7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:24.540378 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d75363-379a-4a85-a13d-ad363cef4d7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:24.542729 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d75363-379a-4a85-a13d-ad363cef4d7a admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:24.559299 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1203/2429] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:32:24.560898 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9391704d-69fa-4b9a-9a6d-f62632b7cd33 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:24.602053 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9391704d-69fa-4b9a-9a6d-f62632b7cd33 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:24.629478 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc8952-8e08-4be1-85d0-43c424a8411b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:24.629478 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc8952-8e08-4be1-85d0-43c424a8411b admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:24.629478 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc8952-8e08-4be1-85d0-43c424a8411b admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:24.629478 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc8952-8e08-4be1-85d0-43c424a8411b admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:24.630297 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cc8952-8e08-4be1-85d0-43c424a8411b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:24.630297 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cc8952-8e08-4be1-85d0-43c424a8411b admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:24.647730 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1227/2430] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:32:24.652738 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d75363-379a-4a85-a13d-ad363cef4d7a admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:24.671796 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d75363-379a-4a85-a13d-ad363cef4d7a admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:24.680132 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17d8129-58dd-48e9-b58e-be039b2921ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:24.681249 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d8129-58dd-48e9-b58e-be039b2921ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:24.681406 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d8129-58dd-48e9-b58e-be039b2921ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:24.681712 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d8129-58dd-48e9-b58e-be039b2921ab admin admin] PATH_INFO: `/v3/projects/64bea2739769411fbb27afaa2da5e352/users/f5db295e414d48f59f7f9dd6c3d854a8/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:24.701511 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17d8129-58dd-48e9-b58e-be039b2921ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=64bea2739769411fbb27afaa2da5e352, user_id=f5db295e414d48f59f7f9dd6c3d854a8, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:24.706851 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17d8129-58dd-48e9-b58e-be039b2921ab admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:24.737860 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1204/2431] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:32:24 2022] PUT /identity/v3/projects/64bea2739769411fbb27afaa2da5e352/users/f5db295e414d48f59f7f9dd6c3d854a8/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:32:24.739952 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1827ac-ec51-4c9d-a335-fd5cef0f805b None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:24.740245 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1827ac-ec51-4c9d-a335-fd5cef0f805b None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:24.740520 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1827ac-ec51-4c9d-a335-fd5cef0f805b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:24.779023 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:32:24.805540 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-8c1827ac-ec51-4c9d-a335-fd5cef0f805b None None] MFA Rules not processed for user `f5db295e414d48f59f7f9dd6c3d854a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:32:24.806853 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-8c1827ac-ec51-4c9d-a335-fd5cef0f805b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:24.923869 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1228/2432] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:32:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:32:24.936309 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17d8129-58dd-48e9-b58e-be039b2921ab admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:24.938350 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-f17d8129-58dd-48e9-b58e-be039b2921ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:25.041284 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17d8129-58dd-48e9-b58e-be039b2921ab admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:25.047194 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c278cb-b6db-43ad-b1de-b0ea0989d2de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:25.047920 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c278cb-b6db-43ad-b1de-b0ea0989d2de service cinder] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:25.048227 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c278cb-b6db-43ad-b1de-b0ea0989d2de service cinder] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:25.049129 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c278cb-b6db-43ad-b1de-b0ea0989d2de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:25.083572 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c278cb-b6db-43ad-b1de-b0ea0989d2de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:25.085840 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c278cb-b6db-43ad-b1de-b0ea0989d2de service cinder] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:25.099411 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1205/2433] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:32:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:32:26.555068 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144aa10f-e4a5-4e5c-b692-fadb706ae73f None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:26.555580 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144aa10f-e4a5-4e5c-b692-fadb706ae73f None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:26.555802 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144aa10f-e4a5-4e5c-b692-fadb706ae73f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:26.593670 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-144aa10f-e4a5-4e5c-b692-fadb706ae73f None None] MFA Rules not processed for user `f5db295e414d48f59f7f9dd6c3d854a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:32:26.594926 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-144aa10f-e4a5-4e5c-b692-fadb706ae73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:26.607344 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1229/2434] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:32:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:32:30.850343 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2da1e5-87c8-464a-ae8e-2496602f7cac None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:30.850886 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2da1e5-87c8-464a-ae8e-2496602f7cac None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:30.851016 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2da1e5-87c8-464a-ae8e-2496602f7cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:30.886624 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-0a2da1e5-87c8-464a-ae8e-2496602f7cac None None] MFA Rules not processed for user `e2349bd756334f1885d30cfce2730297`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:32:30.888065 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-0a2da1e5-87c8-464a-ae8e-2496602f7cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:30.972196 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1206/2435] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:32:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:32:30.973356 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144aa10f-e4a5-4e5c-b692-fadb706ae73f None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:30.976771 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-144aa10f-e4a5-4e5c-b692-fadb706ae73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:31.055922 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144aa10f-e4a5-4e5c-b692-fadb706ae73f None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:31.062129 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c8cbc0-bb16-48d4-8521-3fed5031cb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:31.062895 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8cbc0-bb16-48d4-8521-3fed5031cb51 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:31.063190 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8cbc0-bb16-48d4-8521-3fed5031cb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:31.063495 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8cbc0-bb16-48d4-8521-3fed5031cb51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:31.064584 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c8cbc0-bb16-48d4-8521-3fed5031cb51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:31.066613 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c8cbc0-bb16-48d4-8521-3fed5031cb51 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:31.096104 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1230/2436] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:32:30 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:32:31.110294 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2da1e5-87c8-464a-ae8e-2496602f7cac None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:31.122455 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2da1e5-87c8-464a-ae8e-2496602f7cac None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:31.133407 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:32:31.186201 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d109caba-0af2-4dfe-8571-14c43c34fff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:31.186872 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109caba-0af2-4dfe-8571-14c43c34fff1 admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:31.187191 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109caba-0af2-4dfe-8571-14c43c34fff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:31.187596 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109caba-0af2-4dfe-8571-14c43c34fff1 admin admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:31.188442 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d109caba-0af2-4dfe-8571-14c43c34fff1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:31.190395 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d109caba-0af2-4dfe-8571-14c43c34fff1 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:31.212961 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1207/2437] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:32:31 2022] POST /identity/v3/users => generated 299 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:32:31.217030 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c8cbc0-bb16-48d4-8521-3fed5031cb51 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:31.227673 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c8cbc0-bb16-48d4-8521-3fed5031cb51 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:31.232340 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e3b86-d04f-4640-b498-ee1fc4f7082f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:31.232957 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e3b86-d04f-4640-b498-ee1fc4f7082f admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:31.233240 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e3b86-d04f-4640-b498-ee1fc4f7082f admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:31.233515 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e3b86-d04f-4640-b498-ee1fc4f7082f admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:31.234207 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e3b86-d04f-4640-b498-ee1fc4f7082f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:31.235903 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e3b86-d04f-4640-b498-ee1fc4f7082f admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:31.247851 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1231/2438] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:32:31.252199 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d109caba-0af2-4dfe-8571-14c43c34fff1 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:31.263638 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d109caba-0af2-4dfe-8571-14c43c34fff1 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:31.268585 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b30683b-921b-4d92-86f3-126a7b0238b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:31.269302 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30683b-921b-4d92-86f3-126a7b0238b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:31.269614 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30683b-921b-4d92-86f3-126a7b0238b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:31.269880 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30683b-921b-4d92-86f3-126a7b0238b6 admin admin] PATH_INFO: `/v3/projects/628fb3abb2de40a68edae6a621da1f64/users/7e1414016cc84137b1230264cd455ed2/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:31.287178 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b30683b-921b-4d92-86f3-126a7b0238b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=628fb3abb2de40a68edae6a621da1f64, user_id=7e1414016cc84137b1230264cd455ed2, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:31.289972 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b30683b-921b-4d92-86f3-126a7b0238b6 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:31.304527 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1208/2439] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:32:31 2022] PUT /identity/v3/projects/628fb3abb2de40a68edae6a621da1f64/users/7e1414016cc84137b1230264cd455ed2/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:32:31.309146 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e3b86-d04f-4640-b498-ee1fc4f7082f admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:31.319938 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e3b86-d04f-4640-b498-ee1fc4f7082f admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:31.439808 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44215a-f05d-4d68-9c56-424646aa7cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:31.440683 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44215a-f05d-4d68-9c56-424646aa7cd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:31.441130 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44215a-f05d-4d68-9c56-424646aa7cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:31.441486 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44215a-f05d-4d68-9c56-424646aa7cd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:31.442433 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b44215a-f05d-4d68-9c56-424646aa7cd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:31.444164 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b44215a-f05d-4d68-9c56-424646aa7cd1 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:31.455481 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1232/2440] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 15:32:31.460039 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b30683b-921b-4d92-86f3-126a7b0238b6 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:31.473116 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b30683b-921b-4d92-86f3-126a7b0238b6 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:31.478875 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc0ce41-42ab-4fb6-8a85-287918253f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:31.479646 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0ce41-42ab-4fb6-8a85-287918253f4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:31.480221 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0ce41-42ab-4fb6-8a85-287918253f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:31.484575 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0ce41-42ab-4fb6-8a85-287918253f4f admin admin] PATH_INFO: `/v3/projects/628fb3abb2de40a68edae6a621da1f64/users/7e1414016cc84137b1230264cd455ed2/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:31.486962 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc0ce41-42ab-4fb6-8a85-287918253f4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=628fb3abb2de40a68edae6a621da1f64, user_id=7e1414016cc84137b1230264cd455ed2, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:31.489926 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc0ce41-42ab-4fb6-8a85-287918253f4f admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:31.502547 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1209/2441] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:32:31 2022] PUT /identity/v3/projects/628fb3abb2de40a68edae6a621da1f64/users/7e1414016cc84137b1230264cd455ed2/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:32:35.865733 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784faf9-c0fd-40ca-a239-d571e87a2015 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:35.866259 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784faf9-c0fd-40ca-a239-d571e87a2015 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:35.866558 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784faf9-c0fd-40ca-a239-d571e87a2015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:35.875009 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:32:35.892201 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-8784faf9-c0fd-40ca-a239-d571e87a2015 None None] MFA Rules not processed for user `cfb5e907ac594ba6a93d88d665c1d740`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:32:35.893513 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-8784faf9-c0fd-40ca-a239-d571e87a2015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:36.057042 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1233/2442] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:32:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:32:37.078644 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d4aa3-ee70-4700-bf9c-008e0a9cd73b None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:37.079193 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d4aa3-ee70-4700-bf9c-008e0a9cd73b None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:37.079193 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d4aa3-ee70-4700-bf9c-008e0a9cd73b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:37.114916 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-c13d4aa3-ee70-4700-bf9c-008e0a9cd73b None None] MFA Rules not processed for user `7e1414016cc84137b1230264cd455ed2`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:32:37.116322 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-c13d4aa3-ee70-4700-bf9c-008e0a9cd73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:37.260705 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1210/2443] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:32:37 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:32:37.289507 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8784faf9-c0fd-40ca-a239-d571e87a2015 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:37.290842 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-8784faf9-c0fd-40ca-a239-d571e87a2015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:37.416444 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8784faf9-c0fd-40ca-a239-d571e87a2015 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:37.431067 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6050cdc5-809d-4932-abeb-d56f2a08d233 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946af31d75ca41a2a4301e0294cf98f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:37.431895 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050cdc5-809d-4932-abeb-d56f2a08d233 service glance] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:37.432408 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050cdc5-809d-4932-abeb-d56f2a08d233 service glance] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:37.432837 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050cdc5-809d-4932-abeb-d56f2a08d233 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:37.561021 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6050cdc5-809d-4932-abeb-d56f2a08d233 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:37.562495 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6050cdc5-809d-4932-abeb-d56f2a08d233 service glance] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:37.587336 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1234/2444] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:32:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:32:37.969856 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d14ec79-b988-411c-a139-528777ae07a8 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:37.969856 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d14ec79-b988-411c-a139-528777ae07a8 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:37.969856 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d14ec79-b988-411c-a139-528777ae07a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:38.022526 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-5d14ec79-b988-411c-a139-528777ae07a8 None None] MFA Rules not processed for user `dfe8c00c0c3d4c4b8b6f36e39a3a2e71`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:32:38.027178 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-5d14ec79-b988-411c-a139-528777ae07a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:38.129882 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:32:38.149826 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1211/2445] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Aug 2 15:32:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:32:38.312175 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6050cdc5-809d-4932-abeb-d56f2a08d233 service glance] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:38.314665 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-6050cdc5-809d-4932-abeb-d56f2a08d233 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:38.501426 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:32:38.509045 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6050cdc5-809d-4932-abeb-d56f2a08d233 service glance] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:38.530416 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc847b-2495-4939-b288-58d04c019253 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4de590df474c8b95f2b1193f7dbcb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:38.532510 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc847b-2495-4939-b288-58d04c019253 service swift] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:38.534397 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc847b-2495-4939-b288-58d04c019253 service swift] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:38.534879 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc847b-2495-4939-b288-58d04c019253 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:38.559623 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cc847b-2495-4939-b288-58d04c019253 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:38.563896 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cc847b-2495-4939-b288-58d04c019253 service swift] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:38.590252 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1235/2446] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Aug 2 15:32:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 15:32:43.322021 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c59b6d-4ead-493f-9317-ef9770b3410f None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:43.323264 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c59b6d-4ead-493f-9317-ef9770b3410f None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:43.323264 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c59b6d-4ead-493f-9317-ef9770b3410f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:43.349509 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-33c59b6d-4ead-493f-9317-ef9770b3410f None None] MFA Rules not processed for user `0f08ca03f3f44afcbbbe94fe0ac5baf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:32:43.351826 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-33c59b6d-4ead-493f-9317-ef9770b3410f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:43.449992 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1212/2447] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:32:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:32:47.267128 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c4d82-dfca-468c-8bbe-82fd7ea7f4bd None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:47.267707 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c4d82-dfca-468c-8bbe-82fd7ea7f4bd None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:47.267707 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c4d82-dfca-468c-8bbe-82fd7ea7f4bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:47.292294 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-746c4d82-dfca-468c-8bbe-82fd7ea7f4bd None None] MFA Rules not processed for user `dfe8c00c0c3d4c4b8b6f36e39a3a2e71`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:32:47.295472 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-746c4d82-dfca-468c-8bbe-82fd7ea7f4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:47.309977 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1236/2448] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Aug 2 15:32:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:32:47.323079 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c59b6d-4ead-493f-9317-ef9770b3410f None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:47.340836 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c59b6d-4ead-493f-9317-ef9770b3410f None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:47.348997 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44642f8-c7a6-45ee-ae3e-cac3b55e3dc0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4de590df474c8b95f2b1193f7dbcb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:47.349907 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44642f8-c7a6-45ee-ae3e-cac3b55e3dc0 service swift] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:47.350383 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44642f8-c7a6-45ee-ae3e-cac3b55e3dc0 service swift] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:47.350809 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44642f8-c7a6-45ee-ae3e-cac3b55e3dc0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:47.366960 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44642f8-c7a6-45ee-ae3e-cac3b55e3dc0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:47.368850 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44642f8-c7a6-45ee-ae3e-cac3b55e3dc0 service swift] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:47.380021 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1213/2449] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Aug 2 15:32:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 15:32:50.968213 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746c4d82-dfca-468c-8bbe-82fd7ea7f4bd None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:51.045395 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746c4d82-dfca-468c-8bbe-82fd7ea7f4bd None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:51.060315 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e0219-9741-4501-a667-1da1a6c72c6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:51.060689 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e0219-9741-4501-a667-1da1a6c72c6c service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:51.060977 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e0219-9741-4501-a667-1da1a6c72c6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:51.061254 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e0219-9741-4501-a667-1da1a6c72c6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:51.066922 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-4a6e0219-9741-4501-a667-1da1a6c72c6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:51.178711 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6e0219-9741-4501-a667-1da1a6c72c6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:51.180453 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6e0219-9741-4501-a667-1da1a6c72c6c service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:51.194074 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1237/2450] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:32:50 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:32:54.843508 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b3dee-e51f-433f-b68d-9af1c6167396 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:54.844584 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b3dee-e51f-433f-b68d-9af1c6167396 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:54.845088 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b3dee-e51f-433f-b68d-9af1c6167396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:54.888801 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-b67b3dee-e51f-433f-b68d-9af1c6167396 None None] MFA Rules not processed for user `e2349bd756334f1885d30cfce2730297`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:32:54.890453 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-b67b3dee-e51f-433f-b68d-9af1c6167396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:54.905015 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1214/2451] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:32:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:32:57.800172 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e0219-9741-4501-a667-1da1a6c72c6c service neutron] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:32:57.801643 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-4a6e0219-9741-4501-a667-1da1a6c72c6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:57.983713 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e0219-9741-4501-a667-1da1a6c72c6c service neutron] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:32:57.999111 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0af6d4-11d8-45df-9b18-50a304024385 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57dfafee636a45ca98fe0e8bb13dd754', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:32:57.999908 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0af6d4-11d8-45df-9b18-50a304024385 service placement] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:58.003205 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0af6d4-11d8-45df-9b18-50a304024385 service placement] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:58.003632 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0af6d4-11d8-45df-9b18-50a304024385 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:58.006431 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-de0af6d4-11d8-45df-9b18-50a304024385 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:58.038644 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0af6d4-11d8-45df-9b18-50a304024385 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:32:58.043698 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0af6d4-11d8-45df-9b18-50a304024385 service placement] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:32:58.083435 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1238/2452] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:32:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:32:59.777915 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e800b-d657-4d7c-bc39-4e806fdd6bc1 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:32:59.778433 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e800b-d657-4d7c-bc39-4e806fdd6bc1 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:32:59.778433 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e800b-d657-4d7c-bc39-4e806fdd6bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:32:59.801381 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-1c6e800b-d657-4d7c-bc39-4e806fdd6bc1 None None] MFA Rules not processed for user `77c9a03620d04b2a9f80ec16f9738670`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:32:59.803062 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-1c6e800b-d657-4d7c-bc39-4e806fdd6bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:32:59.937980 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1215/2453] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:32:59 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:33:02.140540 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560cc81c-49f8-4777-8b86-9ff756a0f817 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:33:02.141761 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560cc81c-49f8-4777-8b86-9ff756a0f817 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:33:02.142723 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560cc81c-49f8-4777-8b86-9ff756a0f817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:33:02.193063 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-560cc81c-49f8-4777-8b86-9ff756a0f817 None None] MFA Rules not processed for user `dfe8c00c0c3d4c4b8b6f36e39a3a2e71`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:33:02.199308 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-560cc81c-49f8-4777-8b86-9ff756a0f817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:33:02.220350 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1239/2454] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Aug 2 15:33:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:33:02.257022 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e800b-d657-4d7c-bc39-4e806fdd6bc1 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:33:02.294868 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e800b-d657-4d7c-bc39-4e806fdd6bc1 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:33:02.302009 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e4c4f3-6f3e-4d8f-8f5f-affee9ffc6d0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4de590df474c8b95f2b1193f7dbcb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:33:02.302921 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4c4f3-6f3e-4d8f-8f5f-affee9ffc6d0 service swift] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:33:02.303410 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4c4f3-6f3e-4d8f-8f5f-affee9ffc6d0 service swift] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:33:02.304317 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4c4f3-6f3e-4d8f-8f5f-affee9ffc6d0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:33:02.324476 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e4c4f3-6f3e-4d8f-8f5f-affee9ffc6d0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:33:02.328101 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e4c4f3-6f3e-4d8f-8f5f-affee9ffc6d0 service swift] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:33:02.342571 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1216/2455] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Aug 2 15:33:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 15:33:10.327856 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeee1eb-c6bc-4281-a897-35e3f4aa489d None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:33:10.328679 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeee1eb-c6bc-4281-a897-35e3f4aa489d None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:33:10.331481 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeee1eb-c6bc-4281-a897-35e3f4aa489d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:33:10.340140 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=93 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:33:10.354611 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-0aeee1eb-c6bc-4281-a897-35e3f4aa489d None None] MFA Rules not processed for user `dfe8c00c0c3d4c4b8b6f36e39a3a2e71`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:33:10.355956 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-0aeee1eb-c6bc-4281-a897-35e3f4aa489d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:33:10.367792 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1240/2456] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Aug 2 15:33:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:33:10.390203 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e4c4f3-6f3e-4d8f-8f5f-affee9ffc6d0 service swift] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:33:10.395698 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=69 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:33:10.405997 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e4c4f3-6f3e-4d8f-8f5f-affee9ffc6d0 service swift] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:33:10.411424 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf190da-cc83-46ea-a3c0-b50167650998 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4de590df474c8b95f2b1193f7dbcb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:33:10.412048 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf190da-cc83-46ea-a3c0-b50167650998 service swift] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:33:10.412328 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf190da-cc83-46ea-a3c0-b50167650998 service swift] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:33:10.412603 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf190da-cc83-46ea-a3c0-b50167650998 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:33:10.422371 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf190da-cc83-46ea-a3c0-b50167650998 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:33:10.424183 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf190da-cc83-46ea-a3c0-b50167650998 service swift] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:33:10.435255 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1217/2457] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Aug 2 15:33:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 15:33:11.010281 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5acbd-a3d7-44aa-92f1-f8799cff8bbe None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:33:11.010604 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5acbd-a3d7-44aa-92f1-f8799cff8bbe None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:33:11.011028 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5acbd-a3d7-44aa-92f1-f8799cff8bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:33:11.039600 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-22d5acbd-a3d7-44aa-92f1-f8799cff8bbe None None] MFA Rules not processed for user `dfe8c00c0c3d4c4b8b6f36e39a3a2e71`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:33:11.041804 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-22d5acbd-a3d7-44aa-92f1-f8799cff8bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:33:11.052666 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1241/2458] 10.222.0.42 () {58 vars in 967 bytes} [Tue Aug 2 15:33:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:33:11.068271 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf190da-cc83-46ea-a3c0-b50167650998 service swift] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:33:11.079441 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf190da-cc83-46ea-a3c0-b50167650998 service swift] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:33:11.088224 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b473e7-e1b6-428a-a1a7-64bc6d8e358f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4de590df474c8b95f2b1193f7dbcb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:33:11.089874 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b473e7-e1b6-428a-a1a7-64bc6d8e358f service swift] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:33:11.090621 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b473e7-e1b6-428a-a1a7-64bc6d8e358f service swift] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:33:11.091569 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b473e7-e1b6-428a-a1a7-64bc6d8e358f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:33:11.101924 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b473e7-e1b6-428a-a1a7-64bc6d8e358f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:33:11.104174 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b473e7-e1b6-428a-a1a7-64bc6d8e358f service swift] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:33:11.116634 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1218/2459] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Aug 2 15:33:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 15:33:11.426244 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125eeae3-966b-4a3a-ba50-7ecd35c6a884 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:33:11.426895 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125eeae3-966b-4a3a-ba50-7ecd35c6a884 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:33:11.427306 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125eeae3-966b-4a3a-ba50-7ecd35c6a884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:33:11.450617 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-125eeae3-966b-4a3a-ba50-7ecd35c6a884 None None] MFA Rules not processed for user `dfe8c00c0c3d4c4b8b6f36e39a3a2e71`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:33:11.451900 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-125eeae3-966b-4a3a-ba50-7ecd35c6a884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:33:11.459470 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1242/2460] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Aug 2 15:33:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:33:11.471892 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b473e7-e1b6-428a-a1a7-64bc6d8e358f service swift] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:33:11.482710 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b473e7-e1b6-428a-a1a7-64bc6d8e358f service swift] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:33:11.488846 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e212cee7-3c60-4949-80da-9bbdb06a514f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4de590df474c8b95f2b1193f7dbcb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:33:11.489539 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212cee7-3c60-4949-80da-9bbdb06a514f service swift] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:33:11.489888 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212cee7-3c60-4949-80da-9bbdb06a514f service swift] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:33:11.490198 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212cee7-3c60-4949-80da-9bbdb06a514f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:33:11.500340 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e212cee7-3c60-4949-80da-9bbdb06a514f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:33:11.501975 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e212cee7-3c60-4949-80da-9bbdb06a514f service swift] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:33:11.512126 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1219/2461] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Aug 2 15:33:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 15:33:11.743982 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c324418-9b19-4a67-95cb-4379525621c6 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:33:11.744278 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c324418-9b19-4a67-95cb-4379525621c6 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:33:11.744560 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c324418-9b19-4a67-95cb-4379525621c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:33:11.774031 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-7c324418-9b19-4a67-95cb-4379525621c6 None None] MFA Rules not processed for user `dfe8c00c0c3d4c4b8b6f36e39a3a2e71`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:33:11.775344 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-7c324418-9b19-4a67-95cb-4379525621c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:33:11.782929 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1243/2462] 10.222.0.42 () {58 vars in 967 bytes} [Tue Aug 2 15:33:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:33:11.800893 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e212cee7-3c60-4949-80da-9bbdb06a514f service swift] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:33:11.812364 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e212cee7-3c60-4949-80da-9bbdb06a514f service swift] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:33:11.818020 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069cfab3-6ae9-4074-9bf4-ba72f59074d5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4de590df474c8b95f2b1193f7dbcb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:33:11.818900 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069cfab3-6ae9-4074-9bf4-ba72f59074d5 service swift] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:33:11.819301 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069cfab3-6ae9-4074-9bf4-ba72f59074d5 service swift] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:33:11.819654 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069cfab3-6ae9-4074-9bf4-ba72f59074d5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:33:11.835497 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069cfab3-6ae9-4074-9bf4-ba72f59074d5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:33:11.837867 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069cfab3-6ae9-4074-9bf4-ba72f59074d5 service swift] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:33:11.846621 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1220/2463] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Aug 2 15:33:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 02 15:33:12.576115 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f2fe2-8be0-4626-89cc-a6de134585a2 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:33:12.577096 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f2fe2-8be0-4626-89cc-a6de134585a2 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:33:12.577567 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f2fe2-8be0-4626-89cc-a6de134585a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:33:12.606548 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-799f2fe2-8be0-4626-89cc-a6de134585a2 None None] MFA Rules not processed for user `dfe8c00c0c3d4c4b8b6f36e39a3a2e71`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:33:12.608418 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-799f2fe2-8be0-4626-89cc-a6de134585a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:33:12.617653 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1244/2464] 10.222.0.42 () {58 vars in 967 bytes} [Tue Aug 2 15:33:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:33:12.640400 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069cfab3-6ae9-4074-9bf4-ba72f59074d5 service swift] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:33:12.653706 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069cfab3-6ae9-4074-9bf4-ba72f59074d5 service swift] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:33:12.660589 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7197a4-7cf5-4f5d-8afd-7b7936515d83 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4de590df474c8b95f2b1193f7dbcb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:33:12.661334 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7197a4-7cf5-4f5d-8afd-7b7936515d83 service swift] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:33:12.661782 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7197a4-7cf5-4f5d-8afd-7b7936515d83 service swift] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:33:12.662244 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7197a4-7cf5-4f5d-8afd-7b7936515d83 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:33:12.672828 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7197a4-7cf5-4f5d-8afd-7b7936515d83 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:33:12.674584 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7197a4-7cf5-4f5d-8afd-7b7936515d83 service swift] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:33:12.684227 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1221/2465] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Aug 2 15:33:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 02 15:33:14.407119 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f2fe2-8be0-4626-89cc-a6de134585a2 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:33:14.409744 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-799f2fe2-8be0-4626-89cc-a6de134585a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:33:14.514310 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f2fe2-8be0-4626-89cc-a6de134585a2 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:33:14.521859 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d78b6-d242-48aa-bfab-309f67abb258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:33:14.522851 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d78b6-d242-48aa-bfab-309f67abb258 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:33:14.523422 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d78b6-d242-48aa-bfab-309f67abb258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:33:14.523917 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d78b6-d242-48aa-bfab-309f67abb258 admin admin] PATH_INFO: `/v3/users/73208e627bdc4315b4e1eed3a96a2b10` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:33:14.525658 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711d78b6-d242-48aa-bfab-309f67abb258 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73208e627bdc4315b4e1eed3a96a2b10)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:33:14.528986 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711d78b6-d242-48aa-bfab-309f67abb258 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:33:14.586962 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-711d78b6-d242-48aa-bfab-309f67abb258 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73208e627bdc4315b4e1eed3a96a2b10'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:33:14.599677 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-711d78b6-d242-48aa-bfab-309f67abb258 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73208e627bdc4315b4e1eed3a96a2b10'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:33:14.600544 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-711d78b6-d242-48aa-bfab-309f67abb258 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73208e627bdc4315b4e1eed3a96a2b10'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:33:14.611438 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-711d78b6-d242-48aa-bfab-309f67abb258 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73208e627bdc4315b4e1eed3a96a2b10'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:33:14.623632 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-711d78b6-d242-48aa-bfab-309f67abb258 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73208e627bdc4315b4e1eed3a96a2b10'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:33:14.631720 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1245/2466] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:33:14 2022] DELETE /identity/v3/users/73208e627bdc4315b4e1eed3a96a2b10 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:33:14.921659 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7197a4-7cf5-4f5d-8afd-7b7936515d83 service swift] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:33:14.938299 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7197a4-7cf5-4f5d-8afd-7b7936515d83 service swift] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:33:15.015752 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee8611f-ed72-43f8-b346-ce11e7e891a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:33:15.016419 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8611f-ed72-43f8-b346-ce11e7e891a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:33:15.016699 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8611f-ed72-43f8-b346-ce11e7e891a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:33:15.016975 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8611f-ed72-43f8-b346-ce11e7e891a9 admin admin] PATH_INFO: `/v3/projects/f6e62db963a84b69b7c07a136fe5476f` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:33:15.018364 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee8611f-ed72-43f8-b346-ce11e7e891a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6e62db963a84b69b7c07a136fe5476f)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:33:15.020491 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee8611f-ed72-43f8-b346-ce11e7e891a9 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:33:15.096263 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-9ee8611f-ed72-43f8-b346-ce11e7e891a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6e62db963a84b69b7c07a136fe5476f', 'request_id': 'req-9ee8611f-ed72-43f8-b346-ce11e7e891a9'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:33:15.105522 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-9ee8611f-ed72-43f8-b346-ce11e7e891a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6e62db963a84b69b7c07a136fe5476f', 'request_id': 'req-9ee8611f-ed72-43f8-b346-ce11e7e891a9'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:33:15.119627 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-9ee8611f-ed72-43f8-b346-ce11e7e891a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6e62db963a84b69b7c07a136fe5476f', 'request_id': 'req-9ee8611f-ed72-43f8-b346-ce11e7e891a9'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:33:15.136570 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-9ee8611f-ed72-43f8-b346-ce11e7e891a9 admin admin] The token cache is being invalidate because project f6e62db963a84b69b7c07a136fe5476f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80360) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:33:15.136878 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-9ee8611f-ed72-43f8-b346-ce11e7e891a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:33:15.137552 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-9ee8611f-ed72-43f8-b346-ce11e7e891a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:33:15.139428 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1222/2467] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:33:14 2022] DELETE /identity/v3/projects/f6e62db963a84b69b7c07a136fe5476f => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:33:15.144210 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d39641-1d71-4826-a60f-852538dc9c9f None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:33:15.144776 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d39641-1d71-4826-a60f-852538dc9c9f None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:33:15.145279 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d39641-1d71-4826-a60f-852538dc9c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:33:15.174069 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee8611f-ed72-43f8-b346-ce11e7e891a9 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:33:15.175825 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-9ee8611f-ed72-43f8-b346-ce11e7e891a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:33:15.177142 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-51d39641-1d71-4826-a60f-852538dc9c9f None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:33:15.178518 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-51d39641-1d71-4826-a60f-852538dc9c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:33:15.211475 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:33:15.235764 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:33:15.256949 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1246/2468] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:33:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:33:15.265379 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a5712e-aa89-42d4-a7fc-467df1ea3ac0 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:33:15.265673 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a5712e-aa89-42d4-a7fc-467df1ea3ac0 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:33:15.265947 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a5712e-aa89-42d4-a7fc-467df1ea3ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:33:15.277896 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee8611f-ed72-43f8-b346-ce11e7e891a9 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:33:15.283232 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3a70fa-99f8-4d1a-864e-09fa5c7d88f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:33:15.283910 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a70fa-99f8-4d1a-864e-09fa5c7d88f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:33:15.284197 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a70fa-99f8-4d1a-864e-09fa5c7d88f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:33:15.284473 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a70fa-99f8-4d1a-864e-09fa5c7d88f5 admin admin] PATH_INFO: `/v3/users/f5db295e414d48f59f7f9dd6c3d854a8` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:33:15.285757 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3a70fa-99f8-4d1a-864e-09fa5c7d88f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5db295e414d48f59f7f9dd6c3d854a8)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:33:15.286036 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-65a5712e-aa89-42d4-a7fc-467df1ea3ac0 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:33:15.287270 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-65a5712e-aa89-42d4-a7fc-467df1ea3ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:33:15.287726 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3a70fa-99f8-4d1a-864e-09fa5c7d88f5 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:33:15.296214 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1247/2469] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:33:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:33:15.300516 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a5712e-aa89-42d4-a7fc-467df1ea3ac0 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:33:15.317246 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a5712e-aa89-42d4-a7fc-467df1ea3ac0 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:33:15.323669 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f4708-cfe0-4740-bce8-8c0ca92563b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:33:15.324335 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f4708-cfe0-4740-bce8-8c0ca92563b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:33:15.324637 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f4708-cfe0-4740-bce8-8c0ca92563b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:33:15.325113 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f4708-cfe0-4740-bce8-8c0ca92563b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:33:15.325821 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689f4708-cfe0-4740-bce8-8c0ca92563b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:33:15.326144 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689f4708-cfe0-4740-bce8-8c0ca92563b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:33:15.328050 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689f4708-cfe0-4740-bce8-8c0ca92563b9 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:33:15.348586 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-ae3a70fa-99f8-4d1a-864e-09fa5c7d88f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5db295e414d48f59f7f9dd6c3d854a8'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:33:15.351793 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1248/2470] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 2 15:33:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:33:15.356449 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f4708-cfe0-4740-bce8-8c0ca92563b9 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:33:15.359080 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-ae3a70fa-99f8-4d1a-864e-09fa5c7d88f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5db295e414d48f59f7f9dd6c3d854a8'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:33:15.368351 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f4708-cfe0-4740-bce8-8c0ca92563b9 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:33:15.374280 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-ae3a70fa-99f8-4d1a-864e-09fa5c7d88f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5db295e414d48f59f7f9dd6c3d854a8'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:33:15.375078 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-ae3a70fa-99f8-4d1a-864e-09fa5c7d88f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5db295e414d48f59f7f9dd6c3d854a8'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:33:15.375778 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-ae3a70fa-99f8-4d1a-864e-09fa5c7d88f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5db295e414d48f59f7f9dd6c3d854a8'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:33:15.376442 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad90a44-e850-4eec-aaea-e1347375df7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:33:15.377075 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad90a44-e850-4eec-aaea-e1347375df7d admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:33:15.377391 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad90a44-e850-4eec-aaea-e1347375df7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:33:15.377670 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad90a44-e850-4eec-aaea-e1347375df7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:33:15.378337 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad90a44-e850-4eec-aaea-e1347375df7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:33:15.380641 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad90a44-e850-4eec-aaea-e1347375df7d admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:33:15.391077 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1223/2471] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:33:15 2022] DELETE /identity/v3/users/f5db295e414d48f59f7f9dd6c3d854a8 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 15:33:15.395680 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9cced8-23d4-41fe-8d4b-f75e63a41b6d None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:33:15.396091 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9cced8-23d4-41fe-8d4b-f75e63a41b6d None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:33:15.396434 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9cced8-23d4-41fe-8d4b-f75e63a41b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:33:15.418440 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1249/2472] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:33:15 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 15:33:15.423331 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad90a44-e850-4eec-aaea-e1347375df7d admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:33:15.423649 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-3f9cced8-23d4-41fe-8d4b-f75e63a41b6d None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:33:15.424809 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-3f9cced8-23d4-41fe-8d4b-f75e63a41b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:33:15.425242 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-2ad90a44-e850-4eec-aaea-e1347375df7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:33:15.490896 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1224/2473] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:33:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:33:15.501154 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9cced8-23d4-41fe-8d4b-f75e63a41b6d None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:33:15.502520 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad90a44-e850-4eec-aaea-e1347375df7d admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:33:15.502793 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-3f9cced8-23d4-41fe-8d4b-f75e63a41b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:33:15.507275 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4034ac80-8b28-4a1a-a1d0-ef5185ad10b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:33:15.507898 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034ac80-8b28-4a1a-a1d0-ef5185ad10b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:33:15.508360 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034ac80-8b28-4a1a-a1d0-ef5185ad10b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:33:15.508851 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034ac80-8b28-4a1a-a1d0-ef5185ad10b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:33:15.509510 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4034ac80-8b28-4a1a-a1d0-ef5185ad10b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:33:15.511668 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4034ac80-8b28-4a1a-a1d0-ef5185ad10b7 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:33:15.533516 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1250/2474] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:33:15 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:33:15.537827 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4034ac80-8b28-4a1a-a1d0-ef5185ad10b7 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:33:15.548717 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4034ac80-8b28-4a1a-a1d0-ef5185ad10b7 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:33:15.553847 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f031aa69-650f-4b56-a700-2dc7a3c3a608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:33:15.554490 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031aa69-650f-4b56-a700-2dc7a3c3a608 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:33:15.554769 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031aa69-650f-4b56-a700-2dc7a3c3a608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:33:15.555062 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031aa69-650f-4b56-a700-2dc7a3c3a608 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:33:15.556427 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f031aa69-650f-4b56-a700-2dc7a3c3a608 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:33:15.558028 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f031aa69-650f-4b56-a700-2dc7a3c3a608 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:33:15.558583 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:33:15.564017 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9cced8-23d4-41fe-8d4b-f75e63a41b6d None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:33:15.571600 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1251/2475] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:33:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:33:15.571781 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee10b2b-e7f7-4479-ba78-adcbbab014b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:33:15.571781 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee10b2b-e7f7-4479-ba78-adcbbab014b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:33:15.571781 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee10b2b-e7f7-4479-ba78-adcbbab014b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:33:15.571781 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee10b2b-e7f7-4479-ba78-adcbbab014b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:33:15.573103 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f031aa69-650f-4b56-a700-2dc7a3c3a608 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:33:15.580427 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee10b2b-e7f7-4479-ba78-adcbbab014b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:33:15.581856 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee10b2b-e7f7-4479-ba78-adcbbab014b0 service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:33:15.582722 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f031aa69-650f-4b56-a700-2dc7a3c3a608 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:33:15.592958 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1225/2476] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:33:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 15:33:15.595896 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df8f3d-f915-434b-ae3a-9d41e701f44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:33:15.596575 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df8f3d-f915-434b-ae3a-9d41e701f44a admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:33:15.596893 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df8f3d-f915-434b-ae3a-9d41e701f44a admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:33:15.597173 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df8f3d-f915-434b-ae3a-9d41e701f44a admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:33:15.597927 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45df8f3d-f915-434b-ae3a-9d41e701f44a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:33:15.599527 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45df8f3d-f915-434b-ae3a-9d41e701f44a admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:33:15.613377 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1252/2477] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:33:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:33:15.617505 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee10b2b-e7f7-4479-ba78-adcbbab014b0 service neutron] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:33:15.628449 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee10b2b-e7f7-4479-ba78-adcbbab014b0 service neutron] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:33:15.633636 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2167419-b78e-4a9c-84fa-2ed664f552da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:33:15.634876 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2167419-b78e-4a9c-84fa-2ed664f552da admin admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:33:15.635163 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2167419-b78e-4a9c-84fa-2ed664f552da admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:33:15.635478 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2167419-b78e-4a9c-84fa-2ed664f552da admin admin] PATH_INFO: `/v3/projects/070bf7470ca14734b506a467ed5983f6/users/634c2f51cc31414a88e027aa40739d6f/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:33:15.654004 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2167419-b78e-4a9c-84fa-2ed664f552da admin admin] RBAC: Authorizing `identity:create_grant(project_id=070bf7470ca14734b506a467ed5983f6, user_id=634c2f51cc31414a88e027aa40739d6f, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:33:15.656860 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2167419-b78e-4a9c-84fa-2ed664f552da admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:33:15.674093 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1226/2478] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:33:15 2022] PUT /identity/v3/projects/070bf7470ca14734b506a467ed5983f6/users/634c2f51cc31414a88e027aa40739d6f/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 15:33:15.745951 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2de534-6437-43e1-9292-98cc9892280d None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:33:15.746243 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2de534-6437-43e1-9292-98cc9892280d None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:33:15.746962 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2de534-6437-43e1-9292-98cc9892280d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:33:15.789068 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-4f2de534-6437-43e1-9292-98cc9892280d None None] MFA Rules not processed for user `634c2f51cc31414a88e027aa40739d6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:33:15.790543 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-4f2de534-6437-43e1-9292-98cc9892280d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:33:15.800698 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2167419-b78e-4a9c-84fa-2ed664f552da admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:33:15.802460 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-d2167419-b78e-4a9c-84fa-2ed664f552da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:33:15.863817 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1253/2479] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:33:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:33:15.875389 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2de534-6437-43e1-9292-98cc9892280d None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:33:15.876765 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-4f2de534-6437-43e1-9292-98cc9892280d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:33:15.885369 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2167419-b78e-4a9c-84fa-2ed664f552da admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:33:15.886917 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:33:15.890929 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26943617-c350-4a6c-b551-3e98f576b30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:33:15.891632 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26943617-c350-4a6c-b551-3e98f576b30a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:33:15.891918 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26943617-c350-4a6c-b551-3e98f576b30a admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:33:15.892201 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26943617-c350-4a6c-b551-3e98f576b30a admin admin] PATH_INFO: `/v3/projects/64bea2739769411fbb27afaa2da5e352` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:33:15.893642 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26943617-c350-4a6c-b551-3e98f576b30a admin admin] RBAC: Authorizing `identity:delete_project(project_id=64bea2739769411fbb27afaa2da5e352)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:33:15.895601 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26943617-c350-4a6c-b551-3e98f576b30a admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:33:15.944675 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2de534-6437-43e1-9292-98cc9892280d None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:33:15.954159 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-26943617-c350-4a6c-b551-3e98f576b30a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64bea2739769411fbb27afaa2da5e352', 'request_id': 'req-26943617-c350-4a6c-b551-3e98f576b30a'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:33:15.963131 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-26943617-c350-4a6c-b551-3e98f576b30a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64bea2739769411fbb27afaa2da5e352', 'request_id': 'req-26943617-c350-4a6c-b551-3e98f576b30a'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:33:15.974093 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-26943617-c350-4a6c-b551-3e98f576b30a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64bea2739769411fbb27afaa2da5e352', 'request_id': 'req-26943617-c350-4a6c-b551-3e98f576b30a'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:33:15.989727 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-26943617-c350-4a6c-b551-3e98f576b30a admin admin] The token cache is being invalidate because project 64bea2739769411fbb27afaa2da5e352 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80360) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:33:15.990025 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-26943617-c350-4a6c-b551-3e98f576b30a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:33:15.990726 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-26943617-c350-4a6c-b551-3e98f576b30a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:33:15.993228 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1227/2480] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:33:15 2022] DELETE /identity/v3/projects/64bea2739769411fbb27afaa2da5e352 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 15:33:15.998211 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af7ea6-d269-4786-8572-8a04ee3191fd None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:33:15.998566 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af7ea6-d269-4786-8572-8a04ee3191fd None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:33:15.998862 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af7ea6-d269-4786-8572-8a04ee3191fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:33:16.000916 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e19495-4ddc-43d3-bc33-3329761e7ec5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:33:16.001666 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e19495-4ddc-43d3-bc33-3329761e7ec5 service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:33:16.002036 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e19495-4ddc-43d3-bc33-3329761e7ec5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:33:16.002380 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e19495-4ddc-43d3-bc33-3329761e7ec5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:33:16.004200 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-45e19495-4ddc-43d3-bc33-3329761e7ec5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:33:16.021723 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-46af7ea6-d269-4786-8572-8a04ee3191fd None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:33:16.023754 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-46af7ea6-d269-4786-8572-8a04ee3191fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:33:16.100771 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e19495-4ddc-43d3-bc33-3329761e7ec5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:33:16.102957 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e19495-4ddc-43d3-bc33-3329761e7ec5 service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:33:16.116702 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1254/2481] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:33:15 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 15:33:16.118879 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:33:16.131453 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1228/2482] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:33:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:33:16.139874 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280965dc-d038-45e8-ba7e-7c40e225b56e None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:33:16.140163 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280965dc-d038-45e8-ba7e-7c40e225b56e None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:33:16.140440 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280965dc-d038-45e8-ba7e-7c40e225b56e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:33:16.163020 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-280965dc-d038-45e8-ba7e-7c40e225b56e None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:33:16.164266 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-280965dc-d038-45e8-ba7e-7c40e225b56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:33:16.172835 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1255/2483] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:33:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:33:16.177098 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af7ea6-d269-4786-8572-8a04ee3191fd None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:33:16.187278 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af7ea6-d269-4786-8572-8a04ee3191fd None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:33:16.192300 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e48efa-e740-4f8b-8ca4-6edc5bb507aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:33:16.193004 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e48efa-e740-4f8b-8ca4-6edc5bb507aa admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:33:16.193352 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e48efa-e740-4f8b-8ca4-6edc5bb507aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:33:16.193627 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e48efa-e740-4f8b-8ca4-6edc5bb507aa admin admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:33:16.194324 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e48efa-e740-4f8b-8ca4-6edc5bb507aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:33:16.194627 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e48efa-e740-4f8b-8ca4-6edc5bb507aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:33:16.196818 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e48efa-e740-4f8b-8ca4-6edc5bb507aa admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:33:16.215065 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280965dc-d038-45e8-ba7e-7c40e225b56e None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:33:16.220830 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1229/2484] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 2 15:33:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:33:16.225277 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280965dc-d038-45e8-ba7e-7c40e225b56e None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:33:16.230478 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10cfdc5-ec72-4d01-b872-1ff9d4281800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:33:16.231096 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10cfdc5-ec72-4d01-b872-1ff9d4281800 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:33:16.231410 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10cfdc5-ec72-4d01-b872-1ff9d4281800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:33:16.231688 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10cfdc5-ec72-4d01-b872-1ff9d4281800 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:33:16.232336 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10cfdc5-ec72-4d01-b872-1ff9d4281800 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:33:16.234367 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10cfdc5-ec72-4d01-b872-1ff9d4281800 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:33:16.276378 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1256/2485] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:33:16 2022] POST /identity/v3/projects => generated 383 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:33:16.280617 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e48efa-e740-4f8b-8ca4-6edc5bb507aa admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:33:16.292666 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e48efa-e740-4f8b-8ca4-6edc5bb507aa admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:33:16.362439 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a53253-b4fd-48d5-aa82-1387f103b980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:33:16.363117 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a53253-b4fd-48d5-aa82-1387f103b980 admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:33:16.363407 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a53253-b4fd-48d5-aa82-1387f103b980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:33:16.363685 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a53253-b4fd-48d5-aa82-1387f103b980 admin admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:33:16.364408 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a53253-b4fd-48d5-aa82-1387f103b980 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:33:16.366445 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a53253-b4fd-48d5-aa82-1387f103b980 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:33:16.391016 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1230/2486] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:33:16 2022] POST /identity/v3/users => generated 292 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:33:16.395627 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10cfdc5-ec72-4d01-b872-1ff9d4281800 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:33:16.409243 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10cfdc5-ec72-4d01-b872-1ff9d4281800 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:33:16.427302 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2fef03-ba3a-421e-8801-8a02894b3ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:33:16.428130 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2fef03-ba3a-421e-8801-8a02894b3ec6 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:33:16.428416 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2fef03-ba3a-421e-8801-8a02894b3ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:33:16.428690 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2fef03-ba3a-421e-8801-8a02894b3ec6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:33:16.429559 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2fef03-ba3a-421e-8801-8a02894b3ec6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:33:16.432223 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2fef03-ba3a-421e-8801-8a02894b3ec6 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:33:16.445776 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1257/2487] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:33:16.449932 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a53253-b4fd-48d5-aa82-1387f103b980 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:33:16.460422 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a53253-b4fd-48d5-aa82-1387f103b980 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:33:16.476623 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c36f15-c101-4852-9d17-d48f9c02af8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:33:16.477275 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c36f15-c101-4852-9d17-d48f9c02af8b admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:33:16.478168 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c36f15-c101-4852-9d17-d48f9c02af8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:33:16.478474 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c36f15-c101-4852-9d17-d48f9c02af8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:33:16.479127 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c36f15-c101-4852-9d17-d48f9c02af8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:33:16.482279 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c36f15-c101-4852-9d17-d48f9c02af8b admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:33:16.501574 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1231/2488] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:33:16.503117 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2fef03-ba3a-421e-8801-8a02894b3ec6 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:33:16.518931 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2fef03-ba3a-421e-8801-8a02894b3ec6 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:33:16.523958 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e2ac2d-d5ab-40cc-af3c-b213235e5fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:33:16.525287 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2ac2d-d5ab-40cc-af3c-b213235e5fe1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:33:16.525480 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2ac2d-d5ab-40cc-af3c-b213235e5fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:33:16.525751 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2ac2d-d5ab-40cc-af3c-b213235e5fe1 admin admin] PATH_INFO: `/v3/projects/470ec768e7324780a3f2eded8431a93b/users/cddf51fd31994e189c433c1fb20cb229/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:33:16.545454 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e2ac2d-d5ab-40cc-af3c-b213235e5fe1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=470ec768e7324780a3f2eded8431a93b, user_id=cddf51fd31994e189c433c1fb20cb229, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:33:16.548845 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e2ac2d-d5ab-40cc-af3c-b213235e5fe1 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:33:16.567303 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1258/2489] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:33:16 2022] PUT /identity/v3/projects/470ec768e7324780a3f2eded8431a93b/users/cddf51fd31994e189c433c1fb20cb229/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:33:16.572516 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bde9eb-d89d-4272-9b3c-5e889dea284b None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:33:16.572888 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bde9eb-d89d-4272-9b3c-5e889dea284b None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:33:16.573260 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bde9eb-d89d-4272-9b3c-5e889dea284b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:33:16.594468 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-92bde9eb-d89d-4272-9b3c-5e889dea284b None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:33:16.596048 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-92bde9eb-d89d-4272-9b3c-5e889dea284b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:33:16.659569 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1232/2490] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:33:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:33:16.670025 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e2ac2d-d5ab-40cc-af3c-b213235e5fe1 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:33:16.672151 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-f0e2ac2d-d5ab-40cc-af3c-b213235e5fe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:33:16.688751 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:33:16.743943 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e2ac2d-d5ab-40cc-af3c-b213235e5fe1 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:33:16.748220 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b6fa06-46a0-437b-a8ad-89922858609c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:33:16.748862 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6fa06-46a0-437b-a8ad-89922858609c service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:33:16.749140 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6fa06-46a0-437b-a8ad-89922858609c service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:33:16.749414 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6fa06-46a0-437b-a8ad-89922858609c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:33:16.761233 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b6fa06-46a0-437b-a8ad-89922858609c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:33:16.762743 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b6fa06-46a0-437b-a8ad-89922858609c service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:33:16.772871 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1259/2491] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:33:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:33:18.571872 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d1a0e-2244-44d2-bd5c-beb10dc41afa None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:33:18.572450 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d1a0e-2244-44d2-bd5c-beb10dc41afa None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:33:18.572450 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d1a0e-2244-44d2-bd5c-beb10dc41afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:33:18.621787 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-fe8d1a0e-2244-44d2-bd5c-beb10dc41afa None None] MFA Rules not processed for user `cddf51fd31994e189c433c1fb20cb229`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:33:18.623035 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-fe8d1a0e-2244-44d2-bd5c-beb10dc41afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:33:18.679800 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:33:18.700692 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1233/2492] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:33:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:33:18.711356 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b6fa06-46a0-437b-a8ad-89922858609c service neutron] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:33:18.713377 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-37b6fa06-46a0-437b-a8ad-89922858609c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:33:18.773172 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b6fa06-46a0-437b-a8ad-89922858609c service neutron] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:33:18.777183 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a6ea8b-29fa-44ae-a17f-fdfab4d6bd84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:33:18.778016 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6ea8b-29fa-44ae-a17f-fdfab4d6bd84 service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:33:18.778295 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6ea8b-29fa-44ae-a17f-fdfab4d6bd84 service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:33:18.778570 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6ea8b-29fa-44ae-a17f-fdfab4d6bd84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:33:18.793363 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d1a0e-2244-44d2-bd5c-beb10dc41afa None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:33:18.794765 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-fe8d1a0e-2244-44d2-bd5c-beb10dc41afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:33:18.796193 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a6ea8b-29fa-44ae-a17f-fdfab4d6bd84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:33:18.798028 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a6ea8b-29fa-44ae-a17f-fdfab4d6bd84 service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:33:18.809686 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1260/2493] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:33:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:33:18.809886 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d1a0e-2244-44d2-bd5c-beb10dc41afa None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:33:18.814584 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa322bc-0157-4a3d-ac01-355b8f4baecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:33:18.815472 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa322bc-0157-4a3d-ac01-355b8f4baecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:33:18.815850 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa322bc-0157-4a3d-ac01-355b8f4baecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:33:18.816226 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa322bc-0157-4a3d-ac01-355b8f4baecc admin admin] PATH_INFO: `/v3/users/634c2f51cc31414a88e027aa40739d6f` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:33:18.817717 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa322bc-0157-4a3d-ac01-355b8f4baecc admin admin] RBAC: Authorizing `identity:delete_user(user_id=634c2f51cc31414a88e027aa40739d6f)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:33:18.819769 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa322bc-0157-4a3d-ac01-355b8f4baecc admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:33:18.880952 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-afa322bc-0157-4a3d-ac01-355b8f4baecc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '634c2f51cc31414a88e027aa40739d6f'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:33:18.889144 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-afa322bc-0157-4a3d-ac01-355b8f4baecc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '634c2f51cc31414a88e027aa40739d6f'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:33:18.901503 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-afa322bc-0157-4a3d-ac01-355b8f4baecc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '634c2f51cc31414a88e027aa40739d6f'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:33:18.902280 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-afa322bc-0157-4a3d-ac01-355b8f4baecc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '634c2f51cc31414a88e027aa40739d6f'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:33:18.902873 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-afa322bc-0157-4a3d-ac01-355b8f4baecc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '634c2f51cc31414a88e027aa40739d6f'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:33:18.923307 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1234/2494] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:33:18 2022] DELETE /identity/v3/users/634c2f51cc31414a88e027aa40739d6f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 15:33:18.926823 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4cd5e-9742-41d1-b6f1-01d8579ad6c1 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:33:18.927351 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4cd5e-9742-41d1-b6f1-01d8579ad6c1 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:33:18.927724 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4cd5e-9742-41d1-b6f1-01d8579ad6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:33:18.950331 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-32a4cd5e-9742-41d1-b6f1-01d8579ad6c1 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:33:18.952055 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-32a4cd5e-9742-41d1-b6f1-01d8579ad6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:33:19.027429 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1261/2495] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:33:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:33:19.030303 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa322bc-0157-4a3d-ac01-355b8f4baecc admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:33:19.031970 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-afa322bc-0157-4a3d-ac01-355b8f4baecc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:33:19.114455 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa322bc-0157-4a3d-ac01-355b8f4baecc admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:33:19.119074 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d9de3-2933-4ca3-9e55-0667d5f0bafe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:33:19.119999 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d9de3-2933-4ca3-9e55-0667d5f0bafe service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:33:19.120389 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d9de3-2933-4ca3-9e55-0667d5f0bafe service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:33:19.120711 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d9de3-2933-4ca3-9e55-0667d5f0bafe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:33:19.132925 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583d9de3-2933-4ca3-9e55-0667d5f0bafe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:33:19.135094 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583d9de3-2933-4ca3-9e55-0667d5f0bafe service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:33:19.146176 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1235/2496] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:33:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:33:19.855968 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4cd5e-9742-41d1-b6f1-01d8579ad6c1 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:33:19.857714 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-32a4cd5e-9742-41d1-b6f1-01d8579ad6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:33:19.871683 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4cd5e-9742-41d1-b6f1-01d8579ad6c1 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:33:19.878018 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b56e89-ae7b-433c-b507-181044686d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:33:19.878688 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b56e89-ae7b-433c-b507-181044686d9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:33:19.878970 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b56e89-ae7b-433c-b507-181044686d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:33:19.879276 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b56e89-ae7b-433c-b507-181044686d9b admin admin] PATH_INFO: `/v3/projects/070bf7470ca14734b506a467ed5983f6` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:33:19.880461 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b56e89-ae7b-433c-b507-181044686d9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=070bf7470ca14734b506a467ed5983f6)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:33:19.882437 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b56e89-ae7b-433c-b507-181044686d9b admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:33:19.989230 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-84b56e89-ae7b-433c-b507-181044686d9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '070bf7470ca14734b506a467ed5983f6', 'request_id': 'req-84b56e89-ae7b-433c-b507-181044686d9b'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:33:19.993766 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:33:20.001447 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-84b56e89-ae7b-433c-b507-181044686d9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '070bf7470ca14734b506a467ed5983f6', 'request_id': 'req-84b56e89-ae7b-433c-b507-181044686d9b'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:33:20.012683 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-84b56e89-ae7b-433c-b507-181044686d9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '070bf7470ca14734b506a467ed5983f6', 'request_id': 'req-84b56e89-ae7b-433c-b507-181044686d9b'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:33:20.029308 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-84b56e89-ae7b-433c-b507-181044686d9b admin admin] The token cache is being invalidate because project 070bf7470ca14734b506a467ed5983f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:33:20.031834 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-84b56e89-ae7b-433c-b507-181044686d9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:33:20.031834 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-84b56e89-ae7b-433c-b507-181044686d9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:33:20.033380 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1262/2497] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:33:19 2022] DELETE /identity/v3/projects/070bf7470ca14734b506a467ed5983f6 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:33:20.190948 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d9de3-2933-4ca3-9e55-0667d5f0bafe service neutron] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:33:20.192432 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-583d9de3-2933-4ca3-9e55-0667d5f0bafe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:33:20.205354 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d9de3-2933-4ca3-9e55-0667d5f0bafe service neutron] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:33:20.262885 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f713286-0ca6-4353-818f-72fdd6e3e9d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:33:20.263542 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f713286-0ca6-4353-818f-72fdd6e3e9d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:33:20.263827 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f713286-0ca6-4353-818f-72fdd6e3e9d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:33:20.264103 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f713286-0ca6-4353-818f-72fdd6e3e9d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:33:20.265875 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-1f713286-0ca6-4353-818f-72fdd6e3e9d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:33:20.284386 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d47da4-616f-490d-9d54-b0a7e6df18d9 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:33:20.284666 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d47da4-616f-490d-9d54-b0a7e6df18d9 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:33:20.284938 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d47da4-616f-490d-9d54-b0a7e6df18d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:33:20.286190 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:33:20.305272 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-13d47da4-616f-490d-9d54-b0a7e6df18d9 None None] MFA Rules not processed for user `cddf51fd31994e189c433c1fb20cb229`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:33:20.307234 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-13d47da4-616f-490d-9d54-b0a7e6df18d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:33:20.334488 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f713286-0ca6-4353-818f-72fdd6e3e9d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:33:20.335961 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f713286-0ca6-4353-818f-72fdd6e3e9d8 service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:33:20.345710 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1236/2498] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:33:20 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:33:20.364224 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1263/2499] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:33:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:33:30.341298 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=20 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:33:30.357338 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:DELETE=3,keystone:SELECT=31 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:33:37.130808 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f713286-0ca6-4353-818f-72fdd6e3e9d8 service neutron] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:33:37.132333 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-1f713286-0ca6-4353-818f-72fdd6e3e9d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:33:37.144149 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f713286-0ca6-4353-818f-72fdd6e3e9d8 service neutron] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:33:37.148118 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf16b7-fd26-4f9c-bd62-483dd4f40296 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:33:37.148994 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf16b7-fd26-4f9c-bd62-483dd4f40296 service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:33:37.149857 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf16b7-fd26-4f9c-bd62-483dd4f40296 service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:33:37.150140 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf16b7-fd26-4f9c-bd62-483dd4f40296 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:33:37.151976 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-3cbf16b7-fd26-4f9c-bd62-483dd4f40296 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:33:37.227188 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbf16b7-fd26-4f9c-bd62-483dd4f40296 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:33:37.228667 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbf16b7-fd26-4f9c-bd62-483dd4f40296 service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:33:37.238352 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1237/2500] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:33:37 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:33:47.234039 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=30 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:34:35.138799 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46e17c-e09c-425c-85bd-3a8ce5d84ab1 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:34:35.139440 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46e17c-e09c-425c-85bd-3a8ce5d84ab1 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:34:35.139440 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46e17c-e09c-425c-85bd-3a8ce5d84ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:34:35.158675 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-3e46e17c-e09c-425c-85bd-3a8ce5d84ab1 None None] MFA Rules not processed for user `0f08ca03f3f44afcbbbe94fe0ac5baf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:34:35.159906 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-3e46e17c-e09c-425c-85bd-3a8ce5d84ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:34:35.215606 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1264/2501] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:34:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:34:41.288580 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b3fe5-b9a8-4245-b499-082ed844273b None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:34:41.289257 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b3fe5-b9a8-4245-b499-082ed844273b None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:34:41.289257 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b3fe5-b9a8-4245-b499-082ed844273b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:34:41.313980 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-394b3fe5-b9a8-4245-b499-082ed844273b None None] MFA Rules not processed for user `cddf51fd31994e189c433c1fb20cb229`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:34:41.316041 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-394b3fe5-b9a8-4245-b499-082ed844273b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:34:41.323495 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1238/2502] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:34:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:34:41.652692 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e46e17c-e09c-425c-85bd-3a8ce5d84ab1 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:34:41.667139 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e46e17c-e09c-425c-85bd-3a8ce5d84ab1 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:34:41.673147 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0926a7ef-3500-4729-beff-d09e757aeea5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:34:41.673774 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0926a7ef-3500-4729-beff-d09e757aeea5 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:34:41.674229 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0926a7ef-3500-4729-beff-d09e757aeea5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:34:41.674940 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0926a7ef-3500-4729-beff-d09e757aeea5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:34:41.677070 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-0926a7ef-3500-4729-beff-d09e757aeea5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:34:41.762310 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0926a7ef-3500-4729-beff-d09e757aeea5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:34:41.764447 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0926a7ef-3500-4729-beff-d09e757aeea5 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:34:41.780244 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1265/2503] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:34:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:34:44.288695 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b3fe5-b9a8-4245-b499-082ed844273b None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:34:44.304478 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b3fe5-b9a8-4245-b499-082ed844273b None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:34:44.309143 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02efc869-3f43-4ee1-b49b-1ae2e99c8799 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:34:44.309779 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02efc869-3f43-4ee1-b49b-1ae2e99c8799 service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:34:44.310190 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02efc869-3f43-4ee1-b49b-1ae2e99c8799 service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:34:44.310542 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02efc869-3f43-4ee1-b49b-1ae2e99c8799 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:34:44.312414 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-02efc869-3f43-4ee1-b49b-1ae2e99c8799 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:34:44.326789 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02efc869-3f43-4ee1-b49b-1ae2e99c8799 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:34:44.328276 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02efc869-3f43-4ee1-b49b-1ae2e99c8799 service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:34:44.341548 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1239/2504] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:34:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:34:45.422369 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0926a7ef-3500-4729-beff-d09e757aeea5 service neutron] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:34:45.424269 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-0926a7ef-3500-4729-beff-d09e757aeea5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:34:45.451363 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0926a7ef-3500-4729-beff-d09e757aeea5 service neutron] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:34:45.461832 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5912f4f3-9930-42ca-a24e-c16664760669 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0865af59bf43dfa4c84213d7db53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:34:45.462556 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5912f4f3-9930-42ca-a24e-c16664760669 service nova] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:34:45.462891 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5912f4f3-9930-42ca-a24e-c16664760669 service nova] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:34:45.463172 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5912f4f3-9930-42ca-a24e-c16664760669 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:34:45.469182 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-5912f4f3-9930-42ca-a24e-c16664760669 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:34:45.481773 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5912f4f3-9930-42ca-a24e-c16664760669 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:34:45.483578 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5912f4f3-9930-42ca-a24e-c16664760669 service nova] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:34:45.494605 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1266/2505] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:34:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:34:54.336381 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=9 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:34:55.489406 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=65 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:35:04.667185 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02efc869-3f43-4ee1-b49b-1ae2e99c8799 service neutron] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:35:04.668705 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-02efc869-3f43-4ee1-b49b-1ae2e99c8799 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:35:04.683455 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02efc869-3f43-4ee1-b49b-1ae2e99c8799 service neutron] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:35:04.689038 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578931f3-691f-4723-8604-b1702f6983ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0865af59bf43dfa4c84213d7db53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:35:04.689656 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578931f3-691f-4723-8604-b1702f6983ec service nova] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:35:04.689940 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578931f3-691f-4723-8604-b1702f6983ec service nova] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:35:04.690215 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578931f3-691f-4723-8604-b1702f6983ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:35:04.693770 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-578931f3-691f-4723-8604-b1702f6983ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:35:04.756304 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578931f3-691f-4723-8604-b1702f6983ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:35:04.757931 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578931f3-691f-4723-8604-b1702f6983ec service nova] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:35:04.767131 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1240/2506] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:35:04 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:35:10.809099 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5912f4f3-9930-42ca-a24e-c16664760669 service nova] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:35:10.810772 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-5912f4f3-9930-42ca-a24e-c16664760669 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:35:10.823887 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5912f4f3-9930-42ca-a24e-c16664760669 service nova] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:35:10.828056 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc36c2f-d7c6-4381-a926-0b4f956ee3c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:35:10.828519 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc36c2f-d7c6-4381-a926-0b4f956ee3c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:35:10.828803 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc36c2f-d7c6-4381-a926-0b4f956ee3c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:35:10.829115 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc36c2f-d7c6-4381-a926-0b4f956ee3c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:35:10.830997 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-8dc36c2f-d7c6-4381-a926-0b4f956ee3c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:35:10.842459 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc36c2f-d7c6-4381-a926-0b4f956ee3c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:35:10.843947 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc36c2f-d7c6-4381-a926-0b4f956ee3c9 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:35:10.852316 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1267/2507] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:35:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:35:13.502532 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b8343-d41a-4639-bf5f-34e752a187ec None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:35:13.502532 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b8343-d41a-4639-bf5f-34e752a187ec None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:35:13.503103 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b8343-d41a-4639-bf5f-34e752a187ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:35:13.526956 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-672b8343-d41a-4639-bf5f-34e752a187ec None None] MFA Rules not processed for user `77c9a03620d04b2a9f80ec16f9738670`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:35:13.528645 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-672b8343-d41a-4639-bf5f-34e752a187ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:35:13.536411 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1241/2508] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:35:13 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:35:20.848568 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=6 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:35:21.042092 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc36c2f-d7c6-4381-a926-0b4f956ee3c9 service neutron] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:35:21.056653 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc36c2f-d7c6-4381-a926-0b4f956ee3c9 service neutron] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:35:21.064382 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a84c7de-efd8-4d2a-b5de-9f538504f4f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0865af59bf43dfa4c84213d7db53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:35:21.065028 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84c7de-efd8-4d2a-b5de-9f538504f4f2 service nova] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:35:21.065329 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84c7de-efd8-4d2a-b5de-9f538504f4f2 service nova] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:35:21.066241 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84c7de-efd8-4d2a-b5de-9f538504f4f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:35:21.068306 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-6a84c7de-efd8-4d2a-b5de-9f538504f4f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:35:21.084370 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a84c7de-efd8-4d2a-b5de-9f538504f4f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:35:21.086591 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a84c7de-efd8-4d2a-b5de-9f538504f4f2 service nova] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:35:21.110201 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1268/2509] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:35:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:35:21.183524 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b8343-d41a-4639-bf5f-34e752a187ec None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:35:21.210771 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b8343-d41a-4639-bf5f-34e752a187ec None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:35:21.220402 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84696a-d90f-4930-8ea8-c1942a7f73a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0865af59bf43dfa4c84213d7db53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:35:21.220402 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84696a-d90f-4930-8ea8-c1942a7f73a2 service nova] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:35:21.220402 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84696a-d90f-4930-8ea8-c1942a7f73a2 service nova] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:35:21.220912 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84696a-d90f-4930-8ea8-c1942a7f73a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:35:21.222560 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-3f84696a-d90f-4930-8ea8-c1942a7f73a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:35:21.237836 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f84696a-d90f-4930-8ea8-c1942a7f73a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:35:21.239576 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f84696a-d90f-4930-8ea8-c1942a7f73a2 service nova] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:35:21.252096 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1242/2510] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:35:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:35:31.101746 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=6 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:35:31.246700 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=37 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:35:32.576791 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a84c7de-efd8-4d2a-b5de-9f538504f4f2 service nova] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:35:32.586676 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a84c7de-efd8-4d2a-b5de-9f538504f4f2 service nova] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:35:32.590397 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e1a67-13ee-48c4-ab06-27b621108f65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:35:32.591283 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e1a67-13ee-48c4-ab06-27b621108f65 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:35:32.591564 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e1a67-13ee-48c4-ab06-27b621108f65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:35:32.591839 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e1a67-13ee-48c4-ab06-27b621108f65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:35:32.593596 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-0e6e1a67-13ee-48c4-ab06-27b621108f65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:35:32.603445 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6e1a67-13ee-48c4-ab06-27b621108f65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:35:32.604868 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6e1a67-13ee-48c4-ab06-27b621108f65 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:35:32.613609 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1269/2511] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:35:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:35:32.750535 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0019420-c67d-4357-841b-6170056f746b None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:35:32.751114 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0019420-c67d-4357-841b-6170056f746b None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:35:32.753589 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0019420-c67d-4357-841b-6170056f746b None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:35:32.755365 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1243/2512] 10.222.0.42 () {54 vars in 921 bytes} [Tue Aug 2 15:35:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:35:32.761671 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367702a-5771-407a-aa5a-37c4ecedf762 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:35:32.762209 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367702a-5771-407a-aa5a-37c4ecedf762 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:35:32.762347 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367702a-5771-407a-aa5a-37c4ecedf762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:35:32.784247 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-6367702a-5771-407a-aa5a-37c4ecedf762 None None] MFA Rules not processed for user `f6d1caa34f2b41bfbcc95fa58d85f004`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:35:32.785453 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-6367702a-5771-407a-aa5a-37c4ecedf762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:35:32.792494 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1270/2513] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Aug 2 15:35:32 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:35:32.807982 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0019420-c67d-4357-841b-6170056f746b None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:35:32.822018 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0019420-c67d-4357-841b-6170056f746b None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:35:32.827962 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf0689b-3813-4ed1-88f8-5f4e259a7cf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:35:32.828798 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0689b-3813-4ed1-88f8-5f4e259a7cf4 service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:35:32.829419 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0689b-3813-4ed1-88f8-5f4e259a7cf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:35:32.829742 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0689b-3813-4ed1-88f8-5f4e259a7cf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:35:32.838790 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf0689b-3813-4ed1-88f8-5f4e259a7cf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:35:32.840284 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf0689b-3813-4ed1-88f8-5f4e259a7cf4 service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:35:32.848809 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1244/2514] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:35:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:35:32.940561 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f89e95-03c1-47dd-bd3f-6800bf09c8f0 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:35:32.941249 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f89e95-03c1-47dd-bd3f-6800bf09c8f0 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:35:32.941560 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f89e95-03c1-47dd-bd3f-6800bf09c8f0 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:35:32.942937 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1271/2515] 10.222.0.42 () {54 vars in 921 bytes} [Tue Aug 2 15:35:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:35:32.948896 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296897a-8dbf-47a3-9024-09489901d841 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:35:32.949181 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296897a-8dbf-47a3-9024-09489901d841 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:35:32.949491 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296897a-8dbf-47a3-9024-09489901d841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:35:32.970210 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-5296897a-8dbf-47a3-9024-09489901d841 None None] MFA Rules not processed for user `4c0865af59bf43dfa4c84213d7db53c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:35:32.971344 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-5296897a-8dbf-47a3-9024-09489901d841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:35:32.980660 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1245/2516] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Aug 2 15:35:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:35:32.991813 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f89e95-03c1-47dd-bd3f-6800bf09c8f0 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:35:33.003648 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f89e95-03c1-47dd-bd3f-6800bf09c8f0 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:35:33.008209 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42780dc1-af26-4518-80a6-dee1d3acd93a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:35:33.008820 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42780dc1-af26-4518-80a6-dee1d3acd93a service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:35:33.009100 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42780dc1-af26-4518-80a6-dee1d3acd93a service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:35:33.009377 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42780dc1-af26-4518-80a6-dee1d3acd93a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:35:33.027511 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42780dc1-af26-4518-80a6-dee1d3acd93a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:35:33.028986 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42780dc1-af26-4518-80a6-dee1d3acd93a service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:35:33.040536 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1272/2517] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:35:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:35:33.107552 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5296897a-8dbf-47a3-9024-09489901d841 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:35:33.108931 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-5296897a-8dbf-47a3-9024-09489901d841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:35:33.177879 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5296897a-8dbf-47a3-9024-09489901d841 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:35:33.183735 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e274e3-b650-4183-b33c-e9c560151aa7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57dfafee636a45ca98fe0e8bb13dd754', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:35:33.184353 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e274e3-b650-4183-b33c-e9c560151aa7 service placement] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:35:33.184632 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e274e3-b650-4183-b33c-e9c560151aa7 service placement] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:35:33.184951 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e274e3-b650-4183-b33c-e9c560151aa7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:35:33.186923 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-28e274e3-b650-4183-b33c-e9c560151aa7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:35:33.198443 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e274e3-b650-4183-b33c-e9c560151aa7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:35:33.201629 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e274e3-b650-4183-b33c-e9c560151aa7 service placement] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:35:33.211568 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1246/2518] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:35:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:35:34.803387 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42780dc1-af26-4518-80a6-dee1d3acd93a service neutron] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:35:34.824097 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42780dc1-af26-4518-80a6-dee1d3acd93a service neutron] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:35:34.831710 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b09ef-d6b5-4f72-9dbb-6da22f69a0cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0865af59bf43dfa4c84213d7db53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:35:34.832362 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b09ef-d6b5-4f72-9dbb-6da22f69a0cc service nova] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:35:34.832785 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b09ef-d6b5-4f72-9dbb-6da22f69a0cc service nova] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:35:34.833073 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b09ef-d6b5-4f72-9dbb-6da22f69a0cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:35:34.835678 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-8f3b09ef-d6b5-4f72-9dbb-6da22f69a0cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:35:34.849948 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3b09ef-d6b5-4f72-9dbb-6da22f69a0cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:35:34.852434 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3b09ef-d6b5-4f72-9dbb-6da22f69a0cc service nova] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:35:34.863461 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1273/2519] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:35:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 15:35:43.207240 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=41 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:35:44.858902 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=21 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:35:45.887704 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e274e3-b650-4183-b33c-e9c560151aa7 service placement] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:35:45.889170 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-28e274e3-b650-4183-b33c-e9c560151aa7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:35:45.903570 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e274e3-b650-4183-b33c-e9c560151aa7 service placement] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:35:45.909178 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c119674-a130-4433-b32f-b22164ebc5ea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57dfafee636a45ca98fe0e8bb13dd754', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:35:45.909875 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c119674-a130-4433-b32f-b22164ebc5ea service placement] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:35:45.910219 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c119674-a130-4433-b32f-b22164ebc5ea service placement] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:35:45.910595 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c119674-a130-4433-b32f-b22164ebc5ea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:35:45.912641 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-3c119674-a130-4433-b32f-b22164ebc5ea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:35:45.925415 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c119674-a130-4433-b32f-b22164ebc5ea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:35:45.927312 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c119674-a130-4433-b32f-b22164ebc5ea service placement] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:35:45.938908 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1247/2520] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:35:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:35:45.956977 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b09ef-d6b5-4f72-9dbb-6da22f69a0cc service nova] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:35:45.958370 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-8f3b09ef-d6b5-4f72-9dbb-6da22f69a0cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:35:46.026848 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b09ef-d6b5-4f72-9dbb-6da22f69a0cc service nova] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:35:46.031402 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b0583-8f14-4106-ad64-6ffda5fc13f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:35:46.032047 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b0583-8f14-4106-ad64-6ffda5fc13f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:35:46.032328 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b0583-8f14-4106-ad64-6ffda5fc13f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:35:46.032599 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b0583-8f14-4106-ad64-6ffda5fc13f1 admin admin] PATH_INFO: `/v3/users/cddf51fd31994e189c433c1fb20cb229` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:35:46.033748 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247b0583-8f14-4106-ad64-6ffda5fc13f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cddf51fd31994e189c433c1fb20cb229)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:35:46.035728 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247b0583-8f14-4106-ad64-6ffda5fc13f1 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:35:46.085498 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-247b0583-8f14-4106-ad64-6ffda5fc13f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cddf51fd31994e189c433c1fb20cb229'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:35:46.100549 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-247b0583-8f14-4106-ad64-6ffda5fc13f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cddf51fd31994e189c433c1fb20cb229'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:35:46.101263 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-247b0583-8f14-4106-ad64-6ffda5fc13f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cddf51fd31994e189c433c1fb20cb229'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:35:46.108129 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-247b0583-8f14-4106-ad64-6ffda5fc13f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cddf51fd31994e189c433c1fb20cb229'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:35:46.117982 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-247b0583-8f14-4106-ad64-6ffda5fc13f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cddf51fd31994e189c433c1fb20cb229'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:35:46.125361 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1274/2521] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:35:45 2022] DELETE /identity/v3/users/cddf51fd31994e189c433c1fb20cb229 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:35:46.304909 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c119674-a130-4433-b32f-b22164ebc5ea service placement] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:35:46.316533 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c119674-a130-4433-b32f-b22164ebc5ea service placement] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:35:46.378042 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e47bbd-c482-412b-bc0b-ef029a5a3d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:35:46.378689 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e47bbd-c482-412b-bc0b-ef029a5a3d21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:35:46.378974 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e47bbd-c482-412b-bc0b-ef029a5a3d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:35:46.379275 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e47bbd-c482-412b-bc0b-ef029a5a3d21 admin admin] PATH_INFO: `/v3/projects/470ec768e7324780a3f2eded8431a93b` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:35:46.380459 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e47bbd-c482-412b-bc0b-ef029a5a3d21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=470ec768e7324780a3f2eded8431a93b)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:35:46.382359 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e47bbd-c482-412b-bc0b-ef029a5a3d21 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:35:46.428376 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-64e47bbd-c482-412b-bc0b-ef029a5a3d21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '470ec768e7324780a3f2eded8431a93b', 'request_id': 'req-64e47bbd-c482-412b-bc0b-ef029a5a3d21'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:35:46.435589 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-64e47bbd-c482-412b-bc0b-ef029a5a3d21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '470ec768e7324780a3f2eded8431a93b', 'request_id': 'req-64e47bbd-c482-412b-bc0b-ef029a5a3d21'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:35:46.441715 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-64e47bbd-c482-412b-bc0b-ef029a5a3d21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '470ec768e7324780a3f2eded8431a93b', 'request_id': 'req-64e47bbd-c482-412b-bc0b-ef029a5a3d21'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:35:46.451890 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-64e47bbd-c482-412b-bc0b-ef029a5a3d21 admin admin] The token cache is being invalidate because project 470ec768e7324780a3f2eded8431a93b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80360) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:35:46.452180 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-64e47bbd-c482-412b-bc0b-ef029a5a3d21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:35:46.452814 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-64e47bbd-c482-412b-bc0b-ef029a5a3d21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:35:46.454315 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1248/2522] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:35:46 2022] DELETE /identity/v3/projects/470ec768e7324780a3f2eded8431a93b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:35:56.121473 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=53,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:35:56.448947 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:36:04.074052 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ceb1a3-c3b1-4615-b0a4-37b1e871f98e None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:36:04.074549 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ceb1a3-c3b1-4615-b0a4-37b1e871f98e None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:36:04.074679 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ceb1a3-c3b1-4615-b0a4-37b1e871f98e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:36:04.103642 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-b6ceb1a3-c3b1-4615-b0a4-37b1e871f98e None None] MFA Rules not processed for user `cfb5e907ac594ba6a93d88d665c1d740`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:36:04.105204 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-b6ceb1a3-c3b1-4615-b0a4-37b1e871f98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:36:04.181538 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1275/2523] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:36:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:36:12.289320 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53712cff-71a1-4ff5-a430-5467cd56988a None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:36:12.290195 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53712cff-71a1-4ff5-a430-5467cd56988a None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:36:12.290649 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53712cff-71a1-4ff5-a430-5467cd56988a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:36:12.343381 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-53712cff-71a1-4ff5-a430-5467cd56988a None None] MFA Rules not processed for user `dfe8c00c0c3d4c4b8b6f36e39a3a2e71`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:36:12.358629 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-53712cff-71a1-4ff5-a430-5467cd56988a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:36:12.532851 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1249/2524] 10.222.0.42 () {58 vars in 967 bytes} [Tue Aug 2 15:36:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:36:12.612327 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ceb1a3-c3b1-4615-b0a4-37b1e871f98e None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:36:12.614091 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-b6ceb1a3-c3b1-4615-b0a4-37b1e871f98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:36:12.754145 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ceb1a3-c3b1-4615-b0a4-37b1e871f98e None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:36:12.762947 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a8caf7-50ec-479a-92c0-3e4be1c411a2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4de590df474c8b95f2b1193f7dbcb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:36:12.764416 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8caf7-50ec-479a-92c0-3e4be1c411a2 service swift] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:36:12.764770 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8caf7-50ec-479a-92c0-3e4be1c411a2 service swift] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:36:12.765058 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8caf7-50ec-479a-92c0-3e4be1c411a2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:36:12.776136 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a8caf7-50ec-479a-92c0-3e4be1c411a2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:36:12.778457 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a8caf7-50ec-479a-92c0-3e4be1c411a2 service swift] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:36:12.796975 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1276/2525] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Aug 2 15:36:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 15:36:16.359239 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8133e66-7d68-41c1-9a76-83957a2aceb7 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:36:16.359726 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8133e66-7d68-41c1-9a76-83957a2aceb7 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:36:16.359818 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8133e66-7d68-41c1-9a76-83957a2aceb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:36:16.380877 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-e8133e66-7d68-41c1-9a76-83957a2aceb7 None None] MFA Rules not processed for user `0f08ca03f3f44afcbbbe94fe0ac5baf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:36:16.382119 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-e8133e66-7d68-41c1-9a76-83957a2aceb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:36:16.439975 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1250/2526] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:36:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:36:17.519722 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a8caf7-50ec-479a-92c0-3e4be1c411a2 service swift] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:36:17.522790 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-f0a8caf7-50ec-479a-92c0-3e4be1c411a2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:36:17.618461 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:36:17.625578 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a8caf7-50ec-479a-92c0-3e4be1c411a2 service swift] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:36:17.632266 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d12d31e-0adf-40ee-8c00-687ca803543e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57dfafee636a45ca98fe0e8bb13dd754', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:36:17.633174 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12d31e-0adf-40ee-8c00-687ca803543e service placement] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:36:17.633419 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12d31e-0adf-40ee-8c00-687ca803543e service placement] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:36:17.633873 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12d31e-0adf-40ee-8c00-687ca803543e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:36:17.635913 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-9d12d31e-0adf-40ee-8c00-687ca803543e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:36:17.652942 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d12d31e-0adf-40ee-8c00-687ca803543e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:36:17.655128 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d12d31e-0adf-40ee-8c00-687ca803543e service placement] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:36:17.671045 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1277/2527] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:36:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 15:36:22.656332 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8133e66-7d68-41c1-9a76-83957a2aceb7 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:36:22.657874 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-e8133e66-7d68-41c1-9a76-83957a2aceb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:36:22.814256 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:36:22.817769 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8133e66-7d68-41c1-9a76-83957a2aceb7 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:36:22.823464 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f4d89-7a9a-4017-9d97-5aab35c558f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:36:22.824526 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f4d89-7a9a-4017-9d97-5aab35c558f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:36:22.825059 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f4d89-7a9a-4017-9d97-5aab35c558f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:36:22.825566 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f4d89-7a9a-4017-9d97-5aab35c558f1 admin admin] PATH_INFO: `/v3/users/e2349bd756334f1885d30cfce2730297` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:36:22.827278 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30f4d89-7a9a-4017-9d97-5aab35c558f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2349bd756334f1885d30cfce2730297)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:36:22.829946 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30f4d89-7a9a-4017-9d97-5aab35c558f1 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:36:22.885801 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-f30f4d89-7a9a-4017-9d97-5aab35c558f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2349bd756334f1885d30cfce2730297'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:36:22.892931 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-f30f4d89-7a9a-4017-9d97-5aab35c558f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2349bd756334f1885d30cfce2730297'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:36:22.906041 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-f30f4d89-7a9a-4017-9d97-5aab35c558f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2349bd756334f1885d30cfce2730297'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:36:22.906772 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-f30f4d89-7a9a-4017-9d97-5aab35c558f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2349bd756334f1885d30cfce2730297'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:36:22.907423 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-f30f4d89-7a9a-4017-9d97-5aab35c558f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2349bd756334f1885d30cfce2730297'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:36:22.923423 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1251/2528] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:36:22 2022] DELETE /identity/v3/users/e2349bd756334f1885d30cfce2730297 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:36:23.199375 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d12d31e-0adf-40ee-8c00-687ca803543e service placement] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:36:23.217689 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d12d31e-0adf-40ee-8c00-687ca803543e service placement] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:36:23.307425 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bcfb2e-4314-48c9-af5d-f23955406259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:36:23.308083 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bcfb2e-4314-48c9-af5d-f23955406259 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:36:23.308367 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bcfb2e-4314-48c9-af5d-f23955406259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:36:23.308645 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bcfb2e-4314-48c9-af5d-f23955406259 admin admin] PATH_INFO: `/v3/projects/462acab2efc94922bf7567575accbd37` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:36:23.309827 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bcfb2e-4314-48c9-af5d-f23955406259 admin admin] RBAC: Authorizing `identity:delete_project(project_id=462acab2efc94922bf7567575accbd37)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:36:23.311948 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bcfb2e-4314-48c9-af5d-f23955406259 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:36:23.366286 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-c1bcfb2e-4314-48c9-af5d-f23955406259 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '462acab2efc94922bf7567575accbd37', 'request_id': 'req-c1bcfb2e-4314-48c9-af5d-f23955406259'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:36:23.374092 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-c1bcfb2e-4314-48c9-af5d-f23955406259 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '462acab2efc94922bf7567575accbd37', 'request_id': 'req-c1bcfb2e-4314-48c9-af5d-f23955406259'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:36:23.380830 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-c1bcfb2e-4314-48c9-af5d-f23955406259 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '462acab2efc94922bf7567575accbd37', 'request_id': 'req-c1bcfb2e-4314-48c9-af5d-f23955406259'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:36:23.392252 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-c1bcfb2e-4314-48c9-af5d-f23955406259 admin admin] The token cache is being invalidate because project 462acab2efc94922bf7567575accbd37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:36:23.392542 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-c1bcfb2e-4314-48c9-af5d-f23955406259 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:36:23.393240 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-c1bcfb2e-4314-48c9-af5d-f23955406259 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:36:23.395251 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1278/2529] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:36:23 2022] DELETE /identity/v3/projects/462acab2efc94922bf7567575accbd37 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:36:23.401825 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f4d89-7a9a-4017-9d97-5aab35c558f1 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:36:23.403390 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-f30f4d89-7a9a-4017-9d97-5aab35c558f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:36:23.418249 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f4d89-7a9a-4017-9d97-5aab35c558f1 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:36:23.477813 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a414be-9a8e-41d5-9243-09448a5ceb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:36:23.478449 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a414be-9a8e-41d5-9243-09448a5ceb3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:36:23.478727 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a414be-9a8e-41d5-9243-09448a5ceb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:36:23.479002 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a414be-9a8e-41d5-9243-09448a5ceb3e admin admin] PATH_INFO: `/v3/users/7e1414016cc84137b1230264cd455ed2` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:36:23.480211 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a414be-9a8e-41d5-9243-09448a5ceb3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e1414016cc84137b1230264cd455ed2)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:36:23.482126 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a414be-9a8e-41d5-9243-09448a5ceb3e admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:36:23.527567 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-c3a414be-9a8e-41d5-9243-09448a5ceb3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e1414016cc84137b1230264cd455ed2'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:36:23.539928 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-c3a414be-9a8e-41d5-9243-09448a5ceb3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e1414016cc84137b1230264cd455ed2'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:36:23.555717 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-c3a414be-9a8e-41d5-9243-09448a5ceb3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e1414016cc84137b1230264cd455ed2'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:36:23.556446 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-c3a414be-9a8e-41d5-9243-09448a5ceb3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e1414016cc84137b1230264cd455ed2'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:36:23.557058 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-c3a414be-9a8e-41d5-9243-09448a5ceb3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e1414016cc84137b1230264cd455ed2'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:36:23.563810 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:36:23.579111 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1252/2530] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:36:23 2022] DELETE /identity/v3/users/7e1414016cc84137b1230264cd455ed2 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 15:36:23.820653 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bcfb2e-4314-48c9-af5d-f23955406259 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:36:23.822272 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-c1bcfb2e-4314-48c9-af5d-f23955406259 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:36:23.851776 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bcfb2e-4314-48c9-af5d-f23955406259 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:36:23.912868 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec37805-e678-4a87-80e0-999a2b03d161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:36:23.914098 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec37805-e678-4a87-80e0-999a2b03d161 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:36:23.914376 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec37805-e678-4a87-80e0-999a2b03d161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:36:23.914645 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec37805-e678-4a87-80e0-999a2b03d161 admin admin] PATH_INFO: `/v3/projects/628fb3abb2de40a68edae6a621da1f64` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:36:23.915832 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec37805-e678-4a87-80e0-999a2b03d161 admin admin] RBAC: Authorizing `identity:delete_project(project_id=628fb3abb2de40a68edae6a621da1f64)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:36:23.917749 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec37805-e678-4a87-80e0-999a2b03d161 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:36:23.942318 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:36:23.967111 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-7ec37805-e678-4a87-80e0-999a2b03d161 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '628fb3abb2de40a68edae6a621da1f64', 'request_id': 'req-7ec37805-e678-4a87-80e0-999a2b03d161'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:36:23.974701 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-7ec37805-e678-4a87-80e0-999a2b03d161 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '628fb3abb2de40a68edae6a621da1f64', 'request_id': 'req-7ec37805-e678-4a87-80e0-999a2b03d161'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:36:23.981849 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-7ec37805-e678-4a87-80e0-999a2b03d161 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '628fb3abb2de40a68edae6a621da1f64', 'request_id': 'req-7ec37805-e678-4a87-80e0-999a2b03d161'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:36:23.992383 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-7ec37805-e678-4a87-80e0-999a2b03d161 admin admin] The token cache is being invalidate because project 628fb3abb2de40a68edae6a621da1f64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:36:23.992677 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-7ec37805-e678-4a87-80e0-999a2b03d161 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:36:23.993327 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-7ec37805-e678-4a87-80e0-999a2b03d161 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:36:23.994861 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1279/2531] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:36:23 2022] DELETE /identity/v3/projects/628fb3abb2de40a68edae6a621da1f64 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:36:25.247453 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a414be-9a8e-41d5-9243-09448a5ceb3e admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:36:25.248951 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-c3a414be-9a8e-41d5-9243-09448a5ceb3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:36:25.337629 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a414be-9a8e-41d5-9243-09448a5ceb3e admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:36:25.388264 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a00255-6d68-4bf5-8945-cb17bd295850 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:36:25.388895 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a00255-6d68-4bf5-8945-cb17bd295850 service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:36:25.389210 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a00255-6d68-4bf5-8945-cb17bd295850 service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:36:25.389484 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a00255-6d68-4bf5-8945-cb17bd295850 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:36:25.391316 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-a4a00255-6d68-4bf5-8945-cb17bd295850 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:36:25.457772 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a00255-6d68-4bf5-8945-cb17bd295850 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:36:25.459286 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a00255-6d68-4bf5-8945-cb17bd295850 service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:36:25.469770 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1253/2532] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:36:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:36:29.203426 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec37805-e678-4a87-80e0-999a2b03d161 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:36:29.204923 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-7ec37805-e678-4a87-80e0-999a2b03d161 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:36:29.219490 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec37805-e678-4a87-80e0-999a2b03d161 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:36:29.224395 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd193b2-d9a5-4369-84dd-b28f26d3e57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:36:29.225092 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd193b2-d9a5-4369-84dd-b28f26d3e57b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:36:29.225927 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd193b2-d9a5-4369-84dd-b28f26d3e57b admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:36:29.226210 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd193b2-d9a5-4369-84dd-b28f26d3e57b admin admin] PATH_INFO: `/v3/users/77c9a03620d04b2a9f80ec16f9738670` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:36:29.227498 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd193b2-d9a5-4369-84dd-b28f26d3e57b admin admin] RBAC: Authorizing `identity:delete_user(user_id=77c9a03620d04b2a9f80ec16f9738670)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:36:29.229414 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd193b2-d9a5-4369-84dd-b28f26d3e57b admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:36:29.282069 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-9cd193b2-d9a5-4369-84dd-b28f26d3e57b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77c9a03620d04b2a9f80ec16f9738670'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:36:29.294434 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-9cd193b2-d9a5-4369-84dd-b28f26d3e57b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77c9a03620d04b2a9f80ec16f9738670'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:36:29.295118 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-9cd193b2-d9a5-4369-84dd-b28f26d3e57b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77c9a03620d04b2a9f80ec16f9738670'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:36:29.302173 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-9cd193b2-d9a5-4369-84dd-b28f26d3e57b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77c9a03620d04b2a9f80ec16f9738670'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:36:29.309843 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-9cd193b2-d9a5-4369-84dd-b28f26d3e57b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77c9a03620d04b2a9f80ec16f9738670'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:36:29.315801 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1280/2533] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:36:29 2022] DELETE /identity/v3/users/77c9a03620d04b2a9f80ec16f9738670 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:36:29.497126 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a00255-6d68-4bf5-8945-cb17bd295850 service neutron] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:36:29.507802 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a00255-6d68-4bf5-8945-cb17bd295850 service neutron] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:36:29.562527 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:36:29.581643 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec47a9d-9ff6-4706-a671-c728d2642b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:36:29.582302 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec47a9d-9ff6-4706-a671-c728d2642b54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:36:29.582583 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec47a9d-9ff6-4706-a671-c728d2642b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:36:29.582859 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec47a9d-9ff6-4706-a671-c728d2642b54 admin admin] PATH_INFO: `/v3/projects/e6e99b35c7ee43e0bcf1aa605b7e1456` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:36:29.584080 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec47a9d-9ff6-4706-a671-c728d2642b54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6e99b35c7ee43e0bcf1aa605b7e1456)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:36:29.586759 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec47a9d-9ff6-4706-a671-c728d2642b54 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:36:29.636468 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-0ec47a9d-9ff6-4706-a671-c728d2642b54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6e99b35c7ee43e0bcf1aa605b7e1456', 'request_id': 'req-0ec47a9d-9ff6-4706-a671-c728d2642b54'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:36:29.644175 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-0ec47a9d-9ff6-4706-a671-c728d2642b54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6e99b35c7ee43e0bcf1aa605b7e1456', 'request_id': 'req-0ec47a9d-9ff6-4706-a671-c728d2642b54'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:36:29.652815 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-0ec47a9d-9ff6-4706-a671-c728d2642b54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6e99b35c7ee43e0bcf1aa605b7e1456', 'request_id': 'req-0ec47a9d-9ff6-4706-a671-c728d2642b54'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:36:29.663690 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-0ec47a9d-9ff6-4706-a671-c728d2642b54 admin admin] The token cache is being invalidate because project e6e99b35c7ee43e0bcf1aa605b7e1456 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80360) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:36:29.663977 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-0ec47a9d-9ff6-4706-a671-c728d2642b54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:36:29.664627 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-0ec47a9d-9ff6-4706-a671-c728d2642b54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:36:29.666125 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1254/2534] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:36:29 2022] DELETE /identity/v3/projects/e6e99b35c7ee43e0bcf1aa605b7e1456 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:36:29.671186 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f0091-da6f-4e67-90e3-349ff7a8af03 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:36:29.671510 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f0091-da6f-4e67-90e3-349ff7a8af03 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:36:29.671927 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f0091-da6f-4e67-90e3-349ff7a8af03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:36:29.729573 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-f99f0091-da6f-4e67-90e3-349ff7a8af03 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:36:29.730780 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-f99f0091-da6f-4e67-90e3-349ff7a8af03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:36:29.777906 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:36:29.793574 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1281/2535] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:36:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:36:29.801564 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d243fa6e-31f1-4f12-8872-759b0fce926f None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:36:29.801874 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d243fa6e-31f1-4f12-8872-759b0fce926f None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:36:29.802152 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d243fa6e-31f1-4f12-8872-759b0fce926f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:36:29.823693 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-d243fa6e-31f1-4f12-8872-759b0fce926f None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:36:29.824913 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-d243fa6e-31f1-4f12-8872-759b0fce926f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:36:29.832994 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1255/2536] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:36:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:36:29.837555 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f0091-da6f-4e67-90e3-349ff7a8af03 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:36:29.847583 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f0091-da6f-4e67-90e3-349ff7a8af03 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:36:29.852393 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f50810-e501-4b8b-8020-1303468b1ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:36:29.852999 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f50810-e501-4b8b-8020-1303468b1ddf admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:36:29.853278 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f50810-e501-4b8b-8020-1303468b1ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:36:29.853551 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f50810-e501-4b8b-8020-1303468b1ddf admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:36:29.854240 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f50810-e501-4b8b-8020-1303468b1ddf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:36:29.854549 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f50810-e501-4b8b-8020-1303468b1ddf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:36:29.856168 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f50810-e501-4b8b-8020-1303468b1ddf admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:36:29.868657 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1282/2537] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 2 15:36:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:36:29.873061 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d243fa6e-31f1-4f12-8872-759b0fce926f None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:36:29.883089 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d243fa6e-31f1-4f12-8872-759b0fce926f None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:36:29.888132 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b988f1-2065-4f8a-a27d-829dd7b1a716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:36:29.888750 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b988f1-2065-4f8a-a27d-829dd7b1a716 admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:36:29.889031 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b988f1-2065-4f8a-a27d-829dd7b1a716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:36:29.889315 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b988f1-2065-4f8a-a27d-829dd7b1a716 admin admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:36:29.890010 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b988f1-2065-4f8a-a27d-829dd7b1a716 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:36:29.891998 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b988f1-2065-4f8a-a27d-829dd7b1a716 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:36:29.938925 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1256/2538] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:36:29 2022] POST /identity/v3/projects => generated 389 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:36:29.944981 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f50810-e501-4b8b-8020-1303468b1ddf admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:36:29.966678 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f50810-e501-4b8b-8020-1303468b1ddf admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:36:30.038333 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece60900-68f3-4d99-83a8-90ba4ce33655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:36:30.038866 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece60900-68f3-4d99-83a8-90ba4ce33655 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:36:30.039146 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece60900-68f3-4d99-83a8-90ba4ce33655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:36:30.039444 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece60900-68f3-4d99-83a8-90ba4ce33655 admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:36:30.040108 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece60900-68f3-4d99-83a8-90ba4ce33655 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:36:30.042025 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece60900-68f3-4d99-83a8-90ba4ce33655 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:36:30.065107 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1283/2539] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:36:29 2022] POST /identity/v3/users => generated 295 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:36:30.070127 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b988f1-2065-4f8a-a27d-829dd7b1a716 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:36:30.080519 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b988f1-2065-4f8a-a27d-829dd7b1a716 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:36:30.085208 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcdb143-665e-4952-9930-adcd1b73baa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:36:30.085878 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcdb143-665e-4952-9930-adcd1b73baa8 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:36:30.086163 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcdb143-665e-4952-9930-adcd1b73baa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:36:30.086437 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcdb143-665e-4952-9930-adcd1b73baa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:36:30.087151 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcdb143-665e-4952-9930-adcd1b73baa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:36:30.088786 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcdb143-665e-4952-9930-adcd1b73baa8 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:36:30.099247 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1257/2540] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:36:30.103668 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece60900-68f3-4d99-83a8-90ba4ce33655 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:36:30.113410 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece60900-68f3-4d99-83a8-90ba4ce33655 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:36:30.118885 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc90850-d75c-48d3-9b17-306666e675a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:36:30.119618 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc90850-d75c-48d3-9b17-306666e675a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:36:30.119957 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc90850-d75c-48d3-9b17-306666e675a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:36:30.120297 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc90850-d75c-48d3-9b17-306666e675a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:36:30.121070 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc90850-d75c-48d3-9b17-306666e675a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:36:30.122755 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc90850-d75c-48d3-9b17-306666e675a7 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:36:30.134137 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1284/2541] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:36:30.138517 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcdb143-665e-4952-9930-adcd1b73baa8 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:36:30.149621 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcdb143-665e-4952-9930-adcd1b73baa8 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:36:30.154590 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc833b1b-d379-4dab-a34a-33e9eee2f39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:36:30.155414 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc833b1b-d379-4dab-a34a-33e9eee2f39a admin admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:36:30.155777 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc833b1b-d379-4dab-a34a-33e9eee2f39a admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:36:30.156080 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc833b1b-d379-4dab-a34a-33e9eee2f39a admin admin] PATH_INFO: `/v3/projects/6c2ac5d6c05f475189cb3cf0596db094/users/5bad05743cdd47139c63fa1f1a8dca1c/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:36:30.174385 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc833b1b-d379-4dab-a34a-33e9eee2f39a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c2ac5d6c05f475189cb3cf0596db094, user_id=5bad05743cdd47139c63fa1f1a8dca1c, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:36:30.177391 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc833b1b-d379-4dab-a34a-33e9eee2f39a admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:36:30.195626 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1258/2542] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:36:30 2022] PUT /identity/v3/projects/6c2ac5d6c05f475189cb3cf0596db094/users/5bad05743cdd47139c63fa1f1a8dca1c/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:36:30.200819 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97db312-ac67-4cbb-b66c-0882185b31ca None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:36:30.201110 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97db312-ac67-4cbb-b66c-0882185b31ca None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:36:30.201384 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97db312-ac67-4cbb-b66c-0882185b31ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:36:30.221917 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-e97db312-ac67-4cbb-b66c-0882185b31ca None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:36:30.223128 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-e97db312-ac67-4cbb-b66c-0882185b31ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:36:30.292260 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1285/2543] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:36:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:36:30.304611 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc833b1b-d379-4dab-a34a-33e9eee2f39a admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:36:30.306481 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-cc833b1b-d379-4dab-a34a-33e9eee2f39a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:36:30.378429 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc833b1b-d379-4dab-a34a-33e9eee2f39a admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:36:30.382773 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d6ac24-ca60-44fc-90c2-1381d5bb7bcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:36:30.383432 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6ac24-ca60-44fc-90c2-1381d5bb7bcd service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:36:30.383720 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6ac24-ca60-44fc-90c2-1381d5bb7bcd service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:36:30.383997 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6ac24-ca60-44fc-90c2-1381d5bb7bcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:36:30.393567 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d6ac24-ca60-44fc-90c2-1381d5bb7bcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:36:30.395024 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d6ac24-ca60-44fc-90c2-1381d5bb7bcd service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:36:30.405263 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1259/2544] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:36:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:36:35.070759 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e8c47-e8df-4ed9-8d36-3d259ba4f072 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:36:35.071343 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e8c47-e8df-4ed9-8d36-3d259ba4f072 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:36:35.071343 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e8c47-e8df-4ed9-8d36-3d259ba4f072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:36:35.108757 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-777e8c47-e8df-4ed9-8d36-3d259ba4f072 None None] MFA Rules not processed for user `5bad05743cdd47139c63fa1f1a8dca1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:36:35.110368 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-777e8c47-e8df-4ed9-8d36-3d259ba4f072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:36:35.176082 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:36:35.198351 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1286/2545] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:36:35 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:36:35.213845 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d6ac24-ca60-44fc-90c2-1381d5bb7bcd service neutron] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:36:35.215077 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-a9d6ac24-ca60-44fc-90c2-1381d5bb7bcd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:36:35.220662 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:36:35.312725 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d6ac24-ca60-44fc-90c2-1381d5bb7bcd service neutron] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:36:35.319384 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c2c46-bf85-4058-9bcb-fc98e879010b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0865af59bf43dfa4c84213d7db53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:36:35.320097 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c2c46-bf85-4058-9bcb-fc98e879010b service nova] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:36:35.320450 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c2c46-bf85-4058-9bcb-fc98e879010b service nova] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:36:35.320800 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c2c46-bf85-4058-9bcb-fc98e879010b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:36:35.329959 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22c2c46-bf85-4058-9bcb-fc98e879010b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:36:35.331776 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22c2c46-bf85-4058-9bcb-fc98e879010b service nova] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:36:35.342733 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1260/2546] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:36:35 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:36:36.659713 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f940508-2fb2-4029-971e-a4897af7e391 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:36:36.660294 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f940508-2fb2-4029-971e-a4897af7e391 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:36:36.660557 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f940508-2fb2-4029-971e-a4897af7e391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:36:36.686444 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-3f940508-2fb2-4029-971e-a4897af7e391 None None] MFA Rules not processed for user `5bad05743cdd47139c63fa1f1a8dca1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:36:36.687972 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-3f940508-2fb2-4029-971e-a4897af7e391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:36:36.695128 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1287/2547] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:36:36 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:36:45.338651 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=33 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:36:46.681661 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=8 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:37:12.100873 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c2c46-bf85-4058-9bcb-fc98e879010b service nova] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:37:12.110398 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c2c46-bf85-4058-9bcb-fc98e879010b service nova] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:37:12.114188 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d7e68-c160-4555-8680-73289a3dad55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:37:12.114796 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d7e68-c160-4555-8680-73289a3dad55 service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:37:12.115080 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d7e68-c160-4555-8680-73289a3dad55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:37:12.115394 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d7e68-c160-4555-8680-73289a3dad55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:37:12.117381 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-3e8d7e68-c160-4555-8680-73289a3dad55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:37:12.315815 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8d7e68-c160-4555-8680-73289a3dad55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:37:12.317284 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8d7e68-c160-4555-8680-73289a3dad55 service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:37:12.327804 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1261/2548] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:37:12 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:37:18.165719 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f940508-2fb2-4029-971e-a4897af7e391 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:37:18.167411 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-3f940508-2fb2-4029-971e-a4897af7e391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:37:18.179985 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f940508-2fb2-4029-971e-a4897af7e391 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:37:18.183713 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f99d7-bb63-4c98-a313-7a9c1da3fb96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:37:18.184326 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f99d7-bb63-4c98-a313-7a9c1da3fb96 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:37:18.184609 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f99d7-bb63-4c98-a313-7a9c1da3fb96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:37:18.184884 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f99d7-bb63-4c98-a313-7a9c1da3fb96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:37:18.186635 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-282f99d7-bb63-4c98-a313-7a9c1da3fb96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:37:18.198350 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282f99d7-bb63-4c98-a313-7a9c1da3fb96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:37:18.199784 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282f99d7-bb63-4c98-a313-7a9c1da3fb96 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:37:18.209727 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1288/2549] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:37:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:37:22.323799 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=28 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:37:24.620610 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d7e68-c160-4555-8680-73289a3dad55 service neutron] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:37:24.622598 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-3e8d7e68-c160-4555-8680-73289a3dad55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:37:24.637721 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d7e68-c160-4555-8680-73289a3dad55 service neutron] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:37:24.642161 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce13a47-d9c7-4c1c-9ef7-778f97e9ee6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:37:24.642795 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce13a47-d9c7-4c1c-9ef7-778f97e9ee6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:37:24.643069 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce13a47-d9c7-4c1c-9ef7-778f97e9ee6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:37:24.643406 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce13a47-d9c7-4c1c-9ef7-778f97e9ee6a admin admin] PATH_INFO: `/v3/users/2802f9cc5f2044abafe63cb8c2d51864` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:37:24.644573 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce13a47-d9c7-4c1c-9ef7-778f97e9ee6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2802f9cc5f2044abafe63cb8c2d51864)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:37:24.647150 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce13a47-d9c7-4c1c-9ef7-778f97e9ee6a admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:37:24.700175 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-3ce13a47-d9c7-4c1c-9ef7-778f97e9ee6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2802f9cc5f2044abafe63cb8c2d51864'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:37:24.707496 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-3ce13a47-d9c7-4c1c-9ef7-778f97e9ee6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2802f9cc5f2044abafe63cb8c2d51864'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:37:24.720191 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-3ce13a47-d9c7-4c1c-9ef7-778f97e9ee6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2802f9cc5f2044abafe63cb8c2d51864'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:37:24.720909 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-3ce13a47-d9c7-4c1c-9ef7-778f97e9ee6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2802f9cc5f2044abafe63cb8c2d51864'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:37:24.721506 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-3ce13a47-d9c7-4c1c-9ef7-778f97e9ee6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2802f9cc5f2044abafe63cb8c2d51864'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:37:24.741312 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1262/2550] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:37:24 2022] DELETE /identity/v3/users/2802f9cc5f2044abafe63cb8c2d51864 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:37:24.957400 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f99d7-bb63-4c98-a313-7a9c1da3fb96 service neutron] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:37:24.967438 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f99d7-bb63-4c98-a313-7a9c1da3fb96 service neutron] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:37:25.024553 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d2baa-d8dc-4ff5-8547-9506ee7b79f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:37:25.025196 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d2baa-d8dc-4ff5-8547-9506ee7b79f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:37:25.025481 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d2baa-d8dc-4ff5-8547-9506ee7b79f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:37:25.025763 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d2baa-d8dc-4ff5-8547-9506ee7b79f7 admin admin] PATH_INFO: `/v3/projects/b06d32be08fc44ee99bdcd97d7bcc580` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:37:25.026916 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0d2baa-d8dc-4ff5-8547-9506ee7b79f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b06d32be08fc44ee99bdcd97d7bcc580)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:37:25.028867 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0d2baa-d8dc-4ff5-8547-9506ee7b79f7 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:37:25.076902 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-2c0d2baa-d8dc-4ff5-8547-9506ee7b79f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b06d32be08fc44ee99bdcd97d7bcc580', 'request_id': 'req-2c0d2baa-d8dc-4ff5-8547-9506ee7b79f7'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:37:25.084307 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-2c0d2baa-d8dc-4ff5-8547-9506ee7b79f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b06d32be08fc44ee99bdcd97d7bcc580', 'request_id': 'req-2c0d2baa-d8dc-4ff5-8547-9506ee7b79f7'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:37:25.090463 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-2c0d2baa-d8dc-4ff5-8547-9506ee7b79f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b06d32be08fc44ee99bdcd97d7bcc580', 'request_id': 'req-2c0d2baa-d8dc-4ff5-8547-9506ee7b79f7'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:37:25.101009 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-2c0d2baa-d8dc-4ff5-8547-9506ee7b79f7 admin admin] The token cache is being invalidate because project b06d32be08fc44ee99bdcd97d7bcc580 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:37:25.101290 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-2c0d2baa-d8dc-4ff5-8547-9506ee7b79f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:37:25.101914 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-2c0d2baa-d8dc-4ff5-8547-9506ee7b79f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:37:25.103429 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1289/2551] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:37:24 2022] DELETE /identity/v3/projects/b06d32be08fc44ee99bdcd97d7bcc580 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:37:25.107345 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce13a47-d9c7-4c1c-9ef7-778f97e9ee6a admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:37:25.108745 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-3ce13a47-d9c7-4c1c-9ef7-778f97e9ee6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:37:25.121423 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce13a47-d9c7-4c1c-9ef7-778f97e9ee6a admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:37:25.178377 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b17a292-2b6b-4f99-ad8a-b7a06982e5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:37:25.179019 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17a292-2b6b-4f99-ad8a-b7a06982e5f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:37:25.179335 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17a292-2b6b-4f99-ad8a-b7a06982e5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:37:25.179610 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17a292-2b6b-4f99-ad8a-b7a06982e5f7 admin admin] PATH_INFO: `/v3/users/a8c65c0885f04b2fa70386345e17b1b1` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:37:25.180768 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b17a292-2b6b-4f99-ad8a-b7a06982e5f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8c65c0885f04b2fa70386345e17b1b1)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:37:25.182727 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b17a292-2b6b-4f99-ad8a-b7a06982e5f7 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:37:25.233312 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-4b17a292-2b6b-4f99-ad8a-b7a06982e5f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8c65c0885f04b2fa70386345e17b1b1'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:37:25.241273 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-4b17a292-2b6b-4f99-ad8a-b7a06982e5f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8c65c0885f04b2fa70386345e17b1b1'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:37:25.253002 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-4b17a292-2b6b-4f99-ad8a-b7a06982e5f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8c65c0885f04b2fa70386345e17b1b1'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:37:25.253712 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-4b17a292-2b6b-4f99-ad8a-b7a06982e5f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8c65c0885f04b2fa70386345e17b1b1'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:37:25.254324 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-4b17a292-2b6b-4f99-ad8a-b7a06982e5f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8c65c0885f04b2fa70386345e17b1b1'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:37:25.256513 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:37:25.268419 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1263/2552] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:37:25 2022] DELETE /identity/v3/users/a8c65c0885f04b2fa70386345e17b1b1 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:37:25.444706 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d2baa-d8dc-4ff5-8547-9506ee7b79f7 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:37:25.446278 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-2c0d2baa-d8dc-4ff5-8547-9506ee7b79f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:37:25.460841 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d2baa-d8dc-4ff5-8547-9506ee7b79f7 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:37:25.520414 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2795b6df-924d-41c8-b345-6e98d2d915c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:37:25.521057 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2795b6df-924d-41c8-b345-6e98d2d915c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:37:25.521364 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2795b6df-924d-41c8-b345-6e98d2d915c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:37:25.521643 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2795b6df-924d-41c8-b345-6e98d2d915c1 admin admin] PATH_INFO: `/v3/projects/9eef49c2f20d417a8b4733d1fc31162f` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:37:25.522801 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2795b6df-924d-41c8-b345-6e98d2d915c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9eef49c2f20d417a8b4733d1fc31162f)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:37:25.524761 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2795b6df-924d-41c8-b345-6e98d2d915c1 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:37:25.546418 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:37:25.574234 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-2795b6df-924d-41c8-b345-6e98d2d915c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9eef49c2f20d417a8b4733d1fc31162f', 'request_id': 'req-2795b6df-924d-41c8-b345-6e98d2d915c1'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:37:25.582627 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-2795b6df-924d-41c8-b345-6e98d2d915c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9eef49c2f20d417a8b4733d1fc31162f', 'request_id': 'req-2795b6df-924d-41c8-b345-6e98d2d915c1'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:37:25.589925 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-2795b6df-924d-41c8-b345-6e98d2d915c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9eef49c2f20d417a8b4733d1fc31162f', 'request_id': 'req-2795b6df-924d-41c8-b345-6e98d2d915c1'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:37:25.600680 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-2795b6df-924d-41c8-b345-6e98d2d915c1 admin admin] The token cache is being invalidate because project 9eef49c2f20d417a8b4733d1fc31162f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:37:25.600968 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-2795b6df-924d-41c8-b345-6e98d2d915c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:37:25.601604 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-2795b6df-924d-41c8-b345-6e98d2d915c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:37:25.603196 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1290/2553] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:37:25 2022] DELETE /identity/v3/projects/9eef49c2f20d417a8b4733d1fc31162f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:37:31.353242 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b17a292-2b6b-4f99-ad8a-b7a06982e5f7 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:37:31.354657 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-4b17a292-2b6b-4f99-ad8a-b7a06982e5f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:37:31.410294 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b17a292-2b6b-4f99-ad8a-b7a06982e5f7 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:37:31.456933 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c690f35-8c91-4c1a-935f-8dd78cb50a09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:37:31.457541 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c690f35-8c91-4c1a-935f-8dd78cb50a09 service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:37:31.457818 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c690f35-8c91-4c1a-935f-8dd78cb50a09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:37:31.458090 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c690f35-8c91-4c1a-935f-8dd78cb50a09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:37:31.459853 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-7c690f35-8c91-4c1a-935f-8dd78cb50a09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:37:31.519661 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c690f35-8c91-4c1a-935f-8dd78cb50a09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:37:31.521102 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c690f35-8c91-4c1a-935f-8dd78cb50a09 service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:37:31.530678 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1264/2554] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:37:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:37:34.664754 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2795b6df-924d-41c8-b345-6e98d2d915c1 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:37:34.666346 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-2795b6df-924d-41c8-b345-6e98d2d915c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:37:34.680221 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2795b6df-924d-41c8-b345-6e98d2d915c1 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:37:34.685272 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df62e4-a593-4c19-9419-5ae202cfd4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:37:34.685946 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df62e4-a593-4c19-9419-5ae202cfd4f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:37:34.686292 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df62e4-a593-4c19-9419-5ae202cfd4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:37:34.686630 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df62e4-a593-4c19-9419-5ae202cfd4f2 admin admin] PATH_INFO: `/v3/users/0f08ca03f3f44afcbbbe94fe0ac5baf7` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:37:34.687918 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2df62e4-a593-4c19-9419-5ae202cfd4f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f08ca03f3f44afcbbbe94fe0ac5baf7)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:37:34.689845 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2df62e4-a593-4c19-9419-5ae202cfd4f2 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:37:34.742078 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-d2df62e4-a593-4c19-9419-5ae202cfd4f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f08ca03f3f44afcbbbe94fe0ac5baf7'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:37:34.755859 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-d2df62e4-a593-4c19-9419-5ae202cfd4f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f08ca03f3f44afcbbbe94fe0ac5baf7'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:37:34.756650 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-d2df62e4-a593-4c19-9419-5ae202cfd4f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f08ca03f3f44afcbbbe94fe0ac5baf7'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:37:34.763658 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-d2df62e4-a593-4c19-9419-5ae202cfd4f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f08ca03f3f44afcbbbe94fe0ac5baf7'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:37:34.772849 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-d2df62e4-a593-4c19-9419-5ae202cfd4f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f08ca03f3f44afcbbbe94fe0ac5baf7'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:37:34.780006 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1291/2555] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:37:34 2022] DELETE /identity/v3/users/0f08ca03f3f44afcbbbe94fe0ac5baf7 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:37:34.954740 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c690f35-8c91-4c1a-935f-8dd78cb50a09 service neutron] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:37:34.966939 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c690f35-8c91-4c1a-935f-8dd78cb50a09 service neutron] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:37:35.026619 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:37:35.034226 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58507f-9450-468f-a0b6-e788a841b0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:37:35.035234 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58507f-9450-468f-a0b6-e788a841b0f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:37:35.036000 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58507f-9450-468f-a0b6-e788a841b0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:37:35.036441 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58507f-9450-468f-a0b6-e788a841b0f8 admin admin] PATH_INFO: `/v3/projects/2e7db419a01747d4945dbe362adfcb65` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:37:35.037744 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec58507f-9450-468f-a0b6-e788a841b0f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e7db419a01747d4945dbe362adfcb65)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:37:35.039977 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec58507f-9450-468f-a0b6-e788a841b0f8 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:37:35.087938 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-ec58507f-9450-468f-a0b6-e788a841b0f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e7db419a01747d4945dbe362adfcb65', 'request_id': 'req-ec58507f-9450-468f-a0b6-e788a841b0f8'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:37:35.095003 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-ec58507f-9450-468f-a0b6-e788a841b0f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e7db419a01747d4945dbe362adfcb65', 'request_id': 'req-ec58507f-9450-468f-a0b6-e788a841b0f8'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:37:35.101415 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-ec58507f-9450-468f-a0b6-e788a841b0f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e7db419a01747d4945dbe362adfcb65', 'request_id': 'req-ec58507f-9450-468f-a0b6-e788a841b0f8'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:37:35.111711 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-ec58507f-9450-468f-a0b6-e788a841b0f8 admin admin] The token cache is being invalidate because project 2e7db419a01747d4945dbe362adfcb65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80360) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:37:35.112005 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-ec58507f-9450-468f-a0b6-e788a841b0f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:37:35.112656 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-ec58507f-9450-468f-a0b6-e788a841b0f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:37:35.114144 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1265/2556] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:37:34 2022] DELETE /identity/v3/projects/2e7db419a01747d4945dbe362adfcb65 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:37:35.119152 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff5d4b-8455-415e-8635-73dfa433dd55 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:37:35.119546 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff5d4b-8455-415e-8635-73dfa433dd55 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:37:35.119831 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff5d4b-8455-415e-8635-73dfa433dd55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:37:35.139543 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-98ff5d4b-8455-415e-8635-73dfa433dd55 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:37:35.140688 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-98ff5d4b-8455-415e-8635-73dfa433dd55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:37:35.201664 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1292/2557] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:37:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:37:35.210137 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27182b-7783-4afd-97bc-63a7bce14200 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:37:35.210426 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27182b-7783-4afd-97bc-63a7bce14200 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:37:35.210706 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27182b-7783-4afd-97bc-63a7bce14200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:37:35.229970 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-ed27182b-7783-4afd-97bc-63a7bce14200 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:37:35.231180 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-ed27182b-7783-4afd-97bc-63a7bce14200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:37:35.239357 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1266/2558] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:37:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:37:35.243455 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff5d4b-8455-415e-8635-73dfa433dd55 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:37:35.253103 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff5d4b-8455-415e-8635-73dfa433dd55 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:37:35.258241 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ad615-ae25-4127-96b0-76b5a6b17f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:37:35.258838 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ad615-ae25-4127-96b0-76b5a6b17f9b admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:37:35.259121 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ad615-ae25-4127-96b0-76b5a6b17f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:37:35.259420 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ad615-ae25-4127-96b0-76b5a6b17f9b admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:37:35.260099 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433ad615-ae25-4127-96b0-76b5a6b17f9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:37:35.260400 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433ad615-ae25-4127-96b0-76b5a6b17f9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:37:35.261980 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433ad615-ae25-4127-96b0-76b5a6b17f9b admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:37:35.273785 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1293/2559] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 2 15:37:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:37:35.277948 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed27182b-7783-4afd-97bc-63a7bce14200 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:37:35.286948 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed27182b-7783-4afd-97bc-63a7bce14200 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:37:35.291561 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84ded32-2f96-4f6f-8106-f4b61dcf8387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:37:35.292160 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ded32-2f96-4f6f-8106-f4b61dcf8387 admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:37:35.292447 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ded32-2f96-4f6f-8106-f4b61dcf8387 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:37:35.292724 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ded32-2f96-4f6f-8106-f4b61dcf8387 admin admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:37:35.293380 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84ded32-2f96-4f6f-8106-f4b61dcf8387 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:37:35.295278 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84ded32-2f96-4f6f-8106-f4b61dcf8387 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:37:35.323789 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1267/2560] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:37:35 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:37:35.327581 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ad615-ae25-4127-96b0-76b5a6b17f9b admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:37:35.337896 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ad615-ae25-4127-96b0-76b5a6b17f9b admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:37:35.341986 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:37:35.396879 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd3878-ecbb-47a7-95c3-2c01182cd736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:37:35.397404 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd3878-ecbb-47a7-95c3-2c01182cd736 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:37:35.397686 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd3878-ecbb-47a7-95c3-2c01182cd736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:37:35.397959 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd3878-ecbb-47a7-95c3-2c01182cd736 admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:37:35.398648 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bd3878-ecbb-47a7-95c3-2c01182cd736 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:37:35.400589 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bd3878-ecbb-47a7-95c3-2c01182cd736 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:37:35.421864 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1294/2561] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:37:35 2022] POST /identity/v3/users => generated 283 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:37:35.426263 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84ded32-2f96-4f6f-8106-f4b61dcf8387 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:37:35.437608 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84ded32-2f96-4f6f-8106-f4b61dcf8387 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:37:35.442801 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e37f648-4e38-462c-9f91-fe3891091744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:37:35.444114 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37f648-4e38-462c-9f91-fe3891091744 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:37:35.444499 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37f648-4e38-462c-9f91-fe3891091744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:37:35.444830 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37f648-4e38-462c-9f91-fe3891091744 admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:37:35.445518 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e37f648-4e38-462c-9f91-fe3891091744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:37:35.447090 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e37f648-4e38-462c-9f91-fe3891091744 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:37:35.457129 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1268/2562] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:37:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 15:37:35.461095 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd3878-ecbb-47a7-95c3-2c01182cd736 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:37:35.470833 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd3878-ecbb-47a7-95c3-2c01182cd736 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:37:35.475434 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925f3cd8-beab-4c75-b163-1383c7553493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:37:35.476028 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f3cd8-beab-4c75-b163-1383c7553493 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:37:35.476310 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f3cd8-beab-4c75-b163-1383c7553493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:37:35.476583 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f3cd8-beab-4c75-b163-1383c7553493 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:37:35.477261 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925f3cd8-beab-4c75-b163-1383c7553493 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:37:35.478838 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925f3cd8-beab-4c75-b163-1383c7553493 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:37:35.489163 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1295/2563] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:37:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:37:35.493769 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e37f648-4e38-462c-9f91-fe3891091744 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:37:35.503636 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e37f648-4e38-462c-9f91-fe3891091744 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:37:35.509033 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec378ce6-1187-4f04-8521-4d877678e06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:37:35.509679 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec378ce6-1187-4f04-8521-4d877678e06b admin admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:37:35.509957 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec378ce6-1187-4f04-8521-4d877678e06b admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:37:35.510228 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec378ce6-1187-4f04-8521-4d877678e06b admin admin] PATH_INFO: `/v3/projects/e2344e65f9534cc5bc47f5df6fd73a07/users/d2b4a2f91abe4dd5a90b875626c847d8/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:37:35.524574 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec378ce6-1187-4f04-8521-4d877678e06b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2344e65f9534cc5bc47f5df6fd73a07, user_id=d2b4a2f91abe4dd5a90b875626c847d8, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:37:35.527182 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec378ce6-1187-4f04-8521-4d877678e06b admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:37:35.541385 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1269/2564] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:37:35 2022] PUT /identity/v3/projects/e2344e65f9534cc5bc47f5df6fd73a07/users/d2b4a2f91abe4dd5a90b875626c847d8/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:37:35.553415 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119e388-6d7c-425a-84fd-ae61c05d8acd None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:37:35.553714 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119e388-6d7c-425a-84fd-ae61c05d8acd None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:37:35.553985 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119e388-6d7c-425a-84fd-ae61c05d8acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:37:35.582649 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-2119e388-6d7c-425a-84fd-ae61c05d8acd None None] MFA Rules not processed for user `d2b4a2f91abe4dd5a90b875626c847d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:37:35.584397 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-2119e388-6d7c-425a-84fd-ae61c05d8acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:37:35.649934 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1296/2565] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:37:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:37:35.660823 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec378ce6-1187-4f04-8521-4d877678e06b admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:37:35.663048 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-ec378ce6-1187-4f04-8521-4d877678e06b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:37:35.740234 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec378ce6-1187-4f04-8521-4d877678e06b admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:37:35.745054 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce50a3-68a0-4f57-a43b-9c57ca930132 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:37:35.745862 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce50a3-68a0-4f57-a43b-9c57ca930132 service cinder] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:37:35.746148 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce50a3-68a0-4f57-a43b-9c57ca930132 service cinder] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:37:35.746429 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce50a3-68a0-4f57-a43b-9c57ca930132 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:37:35.756611 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ce50a3-68a0-4f57-a43b-9c57ca930132 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:37:35.758052 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ce50a3-68a0-4f57-a43b-9c57ca930132 service cinder] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:37:35.767292 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1270/2566] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:37:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:37:44.091765 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2119e388-6d7c-425a-84fd-ae61c05d8acd None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:37:44.162950 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2119e388-6d7c-425a-84fd-ae61c05d8acd None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:37:44.167721 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d8248-4fe4-47ef-add7-1fd3cea2fcf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:37:44.168373 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d8248-4fe4-47ef-add7-1fd3cea2fcf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:37:44.168653 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d8248-4fe4-47ef-add7-1fd3cea2fcf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:37:44.168929 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d8248-4fe4-47ef-add7-1fd3cea2fcf3 admin admin] PATH_INFO: `/v3/users/d2b4a2f91abe4dd5a90b875626c847d8` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:37:44.170125 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26d8248-4fe4-47ef-add7-1fd3cea2fcf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2b4a2f91abe4dd5a90b875626c847d8)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:37:44.172091 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26d8248-4fe4-47ef-add7-1fd3cea2fcf3 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:37:44.192345 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:37:44.230451 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-f26d8248-4fe4-47ef-add7-1fd3cea2fcf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2b4a2f91abe4dd5a90b875626c847d8'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:37:44.242579 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-f26d8248-4fe4-47ef-add7-1fd3cea2fcf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2b4a2f91abe4dd5a90b875626c847d8'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:37:44.243264 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-f26d8248-4fe4-47ef-add7-1fd3cea2fcf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2b4a2f91abe4dd5a90b875626c847d8'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:37:44.251175 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-f26d8248-4fe4-47ef-add7-1fd3cea2fcf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2b4a2f91abe4dd5a90b875626c847d8'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:37:44.259103 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-f26d8248-4fe4-47ef-add7-1fd3cea2fcf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2b4a2f91abe4dd5a90b875626c847d8'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:37:44.264920 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1297/2567] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:37:44 2022] DELETE /identity/v3/users/d2b4a2f91abe4dd5a90b875626c847d8 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:37:44.269361 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6b0a7-f1fd-44fa-aded-1528c4498d0c None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:37:44.269871 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6b0a7-f1fd-44fa-aded-1528c4498d0c None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:37:44.270000 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6b0a7-f1fd-44fa-aded-1528c4498d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:37:44.283636 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:37:44.290943 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-4da6b0a7-f1fd-44fa-aded-1528c4498d0c None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:37:44.292835 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-4da6b0a7-f1fd-44fa-aded-1528c4498d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:37:44.352644 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1271/2568] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:37:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:37:44.362648 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d8248-4fe4-47ef-add7-1fd3cea2fcf3 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:37:44.364130 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-f26d8248-4fe4-47ef-add7-1fd3cea2fcf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:37:44.422307 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d8248-4fe4-47ef-add7-1fd3cea2fcf3 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:37:44.426252 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e5e062-fbf0-4e92-918c-b46ff502781e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:37:44.426859 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5e062-fbf0-4e92-918c-b46ff502781e service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:37:44.427143 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5e062-fbf0-4e92-918c-b46ff502781e service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:37:44.427452 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5e062-fbf0-4e92-918c-b46ff502781e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:37:44.436440 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e5e062-fbf0-4e92-918c-b46ff502781e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:37:44.437879 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e5e062-fbf0-4e92-918c-b46ff502781e service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:37:44.447342 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1298/2569] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:37:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:37:44.720230 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da6b0a7-f1fd-44fa-aded-1528c4498d0c None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:37:44.721648 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-4da6b0a7-f1fd-44fa-aded-1528c4498d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:37:44.737526 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da6b0a7-f1fd-44fa-aded-1528c4498d0c None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:37:44.742892 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb94ec0-828b-4f07-b385-2139f70ebb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:37:44.743656 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb94ec0-828b-4f07-b385-2139f70ebb96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:37:44.743877 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb94ec0-828b-4f07-b385-2139f70ebb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:37:44.744156 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb94ec0-828b-4f07-b385-2139f70ebb96 admin admin] PATH_INFO: `/v3/projects/e2344e65f9534cc5bc47f5df6fd73a07` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:37:44.745560 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb94ec0-828b-4f07-b385-2139f70ebb96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2344e65f9534cc5bc47f5df6fd73a07)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:37:44.747950 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb94ec0-828b-4f07-b385-2139f70ebb96 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:37:44.798929 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-8fb94ec0-828b-4f07-b385-2139f70ebb96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2344e65f9534cc5bc47f5df6fd73a07', 'request_id': 'req-8fb94ec0-828b-4f07-b385-2139f70ebb96'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:37:44.807230 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-8fb94ec0-828b-4f07-b385-2139f70ebb96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2344e65f9534cc5bc47f5df6fd73a07', 'request_id': 'req-8fb94ec0-828b-4f07-b385-2139f70ebb96'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:37:44.813495 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-8fb94ec0-828b-4f07-b385-2139f70ebb96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2344e65f9534cc5bc47f5df6fd73a07', 'request_id': 'req-8fb94ec0-828b-4f07-b385-2139f70ebb96'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:37:44.824402 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-8fb94ec0-828b-4f07-b385-2139f70ebb96 admin admin] The token cache is being invalidate because project e2344e65f9534cc5bc47f5df6fd73a07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80360) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:37:44.824684 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-8fb94ec0-828b-4f07-b385-2139f70ebb96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:37:44.825301 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-8fb94ec0-828b-4f07-b385-2139f70ebb96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:37:44.826771 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1272/2570] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:37:44 2022] DELETE /identity/v3/projects/e2344e65f9534cc5bc47f5df6fd73a07 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:37:44.831836 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82591388-9252-4775-acde-b8d7a2f5fb38 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:37:44.832072 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82591388-9252-4775-acde-b8d7a2f5fb38 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:37:44.832351 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82591388-9252-4775-acde-b8d7a2f5fb38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:37:44.851860 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-82591388-9252-4775-acde-b8d7a2f5fb38 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:37:44.853074 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-82591388-9252-4775-acde-b8d7a2f5fb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:37:44.913734 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1299/2571] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:37:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:37:44.921606 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b390f04-741e-416a-8eee-10775a1f8484 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:37:44.921921 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b390f04-741e-416a-8eee-10775a1f8484 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:37:44.922197 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b390f04-741e-416a-8eee-10775a1f8484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:37:44.942926 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-5b390f04-741e-416a-8eee-10775a1f8484 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:37:44.944673 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-5b390f04-741e-416a-8eee-10775a1f8484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:37:44.953065 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1273/2572] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:37:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:37:44.957289 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82591388-9252-4775-acde-b8d7a2f5fb38 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:37:44.966921 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82591388-9252-4775-acde-b8d7a2f5fb38 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:37:44.971522 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc60fac3-8684-4392-af3c-35434f217a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:37:44.972127 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc60fac3-8684-4392-af3c-35434f217a83 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:37:44.972411 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc60fac3-8684-4392-af3c-35434f217a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:37:44.972690 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc60fac3-8684-4392-af3c-35434f217a83 admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:37:44.973387 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc60fac3-8684-4392-af3c-35434f217a83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:37:44.973721 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc60fac3-8684-4392-af3c-35434f217a83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:37:44.975841 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc60fac3-8684-4392-af3c-35434f217a83 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:37:44.987233 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1300/2573] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 2 15:37:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:37:44.991955 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b390f04-741e-416a-8eee-10775a1f8484 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:37:45.001039 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b390f04-741e-416a-8eee-10775a1f8484 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:37:45.005672 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7deeeb-c159-4a34-b61c-a0ef68fe02ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:37:45.006774 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7deeeb-c159-4a34-b61c-a0ef68fe02ac admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:37:45.007056 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7deeeb-c159-4a34-b61c-a0ef68fe02ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:37:45.007439 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7deeeb-c159-4a34-b61c-a0ef68fe02ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:37:45.008093 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7deeeb-c159-4a34-b61c-a0ef68fe02ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:37:45.009974 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7deeeb-c159-4a34-b61c-a0ef68fe02ac admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:37:45.038606 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1274/2574] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:37:44 2022] POST /identity/v3/projects => generated 405 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:37:45.042867 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc60fac3-8684-4392-af3c-35434f217a83 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:37:45.053823 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc60fac3-8684-4392-af3c-35434f217a83 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:37:45.074189 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:37:45.113784 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55996a77-a1d0-4c9f-9d0f-3dee325b3db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:37:45.114420 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55996a77-a1d0-4c9f-9d0f-3dee325b3db4 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:37:45.114671 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55996a77-a1d0-4c9f-9d0f-3dee325b3db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:37:45.114949 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55996a77-a1d0-4c9f-9d0f-3dee325b3db4 admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:37:45.116174 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55996a77-a1d0-4c9f-9d0f-3dee325b3db4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:37:45.118093 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55996a77-a1d0-4c9f-9d0f-3dee325b3db4 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:37:45.139763 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1301/2575] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:37:45 2022] POST /identity/v3/users => generated 303 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:37:45.143992 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7deeeb-c159-4a34-b61c-a0ef68fe02ac admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:37:45.154462 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7deeeb-c159-4a34-b61c-a0ef68fe02ac admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:37:45.159682 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a487e3-bee2-4513-9600-3e2fb707f84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:37:45.159916 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a487e3-bee2-4513-9600-3e2fb707f84c admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:37:45.160206 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a487e3-bee2-4513-9600-3e2fb707f84c admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:37:45.160484 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a487e3-bee2-4513-9600-3e2fb707f84c admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:37:45.161187 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a487e3-bee2-4513-9600-3e2fb707f84c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:37:45.162842 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a487e3-bee2-4513-9600-3e2fb707f84c admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:37:45.173381 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1275/2576] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:37:45.177354 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55996a77-a1d0-4c9f-9d0f-3dee325b3db4 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:37:45.187916 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55996a77-a1d0-4c9f-9d0f-3dee325b3db4 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:37:45.192723 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5807c8a7-9195-48e2-a898-8ad8b8c4f720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:37:45.193325 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5807c8a7-9195-48e2-a898-8ad8b8c4f720 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:37:45.194278 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5807c8a7-9195-48e2-a898-8ad8b8c4f720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:37:45.194555 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5807c8a7-9195-48e2-a898-8ad8b8c4f720 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:37:45.195271 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5807c8a7-9195-48e2-a898-8ad8b8c4f720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:37:45.196870 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5807c8a7-9195-48e2-a898-8ad8b8c4f720 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:37:45.207680 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1302/2577] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:37:45.211603 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a487e3-bee2-4513-9600-3e2fb707f84c admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:37:45.221590 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a487e3-bee2-4513-9600-3e2fb707f84c admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:37:45.226198 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7c8ac-f84a-467f-9b7f-42e5c26f41a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:37:45.227009 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7c8ac-f84a-467f-9b7f-42e5c26f41a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:37:45.227324 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7c8ac-f84a-467f-9b7f-42e5c26f41a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:37:45.227608 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7c8ac-f84a-467f-9b7f-42e5c26f41a8 admin admin] PATH_INFO: `/v3/projects/af039cf105304df3942fcb4d038888d7/users/3ee27589b9b5469dbc1308350c2dcd91/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:37:45.243640 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c7c8ac-f84a-467f-9b7f-42e5c26f41a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af039cf105304df3942fcb4d038888d7, user_id=3ee27589b9b5469dbc1308350c2dcd91, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:37:45.246276 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c7c8ac-f84a-467f-9b7f-42e5c26f41a8 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:37:45.261382 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1276/2578] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:37:45 2022] PUT /identity/v3/projects/af039cf105304df3942fcb4d038888d7/users/3ee27589b9b5469dbc1308350c2dcd91/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:37:45.272064 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a5b29-05de-4289-b79e-2ce5d0ddf777 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:37:45.272478 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a5b29-05de-4289-b79e-2ce5d0ddf777 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:37:45.272752 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a5b29-05de-4289-b79e-2ce5d0ddf777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:37:45.304058 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-113a5b29-05de-4289-b79e-2ce5d0ddf777 None None] MFA Rules not processed for user `3ee27589b9b5469dbc1308350c2dcd91`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:37:45.305293 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-113a5b29-05de-4289-b79e-2ce5d0ddf777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:37:45.375437 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1303/2579] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:37:45 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:37:45.380006 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7c8ac-f84a-467f-9b7f-42e5c26f41a8 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:37:45.413636 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:37:45.449243 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7c8ac-f84a-467f-9b7f-42e5c26f41a8 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:37:45.453964 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f031d7bc-9efa-402f-8c34-e7b6cd3a0dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:37:45.454567 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031d7bc-9efa-402f-8c34-e7b6cd3a0dc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:37:45.454856 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031d7bc-9efa-402f-8c34-e7b6cd3a0dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:37:45.455131 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031d7bc-9efa-402f-8c34-e7b6cd3a0dc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:37:45.455835 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f031d7bc-9efa-402f-8c34-e7b6cd3a0dc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:37:45.457733 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f031d7bc-9efa-402f-8c34-e7b6cd3a0dc2 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:37:45.484614 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1277/2580] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:37:45 2022] POST /identity/v3/projects => generated 403 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 15:37:45.488692 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a5b29-05de-4289-b79e-2ce5d0ddf777 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:37:45.499853 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a5b29-05de-4289-b79e-2ce5d0ddf777 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:37:45.557691 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de476a3e-54a1-4b5f-b712-eb1dc9cc04b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:37:45.558392 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de476a3e-54a1-4b5f-b712-eb1dc9cc04b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:37:45.558677 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de476a3e-54a1-4b5f-b712-eb1dc9cc04b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:37:45.558952 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de476a3e-54a1-4b5f-b712-eb1dc9cc04b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:37:45.559657 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de476a3e-54a1-4b5f-b712-eb1dc9cc04b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:37:45.561585 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de476a3e-54a1-4b5f-b712-eb1dc9cc04b4 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:37:45.582954 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1304/2581] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:37:45 2022] POST /identity/v3/users => generated 308 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:37:45.587543 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f031d7bc-9efa-402f-8c34-e7b6cd3a0dc2 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:37:45.597863 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f031d7bc-9efa-402f-8c34-e7b6cd3a0dc2 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:37:45.602445 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bbd61d-c781-4d5e-9d22-552b6f1b5a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:37:45.603056 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbd61d-c781-4d5e-9d22-552b6f1b5a0f admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:37:45.603370 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbd61d-c781-4d5e-9d22-552b6f1b5a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:37:45.603652 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbd61d-c781-4d5e-9d22-552b6f1b5a0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:37:45.604339 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bbd61d-c781-4d5e-9d22-552b6f1b5a0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:37:45.605921 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bbd61d-c781-4d5e-9d22-552b6f1b5a0f admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:37:45.616257 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1278/2582] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:37:45.620092 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de476a3e-54a1-4b5f-b712-eb1dc9cc04b4 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:37:45.629931 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de476a3e-54a1-4b5f-b712-eb1dc9cc04b4 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:37:45.634959 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed558f91-6cfc-4093-9482-dddc69b7e9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:37:45.635627 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed558f91-6cfc-4093-9482-dddc69b7e9f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:37:45.635910 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed558f91-6cfc-4093-9482-dddc69b7e9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:37:45.636189 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed558f91-6cfc-4093-9482-dddc69b7e9f6 admin admin] PATH_INFO: `/v3/projects/ebd931b7a0aa49abbd9debc645cc6f1c/users/38a52ba109304a2eb6d7fda530a889ff/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:37:45.651357 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed558f91-6cfc-4093-9482-dddc69b7e9f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebd931b7a0aa49abbd9debc645cc6f1c, user_id=38a52ba109304a2eb6d7fda530a889ff, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:37:45.654359 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed558f91-6cfc-4093-9482-dddc69b7e9f6 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:37:45.662645 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:37:45.669292 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1305/2583] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:37:45 2022] PUT /identity/v3/projects/ebd931b7a0aa49abbd9debc645cc6f1c/users/38a52ba109304a2eb6d7fda530a889ff/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:37:45.673488 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bbd61d-c781-4d5e-9d22-552b6f1b5a0f admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:37:45.684200 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bbd61d-c781-4d5e-9d22-552b6f1b5a0f admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:37:45.738899 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e53ae5-afdd-4b6f-984a-fad1fdac2744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:37:45.739542 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e53ae5-afdd-4b6f-984a-fad1fdac2744 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:37:45.739827 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e53ae5-afdd-4b6f-984a-fad1fdac2744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:37:45.740106 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e53ae5-afdd-4b6f-984a-fad1fdac2744 admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:37:45.741350 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e53ae5-afdd-4b6f-984a-fad1fdac2744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:37:45.742926 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e53ae5-afdd-4b6f-984a-fad1fdac2744 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:37:45.752709 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1279/2584] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:37:45.756758 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed558f91-6cfc-4093-9482-dddc69b7e9f6 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:37:45.767164 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed558f91-6cfc-4093-9482-dddc69b7e9f6 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:37:45.771940 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7629f869-4ec4-4cdd-9246-b26178c0ece9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:37:45.772596 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629f869-4ec4-4cdd-9246-b26178c0ece9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:37:45.772880 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629f869-4ec4-4cdd-9246-b26178c0ece9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:37:45.773157 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629f869-4ec4-4cdd-9246-b26178c0ece9 admin admin] PATH_INFO: `/v3/projects/ebd931b7a0aa49abbd9debc645cc6f1c/users/38a52ba109304a2eb6d7fda530a889ff/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:37:45.775091 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7629f869-4ec4-4cdd-9246-b26178c0ece9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebd931b7a0aa49abbd9debc645cc6f1c, user_id=38a52ba109304a2eb6d7fda530a889ff, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:37:45.777820 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7629f869-4ec4-4cdd-9246-b26178c0ece9 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:37:45.788510 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1306/2585] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:37:45 2022] PUT /identity/v3/projects/ebd931b7a0aa49abbd9debc645cc6f1c/users/38a52ba109304a2eb6d7fda530a889ff/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 15:37:45.800358 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea691645-75d7-4fdd-b778-ba47746095aa None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:37:45.800650 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea691645-75d7-4fdd-b778-ba47746095aa None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:37:45.800933 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea691645-75d7-4fdd-b778-ba47746095aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:37:45.836697 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-ea691645-75d7-4fdd-b778-ba47746095aa None None] MFA Rules not processed for user `38a52ba109304a2eb6d7fda530a889ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:37:45.837889 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-ea691645-75d7-4fdd-b778-ba47746095aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:37:45.903617 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1280/2586] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:37:45 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:37:45.914945 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7629f869-4ec4-4cdd-9246-b26178c0ece9 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:37:45.916640 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-7629f869-4ec4-4cdd-9246-b26178c0ece9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:37:45.972851 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7629f869-4ec4-4cdd-9246-b26178c0ece9 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:37:45.977062 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af34dd8-4980-46ba-b10c-da047c366a8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:37:45.977659 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af34dd8-4980-46ba-b10c-da047c366a8e service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:37:45.977939 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af34dd8-4980-46ba-b10c-da047c366a8e service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:37:45.978215 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af34dd8-4980-46ba-b10c-da047c366a8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:37:45.986899 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af34dd8-4980-46ba-b10c-da047c366a8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:37:45.988352 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af34dd8-4980-46ba-b10c-da047c366a8e service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:37:45.997965 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1307/2587] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:37:45 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:37:46.148789 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea691645-75d7-4fdd-b778-ba47746095aa None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:37:46.173190 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:37:46.210988 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea691645-75d7-4fdd-b778-ba47746095aa None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:37:46.215503 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbfae43-36ec-4e8a-b3ca-7dc8fa710d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:37:46.216142 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbfae43-36ec-4e8a-b3ca-7dc8fa710d94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:37:46.216424 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbfae43-36ec-4e8a-b3ca-7dc8fa710d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:37:46.216703 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbfae43-36ec-4e8a-b3ca-7dc8fa710d94 admin admin] PATH_INFO: `/v3/users/3ee27589b9b5469dbc1308350c2dcd91` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:37:46.217854 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbfae43-36ec-4e8a-b3ca-7dc8fa710d94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ee27589b9b5469dbc1308350c2dcd91)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:37:46.219797 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbfae43-36ec-4e8a-b3ca-7dc8fa710d94 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:37:46.266071 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-6dbfae43-36ec-4e8a-b3ca-7dc8fa710d94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ee27589b9b5469dbc1308350c2dcd91'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:37:46.272973 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-6dbfae43-36ec-4e8a-b3ca-7dc8fa710d94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ee27589b9b5469dbc1308350c2dcd91'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:37:46.284535 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-6dbfae43-36ec-4e8a-b3ca-7dc8fa710d94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ee27589b9b5469dbc1308350c2dcd91'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:37:46.285197 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-6dbfae43-36ec-4e8a-b3ca-7dc8fa710d94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ee27589b9b5469dbc1308350c2dcd91'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:37:46.285793 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-6dbfae43-36ec-4e8a-b3ca-7dc8fa710d94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ee27589b9b5469dbc1308350c2dcd91'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:37:46.298982 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1281/2588] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:37:46 2022] DELETE /identity/v3/users/3ee27589b9b5469dbc1308350c2dcd91 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:37:46.304450 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ff7a8-d777-4c06-b211-57ecb9aa04ca None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:37:46.304941 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ff7a8-d777-4c06-b211-57ecb9aa04ca None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:37:46.305061 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ff7a8-d777-4c06-b211-57ecb9aa04ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:37:46.324264 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-fa5ff7a8-d777-4c06-b211-57ecb9aa04ca None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:37:46.325460 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-fa5ff7a8-d777-4c06-b211-57ecb9aa04ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:37:46.384828 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1308/2589] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:37:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:37:46.394526 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbfae43-36ec-4e8a-b3ca-7dc8fa710d94 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:37:46.395973 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-6dbfae43-36ec-4e8a-b3ca-7dc8fa710d94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:37:46.459867 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbfae43-36ec-4e8a-b3ca-7dc8fa710d94 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:37:46.464144 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b0163-7b8a-4a26-af82-8c48d7a30c7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:37:46.465003 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b0163-7b8a-4a26-af82-8c48d7a30c7b service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:37:46.465410 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b0163-7b8a-4a26-af82-8c48d7a30c7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:37:46.465655 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b0163-7b8a-4a26-af82-8c48d7a30c7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:37:46.475339 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801b0163-7b8a-4a26-af82-8c48d7a30c7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:37:46.476782 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801b0163-7b8a-4a26-af82-8c48d7a30c7b service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:37:46.486280 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1282/2590] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:37:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:37:46.827861 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ff7a8-d777-4c06-b211-57ecb9aa04ca None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:37:46.829896 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-fa5ff7a8-d777-4c06-b211-57ecb9aa04ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:37:46.843089 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ff7a8-d777-4c06-b211-57ecb9aa04ca None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:37:46.848071 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4574bde0-79d1-4ca4-9675-d689edd9b814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:37:46.848804 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4574bde0-79d1-4ca4-9675-d689edd9b814 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:37:46.849141 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4574bde0-79d1-4ca4-9675-d689edd9b814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:37:46.849488 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4574bde0-79d1-4ca4-9675-d689edd9b814 admin admin] PATH_INFO: `/v3/projects/af039cf105304df3942fcb4d038888d7` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:37:46.850803 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4574bde0-79d1-4ca4-9675-d689edd9b814 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af039cf105304df3942fcb4d038888d7)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:37:46.853063 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4574bde0-79d1-4ca4-9675-d689edd9b814 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:37:46.905686 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-4574bde0-79d1-4ca4-9675-d689edd9b814 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af039cf105304df3942fcb4d038888d7', 'request_id': 'req-4574bde0-79d1-4ca4-9675-d689edd9b814'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:37:46.912578 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-4574bde0-79d1-4ca4-9675-d689edd9b814 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af039cf105304df3942fcb4d038888d7', 'request_id': 'req-4574bde0-79d1-4ca4-9675-d689edd9b814'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:37:46.919085 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-4574bde0-79d1-4ca4-9675-d689edd9b814 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af039cf105304df3942fcb4d038888d7', 'request_id': 'req-4574bde0-79d1-4ca4-9675-d689edd9b814'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:37:46.930337 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-4574bde0-79d1-4ca4-9675-d689edd9b814 admin admin] The token cache is being invalidate because project af039cf105304df3942fcb4d038888d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:37:46.930628 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-4574bde0-79d1-4ca4-9675-d689edd9b814 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:37:46.931324 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-4574bde0-79d1-4ca4-9675-d689edd9b814 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:37:46.933006 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1309/2591] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:37:46 2022] DELETE /identity/v3/projects/af039cf105304df3942fcb4d038888d7 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:37:46.937043 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b0163-7b8a-4a26-af82-8c48d7a30c7b service neutron] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:37:46.948936 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b0163-7b8a-4a26-af82-8c48d7a30c7b service neutron] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:37:46.993390 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:37:47.011880 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e04b70-bfde-41b4-ba8d-2cf1c84c7182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:37:47.012585 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e04b70-bfde-41b4-ba8d-2cf1c84c7182 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:37:47.012865 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e04b70-bfde-41b4-ba8d-2cf1c84c7182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:37:47.013142 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e04b70-bfde-41b4-ba8d-2cf1c84c7182 admin admin] PATH_INFO: `/v3/users/38a52ba109304a2eb6d7fda530a889ff` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:37:47.014337 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e04b70-bfde-41b4-ba8d-2cf1c84c7182 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38a52ba109304a2eb6d7fda530a889ff)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:37:47.016303 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e04b70-bfde-41b4-ba8d-2cf1c84c7182 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:37:47.065029 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-71e04b70-bfde-41b4-ba8d-2cf1c84c7182 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38a52ba109304a2eb6d7fda530a889ff'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:37:47.071895 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-71e04b70-bfde-41b4-ba8d-2cf1c84c7182 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38a52ba109304a2eb6d7fda530a889ff'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:37:47.084162 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-71e04b70-bfde-41b4-ba8d-2cf1c84c7182 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38a52ba109304a2eb6d7fda530a889ff'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:37:47.084846 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-71e04b70-bfde-41b4-ba8d-2cf1c84c7182 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38a52ba109304a2eb6d7fda530a889ff'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:37:47.085447 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-71e04b70-bfde-41b4-ba8d-2cf1c84c7182 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38a52ba109304a2eb6d7fda530a889ff'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:37:47.098346 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1283/2592] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:37:46 2022] DELETE /identity/v3/users/38a52ba109304a2eb6d7fda530a889ff => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:37:47.395826 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4574bde0-79d1-4ca4-9675-d689edd9b814 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:37:47.397272 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-4574bde0-79d1-4ca4-9675-d689edd9b814 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:37:47.411575 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4574bde0-79d1-4ca4-9675-d689edd9b814 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:37:47.419995 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:37:47.472822 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f54008-8a87-41ef-9333-8a299854030c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:37:47.473465 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f54008-8a87-41ef-9333-8a299854030c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:37:47.473739 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f54008-8a87-41ef-9333-8a299854030c admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:37:47.474011 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f54008-8a87-41ef-9333-8a299854030c admin admin] PATH_INFO: `/v3/projects/ebd931b7a0aa49abbd9debc645cc6f1c` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:37:47.475185 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f54008-8a87-41ef-9333-8a299854030c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebd931b7a0aa49abbd9debc645cc6f1c)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:37:47.477118 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f54008-8a87-41ef-9333-8a299854030c admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:37:47.528762 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-01f54008-8a87-41ef-9333-8a299854030c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebd931b7a0aa49abbd9debc645cc6f1c', 'request_id': 'req-01f54008-8a87-41ef-9333-8a299854030c'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:37:47.536721 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-01f54008-8a87-41ef-9333-8a299854030c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebd931b7a0aa49abbd9debc645cc6f1c', 'request_id': 'req-01f54008-8a87-41ef-9333-8a299854030c'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:37:47.543683 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-01f54008-8a87-41ef-9333-8a299854030c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebd931b7a0aa49abbd9debc645cc6f1c', 'request_id': 'req-01f54008-8a87-41ef-9333-8a299854030c'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:37:47.554264 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-01f54008-8a87-41ef-9333-8a299854030c admin admin] The token cache is being invalidate because project ebd931b7a0aa49abbd9debc645cc6f1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:37:47.554551 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-01f54008-8a87-41ef-9333-8a299854030c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:37:47.555201 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-01f54008-8a87-41ef-9333-8a299854030c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:37:47.557094 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1310/2593] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:37:47 2022] DELETE /identity/v3/projects/ebd931b7a0aa49abbd9debc645cc6f1c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:37:47.561995 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c53db42-c82c-429b-94fd-12f262f4f072 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:37:47.562471 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c53db42-c82c-429b-94fd-12f262f4f072 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:37:47.562594 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c53db42-c82c-429b-94fd-12f262f4f072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:37:47.581958 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-9c53db42-c82c-429b-94fd-12f262f4f072 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:37:47.583156 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-9c53db42-c82c-429b-94fd-12f262f4f072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:37:47.640166 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1284/2594] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:37:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:37:47.648220 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34de693-7d25-4ea9-9334-53d9522a8a49 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:37:47.648513 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34de693-7d25-4ea9-9334-53d9522a8a49 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:37:47.648841 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34de693-7d25-4ea9-9334-53d9522a8a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:37:47.668631 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-f34de693-7d25-4ea9-9334-53d9522a8a49 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:37:47.669834 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-f34de693-7d25-4ea9-9334-53d9522a8a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:37:47.677988 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1311/2595] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:37:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:37:47.682017 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c53db42-c82c-429b-94fd-12f262f4f072 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:37:47.691495 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c53db42-c82c-429b-94fd-12f262f4f072 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:37:47.696520 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f7cfd-fd72-43a4-aebf-16786917a1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:37:47.697121 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f7cfd-fd72-43a4-aebf-16786917a1b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:37:47.697401 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f7cfd-fd72-43a4-aebf-16786917a1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:37:47.697681 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f7cfd-fd72-43a4-aebf-16786917a1b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:37:47.698358 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f7cfd-fd72-43a4-aebf-16786917a1b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:37:47.698662 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f7cfd-fd72-43a4-aebf-16786917a1b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:37:47.700272 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f7cfd-fd72-43a4-aebf-16786917a1b4 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:37:47.712188 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1285/2596] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 2 15:37:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:37:47.716229 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34de693-7d25-4ea9-9334-53d9522a8a49 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:37:47.725201 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34de693-7d25-4ea9-9334-53d9522a8a49 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:37:47.730158 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59021b0-c0a9-4163-9b29-522cb04e1ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:37:47.730765 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59021b0-c0a9-4163-9b29-522cb04e1ee5 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:37:47.731050 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59021b0-c0a9-4163-9b29-522cb04e1ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:37:47.731356 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59021b0-c0a9-4163-9b29-522cb04e1ee5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:37:47.732016 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59021b0-c0a9-4163-9b29-522cb04e1ee5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:37:47.733907 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59021b0-c0a9-4163-9b29-522cb04e1ee5 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:37:47.761476 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1312/2597] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:37:47 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:37:47.765503 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f7cfd-fd72-43a4-aebf-16786917a1b4 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:37:47.775884 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f7cfd-fd72-43a4-aebf-16786917a1b4 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:37:47.821768 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:37:47.832922 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0da4a83-90db-4d12-a9e4-221c299f0b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:37:47.834551 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da4a83-90db-4d12-a9e4-221c299f0b68 admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:37:47.834809 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da4a83-90db-4d12-a9e4-221c299f0b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:37:47.835092 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da4a83-90db-4d12-a9e4-221c299f0b68 admin admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:37:47.835905 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0da4a83-90db-4d12-a9e4-221c299f0b68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:37:47.837875 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0da4a83-90db-4d12-a9e4-221c299f0b68 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:37:47.859208 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1286/2598] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:37:47 2022] POST /identity/v3/users => generated 283 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:37:47.863482 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59021b0-c0a9-4163-9b29-522cb04e1ee5 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:37:47.873790 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59021b0-c0a9-4163-9b29-522cb04e1ee5 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:37:47.878488 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcef1a9-db69-4830-a70d-406c3ed49da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:37:47.879097 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcef1a9-db69-4830-a70d-406c3ed49da8 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:37:47.879409 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcef1a9-db69-4830-a70d-406c3ed49da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:37:47.879687 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcef1a9-db69-4830-a70d-406c3ed49da8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:37:47.880376 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcef1a9-db69-4830-a70d-406c3ed49da8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:37:47.882500 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcef1a9-db69-4830-a70d-406c3ed49da8 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:37:47.892921 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1313/2599] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:37:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:37:47.897671 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0da4a83-90db-4d12-a9e4-221c299f0b68 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:37:47.907864 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0da4a83-90db-4d12-a9e4-221c299f0b68 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:37:47.912508 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f0e4bc-0d40-4e90-aa9d-1ad60fba1166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:37:47.913118 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f0e4bc-0d40-4e90-aa9d-1ad60fba1166 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:37:47.913400 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f0e4bc-0d40-4e90-aa9d-1ad60fba1166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:37:47.913705 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f0e4bc-0d40-4e90-aa9d-1ad60fba1166 admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:37:47.914392 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f0e4bc-0d40-4e90-aa9d-1ad60fba1166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:37:47.916022 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f0e4bc-0d40-4e90-aa9d-1ad60fba1166 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:37:47.927590 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1287/2600] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:37:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:37:47.931924 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcef1a9-db69-4830-a70d-406c3ed49da8 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:37:47.942070 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcef1a9-db69-4830-a70d-406c3ed49da8 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:37:47.948088 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc4c86-d717-49f2-b946-a17877f98137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:37:47.948777 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc4c86-d717-49f2-b946-a17877f98137 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:37:47.949059 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc4c86-d717-49f2-b946-a17877f98137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:37:47.949337 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc4c86-d717-49f2-b946-a17877f98137 admin admin] PATH_INFO: `/v3/projects/bcbf47cd5b4e4e2da1f5f0a67a394c44/users/392263e7b042426ba91033466455a02f/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:37:47.965154 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccc4c86-d717-49f2-b946-a17877f98137 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcbf47cd5b4e4e2da1f5f0a67a394c44, user_id=392263e7b042426ba91033466455a02f, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:37:47.967813 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccc4c86-d717-49f2-b946-a17877f98137 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:37:47.980221 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1314/2601] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:37:47 2022] PUT /identity/v3/projects/bcbf47cd5b4e4e2da1f5f0a67a394c44/users/392263e7b042426ba91033466455a02f/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:37:47.990613 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d1197-4cad-4949-8707-7da2b81b45b7 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:37:47.990928 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d1197-4cad-4949-8707-7da2b81b45b7 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:37:47.991208 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d1197-4cad-4949-8707-7da2b81b45b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:37:48.018782 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-491d1197-4cad-4949-8707-7da2b81b45b7 None None] MFA Rules not processed for user `392263e7b042426ba91033466455a02f`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:37:48.020026 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-491d1197-4cad-4949-8707-7da2b81b45b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:37:48.084345 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1288/2602] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:37:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:37:48.088847 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc4c86-d717-49f2-b946-a17877f98137 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:37:48.129384 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:37:48.152465 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc4c86-d717-49f2-b946-a17877f98137 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:37:48.157423 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2546da70-6011-4848-ae7e-13e8a3a2863f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:37:48.158071 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546da70-6011-4848-ae7e-13e8a3a2863f admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:37:48.158355 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546da70-6011-4848-ae7e-13e8a3a2863f admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:37:48.158645 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546da70-6011-4848-ae7e-13e8a3a2863f admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:37:48.159327 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2546da70-6011-4848-ae7e-13e8a3a2863f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:37:48.161250 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2546da70-6011-4848-ae7e-13e8a3a2863f admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:37:48.187442 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1315/2603] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:37:48 2022] POST /identity/v3/projects => generated 363 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 15:37:48.191592 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491d1197-4cad-4949-8707-7da2b81b45b7 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:37:48.203009 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491d1197-4cad-4949-8707-7da2b81b45b7 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:37:48.258063 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf47fa-96f2-4ee5-b5ff-8bfb172ced8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:37:48.258678 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf47fa-96f2-4ee5-b5ff-8bfb172ced8a admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:37:48.258961 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf47fa-96f2-4ee5-b5ff-8bfb172ced8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:37:48.259257 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf47fa-96f2-4ee5-b5ff-8bfb172ced8a admin admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:37:48.259925 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf47fa-96f2-4ee5-b5ff-8bfb172ced8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:37:48.261818 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf47fa-96f2-4ee5-b5ff-8bfb172ced8a admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:37:48.282648 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1289/2604] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:37:48 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 15:37:48.286636 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2546da70-6011-4848-ae7e-13e8a3a2863f admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:37:48.296873 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2546da70-6011-4848-ae7e-13e8a3a2863f admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:37:48.301706 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0452b8e1-8e77-42fb-af1d-66ca920d503b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:37:48.302315 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452b8e1-8e77-42fb-af1d-66ca920d503b admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:37:48.302600 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452b8e1-8e77-42fb-af1d-66ca920d503b admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:37:48.303400 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452b8e1-8e77-42fb-af1d-66ca920d503b admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:37:48.304092 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0452b8e1-8e77-42fb-af1d-66ca920d503b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:37:48.305701 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0452b8e1-8e77-42fb-af1d-66ca920d503b admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:37:48.316600 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1316/2605] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:37:48.321245 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf47fa-96f2-4ee5-b5ff-8bfb172ced8a admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:37:48.332500 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf47fa-96f2-4ee5-b5ff-8bfb172ced8a admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:37:48.337463 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af56b7-410a-425a-99a4-6d02fdbe94f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:37:48.338299 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af56b7-410a-425a-99a4-6d02fdbe94f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:37:48.338715 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af56b7-410a-425a-99a4-6d02fdbe94f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:37:48.339129 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af56b7-410a-425a-99a4-6d02fdbe94f5 admin admin] PATH_INFO: `/v3/projects/ff84114515b9403295b0760ee83b5964/users/f5c7fcece78e476f98ee38391b4c51f2/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:37:48.354430 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98af56b7-410a-425a-99a4-6d02fdbe94f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff84114515b9403295b0760ee83b5964, user_id=f5c7fcece78e476f98ee38391b4c51f2, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:37:48.357135 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98af56b7-410a-425a-99a4-6d02fdbe94f5 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:37:48.369957 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1290/2606] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:37:48 2022] PUT /identity/v3/projects/ff84114515b9403295b0760ee83b5964/users/f5c7fcece78e476f98ee38391b4c51f2/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:37:48.373882 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0452b8e1-8e77-42fb-af1d-66ca920d503b admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:37:48.384531 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0452b8e1-8e77-42fb-af1d-66ca920d503b admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:37:48.440725 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298d140-8fd8-473d-817e-310089384bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:37:48.441350 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298d140-8fd8-473d-817e-310089384bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:37:48.441633 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298d140-8fd8-473d-817e-310089384bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:37:48.441912 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298d140-8fd8-473d-817e-310089384bb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:37:48.442604 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298d140-8fd8-473d-817e-310089384bb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:37:48.444755 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298d140-8fd8-473d-817e-310089384bb4 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:37:48.454511 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1317/2607] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:37:48.458650 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af56b7-410a-425a-99a4-6d02fdbe94f5 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:37:48.469369 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af56b7-410a-425a-99a4-6d02fdbe94f5 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:37:48.473995 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d7df7-0e6a-4fef-aee7-3f067ed499d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:37:48.474652 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d7df7-0e6a-4fef-aee7-3f067ed499d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:37:48.474940 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d7df7-0e6a-4fef-aee7-3f067ed499d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:37:48.475236 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d7df7-0e6a-4fef-aee7-3f067ed499d8 admin admin] PATH_INFO: `/v3/projects/ff84114515b9403295b0760ee83b5964/users/f5c7fcece78e476f98ee38391b4c51f2/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:37:48.477199 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d7df7-0e6a-4fef-aee7-3f067ed499d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff84114515b9403295b0760ee83b5964, user_id=f5c7fcece78e476f98ee38391b4c51f2, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:37:48.479842 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d7df7-0e6a-4fef-aee7-3f067ed499d8 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:37:48.489829 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1291/2608] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:37:48 2022] PUT /identity/v3/projects/ff84114515b9403295b0760ee83b5964/users/f5c7fcece78e476f98ee38391b4c51f2/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:37:48.501048 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb0832-3a23-4d48-a00a-29c45aaf33ec None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:37:48.501385 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb0832-3a23-4d48-a00a-29c45aaf33ec None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:37:48.501668 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb0832-3a23-4d48-a00a-29c45aaf33ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:37:48.530016 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-88bb0832-3a23-4d48-a00a-29c45aaf33ec None None] MFA Rules not processed for user `f5c7fcece78e476f98ee38391b4c51f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:37:48.531241 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-88bb0832-3a23-4d48-a00a-29c45aaf33ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:37:48.599998 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1318/2609] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:37:48 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:37:48.613375 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d7df7-0e6a-4fef-aee7-3f067ed499d8 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:37:48.615080 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-7c6d7df7-0e6a-4fef-aee7-3f067ed499d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:37:48.628852 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:37:48.675183 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d7df7-0e6a-4fef-aee7-3f067ed499d8 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:37:48.678830 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8b85b0-4267-4bc2-8efa-4cb560fc90b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:37:48.679482 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b85b0-4267-4bc2-8efa-4cb560fc90b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:37:48.679760 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b85b0-4267-4bc2-8efa-4cb560fc90b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:37:48.680041 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b85b0-4267-4bc2-8efa-4cb560fc90b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:37:48.689009 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8b85b0-4267-4bc2-8efa-4cb560fc90b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:37:48.690417 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8b85b0-4267-4bc2-8efa-4cb560fc90b9 service cinder] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:37:48.700231 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1292/2610] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:37:48 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:37:48.778340 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb0832-3a23-4d48-a00a-29c45aaf33ec None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:37:48.787858 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb0832-3a23-4d48-a00a-29c45aaf33ec None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:37:48.791434 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394107a8-9b56-4d39-aab9-165589a408f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:37:48.792039 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394107a8-9b56-4d39-aab9-165589a408f3 service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:37:48.792324 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394107a8-9b56-4d39-aab9-165589a408f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:37:48.792599 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394107a8-9b56-4d39-aab9-165589a408f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:37:48.824013 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:37:48.850266 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394107a8-9b56-4d39-aab9-165589a408f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:37:48.851668 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394107a8-9b56-4d39-aab9-165589a408f3 service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:37:48.860441 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1319/2611] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:37:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:37:55.975424 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a7e4b-559c-40a6-83b6-bded27a92b0a None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:37:55.975953 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a7e4b-559c-40a6-83b6-bded27a92b0a None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:37:55.976102 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a7e4b-559c-40a6-83b6-bded27a92b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:37:55.994717 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-fe7a7e4b-559c-40a6-83b6-bded27a92b0a None None] MFA Rules not processed for user `dfe8c00c0c3d4c4b8b6f36e39a3a2e71`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:37:55.995961 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-fe7a7e4b-559c-40a6-83b6-bded27a92b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:37:56.056394 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1293/2612] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Aug 2 15:37:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:37:56.104139 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394107a8-9b56-4d39-aab9-165589a408f3 service cinder] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:37:56.105662 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-394107a8-9b56-4d39-aab9-165589a408f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:37:56.180331 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394107a8-9b56-4d39-aab9-165589a408f3 service cinder] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:37:56.185260 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2511a128-474d-47b3-b308-8d548c77cf59 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4de590df474c8b95f2b1193f7dbcb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:37:56.185874 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2511a128-474d-47b3-b308-8d548c77cf59 service swift] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:37:56.186154 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2511a128-474d-47b3-b308-8d548c77cf59 service swift] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:37:56.186426 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2511a128-474d-47b3-b308-8d548c77cf59 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:37:56.195244 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2511a128-474d-47b3-b308-8d548c77cf59 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:37:56.196879 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2511a128-474d-47b3-b308-8d548c77cf59 service swift] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:37:56.205255 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1320/2613] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Aug 2 15:37:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 15:37:59.215241 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a7e4b-559c-40a6-83b6-bded27a92b0a None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:37:59.297077 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a7e4b-559c-40a6-83b6-bded27a92b0a None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:37:59.302305 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab34bc10-0288-4eda-bab3-0c54deac9740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:37:59.303890 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34bc10-0288-4eda-bab3-0c54deac9740 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:37:59.304180 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34bc10-0288-4eda-bab3-0c54deac9740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:37:59.304505 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34bc10-0288-4eda-bab3-0c54deac9740 admin admin] PATH_INFO: `/v3/users/392263e7b042426ba91033466455a02f` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:37:59.305707 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab34bc10-0288-4eda-bab3-0c54deac9740 admin admin] RBAC: Authorizing `identity:delete_user(user_id=392263e7b042426ba91033466455a02f)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:37:59.307675 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab34bc10-0288-4eda-bab3-0c54deac9740 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:37:59.369195 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-ab34bc10-0288-4eda-bab3-0c54deac9740 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '392263e7b042426ba91033466455a02f'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:37:59.379043 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:37:59.381539 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-ab34bc10-0288-4eda-bab3-0c54deac9740 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '392263e7b042426ba91033466455a02f'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:37:59.400101 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-ab34bc10-0288-4eda-bab3-0c54deac9740 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '392263e7b042426ba91033466455a02f'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:37:59.400947 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-ab34bc10-0288-4eda-bab3-0c54deac9740 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '392263e7b042426ba91033466455a02f'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:37:59.401625 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-ab34bc10-0288-4eda-bab3-0c54deac9740 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '392263e7b042426ba91033466455a02f'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:37:59.423391 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1294/2614] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:37:59 2022] DELETE /identity/v3/users/392263e7b042426ba91033466455a02f => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:37:59.431274 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b733ed55-bfa3-4760-a354-3fd26bc45e0e None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:37:59.431816 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b733ed55-bfa3-4760-a354-3fd26bc45e0e None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:37:59.431816 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b733ed55-bfa3-4760-a354-3fd26bc45e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:37:59.452628 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-b733ed55-bfa3-4760-a354-3fd26bc45e0e None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:37:59.453949 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-b733ed55-bfa3-4760-a354-3fd26bc45e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:37:59.524384 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1321/2615] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:37:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:37:59.531243 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab34bc10-0288-4eda-bab3-0c54deac9740 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:37:59.532685 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-ab34bc10-0288-4eda-bab3-0c54deac9740 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:37:59.608777 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab34bc10-0288-4eda-bab3-0c54deac9740 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:37:59.614126 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1087ef90-a8c2-4b97-96b1-594a46f4e3c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:37:59.615177 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1087ef90-a8c2-4b97-96b1-594a46f4e3c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:37:59.615904 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1087ef90-a8c2-4b97-96b1-594a46f4e3c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:37:59.616375 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1087ef90-a8c2-4b97-96b1-594a46f4e3c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:37:59.629475 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1087ef90-a8c2-4b97-96b1-594a46f4e3c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:37:59.631331 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1087ef90-a8c2-4b97-96b1-594a46f4e3c7 service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:37:59.642717 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1295/2616] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:37:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:38:00.001457 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b733ed55-bfa3-4760-a354-3fd26bc45e0e None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:00.003866 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-b733ed55-bfa3-4760-a354-3fd26bc45e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:38:00.023268 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b733ed55-bfa3-4760-a354-3fd26bc45e0e None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:00.029127 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f785d1d1-9681-4248-b35d-df7a0e19f3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:00.030038 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f785d1d1-9681-4248-b35d-df7a0e19f3c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:00.030489 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f785d1d1-9681-4248-b35d-df7a0e19f3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:00.031521 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f785d1d1-9681-4248-b35d-df7a0e19f3c2 admin admin] PATH_INFO: `/v3/projects/bcbf47cd5b4e4e2da1f5f0a67a394c44` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:00.033117 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f785d1d1-9681-4248-b35d-df7a0e19f3c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcbf47cd5b4e4e2da1f5f0a67a394c44)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:00.042790 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f785d1d1-9681-4248-b35d-df7a0e19f3c2 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:00.094692 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-f785d1d1-9681-4248-b35d-df7a0e19f3c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcbf47cd5b4e4e2da1f5f0a67a394c44', 'request_id': 'req-f785d1d1-9681-4248-b35d-df7a0e19f3c2'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:00.107518 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-f785d1d1-9681-4248-b35d-df7a0e19f3c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcbf47cd5b4e4e2da1f5f0a67a394c44', 'request_id': 'req-f785d1d1-9681-4248-b35d-df7a0e19f3c2'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:00.109271 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:38:00.117505 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-f785d1d1-9681-4248-b35d-df7a0e19f3c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcbf47cd5b4e4e2da1f5f0a67a394c44', 'request_id': 'req-f785d1d1-9681-4248-b35d-df7a0e19f3c2'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:00.133725 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-f785d1d1-9681-4248-b35d-df7a0e19f3c2 admin admin] The token cache is being invalidate because project bcbf47cd5b4e4e2da1f5f0a67a394c44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:38:00.134163 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-f785d1d1-9681-4248-b35d-df7a0e19f3c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:00.134907 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-f785d1d1-9681-4248-b35d-df7a0e19f3c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:00.136790 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1322/2617] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:38:00 2022] DELETE /identity/v3/projects/bcbf47cd5b4e4e2da1f5f0a67a394c44 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:38:00.140525 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1087ef90-a8c2-4b97-96b1-594a46f4e3c7 service neutron] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:00.151611 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1087ef90-a8c2-4b97-96b1-594a46f4e3c7 service neutron] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:00.224303 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c3aae-43c8-4c47-b050-5d4cc0fce806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:00.225043 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c3aae-43c8-4c47-b050-5d4cc0fce806 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:00.225264 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c3aae-43c8-4c47-b050-5d4cc0fce806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:00.225533 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c3aae-43c8-4c47-b050-5d4cc0fce806 admin admin] PATH_INFO: `/v3/users/f5c7fcece78e476f98ee38391b4c51f2` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:00.226725 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678c3aae-43c8-4c47-b050-5d4cc0fce806 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5c7fcece78e476f98ee38391b4c51f2)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:00.228667 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678c3aae-43c8-4c47-b050-5d4cc0fce806 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:00.285239 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-678c3aae-43c8-4c47-b050-5d4cc0fce806 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5c7fcece78e476f98ee38391b4c51f2'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:00.294902 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-678c3aae-43c8-4c47-b050-5d4cc0fce806 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5c7fcece78e476f98ee38391b4c51f2'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:00.309049 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-678c3aae-43c8-4c47-b050-5d4cc0fce806 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5c7fcece78e476f98ee38391b4c51f2'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:00.310215 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-678c3aae-43c8-4c47-b050-5d4cc0fce806 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5c7fcece78e476f98ee38391b4c51f2'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:00.311275 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-678c3aae-43c8-4c47-b050-5d4cc0fce806 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5c7fcece78e476f98ee38391b4c51f2'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:00.313948 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:38:00.331393 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1296/2618] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:38:00 2022] DELETE /identity/v3/users/f5c7fcece78e476f98ee38391b4c51f2 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:38:00.645480 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f785d1d1-9681-4248-b35d-df7a0e19f3c2 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:00.646620 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-f785d1d1-9681-4248-b35d-df7a0e19f3c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:38:00.679174 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f785d1d1-9681-4248-b35d-df7a0e19f3c2 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:00.757020 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a613f2f-72a5-4d46-8a5b-5f9a62c03e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:00.757898 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a613f2f-72a5-4d46-8a5b-5f9a62c03e7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:00.758298 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a613f2f-72a5-4d46-8a5b-5f9a62c03e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:00.758658 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a613f2f-72a5-4d46-8a5b-5f9a62c03e7b admin admin] PATH_INFO: `/v3/projects/ff84114515b9403295b0760ee83b5964` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:00.760034 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a613f2f-72a5-4d46-8a5b-5f9a62c03e7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff84114515b9403295b0760ee83b5964)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:00.762234 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a613f2f-72a5-4d46-8a5b-5f9a62c03e7b admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:00.821133 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-2a613f2f-72a5-4d46-8a5b-5f9a62c03e7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff84114515b9403295b0760ee83b5964', 'request_id': 'req-2a613f2f-72a5-4d46-8a5b-5f9a62c03e7b'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:00.831293 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-2a613f2f-72a5-4d46-8a5b-5f9a62c03e7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff84114515b9403295b0760ee83b5964', 'request_id': 'req-2a613f2f-72a5-4d46-8a5b-5f9a62c03e7b'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:00.838901 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-2a613f2f-72a5-4d46-8a5b-5f9a62c03e7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff84114515b9403295b0760ee83b5964', 'request_id': 'req-2a613f2f-72a5-4d46-8a5b-5f9a62c03e7b'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:00.850738 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-2a613f2f-72a5-4d46-8a5b-5f9a62c03e7b admin admin] The token cache is being invalidate because project ff84114515b9403295b0760ee83b5964 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:38:00.851025 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-2a613f2f-72a5-4d46-8a5b-5f9a62c03e7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:00.851708 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-2a613f2f-72a5-4d46-8a5b-5f9a62c03e7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:00.853212 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1323/2619] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:38:00 2022] DELETE /identity/v3/projects/ff84114515b9403295b0760ee83b5964 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:38:00.858140 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f252f02-5428-4dc9-86b2-5cdaee8fceb8 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:00.858437 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f252f02-5428-4dc9-86b2-5cdaee8fceb8 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:00.858720 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f252f02-5428-4dc9-86b2-5cdaee8fceb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:00.883852 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-0f252f02-5428-4dc9-86b2-5cdaee8fceb8 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:38:00.885678 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-0f252f02-5428-4dc9-86b2-5cdaee8fceb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:38:00.961606 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1297/2620] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:38:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:38:00.969681 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12b277-21e3-44c8-b1ef-d42de1658c3b None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:00.969969 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12b277-21e3-44c8-b1ef-d42de1658c3b None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:00.970250 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12b277-21e3-44c8-b1ef-d42de1658c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:00.996245 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-ee12b277-21e3-44c8-b1ef-d42de1658c3b None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:38:00.997477 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-ee12b277-21e3-44c8-b1ef-d42de1658c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:38:01.011262 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1324/2621] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:38:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:38:01.013118 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f252f02-5428-4dc9-86b2-5cdaee8fceb8 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:01.025808 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f252f02-5428-4dc9-86b2-5cdaee8fceb8 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:01.030863 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef6be7-5e22-4ba5-9413-23c6ac37d1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:01.032042 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef6be7-5e22-4ba5-9413-23c6ac37d1d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:01.032427 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef6be7-5e22-4ba5-9413-23c6ac37d1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:01.032715 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef6be7-5e22-4ba5-9413-23c6ac37d1d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:01.033997 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ef6be7-5e22-4ba5-9413-23c6ac37d1d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:38:01.033997 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ef6be7-5e22-4ba5-9413-23c6ac37d1d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:01.035834 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ef6be7-5e22-4ba5-9413-23c6ac37d1d3 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:01.056598 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1298/2622] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 2 15:38:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:38:01.057726 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee12b277-21e3-44c8-b1ef-d42de1658c3b None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:01.067893 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee12b277-21e3-44c8-b1ef-d42de1658c3b None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:01.076758 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a94116a-82ac-4c89-9093-4a8f273959ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:01.077314 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94116a-82ac-4c89-9093-4a8f273959ef admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:01.077599 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94116a-82ac-4c89-9093-4a8f273959ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:01.078077 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94116a-82ac-4c89-9093-4a8f273959ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:01.078769 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a94116a-82ac-4c89-9093-4a8f273959ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:01.081433 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a94116a-82ac-4c89-9093-4a8f273959ef admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:01.139266 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1325/2623] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:38:01 2022] POST /identity/v3/projects => generated 385 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:38:01.140641 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef6be7-5e22-4ba5-9413-23c6ac37d1d3 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:01.152281 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef6be7-5e22-4ba5-9413-23c6ac37d1d3 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:01.220129 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866445e5-a3ca-4b25-9cf7-72347878f543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:01.221077 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866445e5-a3ca-4b25-9cf7-72347878f543 admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:01.221532 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866445e5-a3ca-4b25-9cf7-72347878f543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:01.222017 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866445e5-a3ca-4b25-9cf7-72347878f543 admin admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:01.222882 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866445e5-a3ca-4b25-9cf7-72347878f543 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:01.225019 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866445e5-a3ca-4b25-9cf7-72347878f543 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:01.254732 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1299/2624] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:38:01 2022] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:38:01.259655 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a94116a-82ac-4c89-9093-4a8f273959ef admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:01.270901 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a94116a-82ac-4c89-9093-4a8f273959ef admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:01.276712 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c23db7-f37a-4251-9a2a-da143a26c758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:01.277333 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c23db7-f37a-4251-9a2a-da143a26c758 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:01.277617 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c23db7-f37a-4251-9a2a-da143a26c758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:01.277900 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c23db7-f37a-4251-9a2a-da143a26c758 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:01.278598 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c23db7-f37a-4251-9a2a-da143a26c758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:01.280235 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c23db7-f37a-4251-9a2a-da143a26c758 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:01.293225 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1326/2625] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:38:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:38:01.297291 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866445e5-a3ca-4b25-9cf7-72347878f543 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:01.308392 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866445e5-a3ca-4b25-9cf7-72347878f543 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:01.313912 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0f961f-49a3-46db-a938-d2cde5572b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:01.314631 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f961f-49a3-46db-a938-d2cde5572b3b admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:01.314985 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f961f-49a3-46db-a938-d2cde5572b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:01.315385 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f961f-49a3-46db-a938-d2cde5572b3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:01.316150 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0f961f-49a3-46db-a938-d2cde5572b3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:01.317802 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0f961f-49a3-46db-a938-d2cde5572b3b admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:01.332413 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1300/2626] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:38:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:38:01.337028 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c23db7-f37a-4251-9a2a-da143a26c758 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:01.351141 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c23db7-f37a-4251-9a2a-da143a26c758 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:01.356112 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14df9a71-64f8-4c56-aa5c-942e5e501a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:01.357416 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df9a71-64f8-4c56-aa5c-942e5e501a78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:01.357707 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df9a71-64f8-4c56-aa5c-942e5e501a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:01.357988 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df9a71-64f8-4c56-aa5c-942e5e501a78 admin admin] PATH_INFO: `/v3/projects/f66a2fdb6f424290b6d625e823c29364/users/306cdd51c6a648acacd98f7310732f50/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:01.377177 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14df9a71-64f8-4c56-aa5c-942e5e501a78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f66a2fdb6f424290b6d625e823c29364, user_id=306cdd51c6a648acacd98f7310732f50, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:01.380328 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14df9a71-64f8-4c56-aa5c-942e5e501a78 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:01.398753 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1327/2627] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:38:01 2022] PUT /identity/v3/projects/f66a2fdb6f424290b6d625e823c29364/users/306cdd51c6a648acacd98f7310732f50/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:38:01.410773 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0f4af-ae2d-42e6-b2b4-a39ed8ee9742 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:01.411209 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0f4af-ae2d-42e6-b2b4-a39ed8ee9742 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:01.411605 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0f4af-ae2d-42e6-b2b4-a39ed8ee9742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:01.441273 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-b6f0f4af-ae2d-42e6-b2b4-a39ed8ee9742 None None] MFA Rules not processed for user `306cdd51c6a648acacd98f7310732f50`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:38:01.442687 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-b6f0f4af-ae2d-42e6-b2b4-a39ed8ee9742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:38:01.498219 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:38:01.525893 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1301/2628] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:38:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:38:01.527187 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14df9a71-64f8-4c56-aa5c-942e5e501a78 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:01.542249 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:38:01.607788 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14df9a71-64f8-4c56-aa5c-942e5e501a78 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:01.613478 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3f8568-35cc-4137-8872-aae5b47ef7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:01.614184 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f8568-35cc-4137-8872-aae5b47ef7f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:01.614473 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f8568-35cc-4137-8872-aae5b47ef7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:01.614749 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f8568-35cc-4137-8872-aae5b47ef7f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:01.616068 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3f8568-35cc-4137-8872-aae5b47ef7f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:01.618043 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3f8568-35cc-4137-8872-aae5b47ef7f5 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:01.646916 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1328/2629] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:38:01 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:38:01.660593 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f0f4af-ae2d-42e6-b2b4-a39ed8ee9742 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:01.674462 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f0f4af-ae2d-42e6-b2b4-a39ed8ee9742 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:01.746604 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4a69f3-7658-4f64-9129-2b7f88b3560a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:01.747258 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a69f3-7658-4f64-9129-2b7f88b3560a admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:01.747545 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a69f3-7658-4f64-9129-2b7f88b3560a admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:01.747824 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a69f3-7658-4f64-9129-2b7f88b3560a admin admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:01.748492 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4a69f3-7658-4f64-9129-2b7f88b3560a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:01.750411 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4a69f3-7658-4f64-9129-2b7f88b3560a admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:01.774278 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1302/2630] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:38:01 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:38:01.778236 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3f8568-35cc-4137-8872-aae5b47ef7f5 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:01.793223 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3f8568-35cc-4137-8872-aae5b47ef7f5 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:01.802412 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b612f3e-9972-4001-8595-e48c8dabc76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:01.803660 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b612f3e-9972-4001-8595-e48c8dabc76d admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:01.804040 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b612f3e-9972-4001-8595-e48c8dabc76d admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:01.804430 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b612f3e-9972-4001-8595-e48c8dabc76d admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:01.805197 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b612f3e-9972-4001-8595-e48c8dabc76d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:01.806887 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b612f3e-9972-4001-8595-e48c8dabc76d admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:01.823806 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1329/2631] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:38:01 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:38:01.827042 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4a69f3-7658-4f64-9129-2b7f88b3560a admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:01.837643 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4a69f3-7658-4f64-9129-2b7f88b3560a admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:01.842593 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d37b1d-5849-4733-be77-406ad28a10cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:01.843234 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d37b1d-5849-4733-be77-406ad28a10cd admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:01.843529 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d37b1d-5849-4733-be77-406ad28a10cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:01.843804 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d37b1d-5849-4733-be77-406ad28a10cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:01.844500 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d37b1d-5849-4733-be77-406ad28a10cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:01.846146 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d37b1d-5849-4733-be77-406ad28a10cd admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:01.857056 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1303/2632] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:38:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:38:01.862343 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b612f3e-9972-4001-8595-e48c8dabc76d admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:01.873587 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b612f3e-9972-4001-8595-e48c8dabc76d admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:01.880670 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5651f7-33f4-4670-aed3-c89640358a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:01.881422 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5651f7-33f4-4670-aed3-c89640358a4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:01.882198 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5651f7-33f4-4670-aed3-c89640358a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:01.882476 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5651f7-33f4-4670-aed3-c89640358a4d admin admin] PATH_INFO: `/v3/projects/2fa502f02c7e4760acedaccabc921b54/users/041ffc3de52c4afc9118432595e2cb1c/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:01.901835 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5651f7-33f4-4670-aed3-c89640358a4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fa502f02c7e4760acedaccabc921b54, user_id=041ffc3de52c4afc9118432595e2cb1c, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:01.904542 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5651f7-33f4-4670-aed3-c89640358a4d admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:01.919912 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1330/2633] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:38:01 2022] PUT /identity/v3/projects/2fa502f02c7e4760acedaccabc921b54/users/041ffc3de52c4afc9118432595e2cb1c/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:38:01.931067 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b7a49-90ce-46e7-8dd0-1a20b36b548c None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:01.931605 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b7a49-90ce-46e7-8dd0-1a20b36b548c None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:01.932069 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b7a49-90ce-46e7-8dd0-1a20b36b548c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:01.967043 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-542b7a49-90ce-46e7-8dd0-1a20b36b548c None None] MFA Rules not processed for user `041ffc3de52c4afc9118432595e2cb1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:38:01.968480 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-542b7a49-90ce-46e7-8dd0-1a20b36b548c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:38:02.046914 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1304/2634] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:38:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:38:02.048401 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5651f7-33f4-4670-aed3-c89640358a4d admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:02.127300 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5651f7-33f4-4670-aed3-c89640358a4d admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:02.132976 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb80a76-e084-4fdc-b237-b61074435dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:02.133734 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb80a76-e084-4fdc-b237-b61074435dc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:02.134022 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb80a76-e084-4fdc-b237-b61074435dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:02.134301 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb80a76-e084-4fdc-b237-b61074435dc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:02.134992 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb80a76-e084-4fdc-b237-b61074435dc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:02.140857 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb80a76-e084-4fdc-b237-b61074435dc7 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:02.201049 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1331/2635] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:38:02 2022] POST /identity/v3/projects => generated 387 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 15:38:02.205324 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b7a49-90ce-46e7-8dd0-1a20b36b548c None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:02.219662 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b7a49-90ce-46e7-8dd0-1a20b36b548c None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:02.279747 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:38:02.286969 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2894870-78f2-46d6-bc70-2c189b2f7df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:02.288261 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2894870-78f2-46d6-bc70-2c189b2f7df8 admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:02.288943 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2894870-78f2-46d6-bc70-2c189b2f7df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:02.289570 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2894870-78f2-46d6-bc70-2c189b2f7df8 admin admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:02.290841 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2894870-78f2-46d6-bc70-2c189b2f7df8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:02.293647 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2894870-78f2-46d6-bc70-2c189b2f7df8 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:02.327747 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb80a76-e084-4fdc-b237-b61074435dc7 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:02.335700 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1305/2636] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:38:02 2022] POST /identity/v3/users => generated 300 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:38:02.370085 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb80a76-e084-4fdc-b237-b61074435dc7 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:02.375843 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36af7859-0670-41ba-b697-df582531420f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:02.376685 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af7859-0670-41ba-b697-df582531420f admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:02.377206 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af7859-0670-41ba-b697-df582531420f admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:02.377761 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af7859-0670-41ba-b697-df582531420f admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:02.378724 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36af7859-0670-41ba-b697-df582531420f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:02.386310 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36af7859-0670-41ba-b697-df582531420f admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:02.399927 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1332/2637] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:38:02 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:38:02.404575 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2894870-78f2-46d6-bc70-2c189b2f7df8 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:02.417200 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2894870-78f2-46d6-bc70-2c189b2f7df8 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:02.426001 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61031ddc-c438-4b69-b5bd-9ee596682310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:02.427383 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61031ddc-c438-4b69-b5bd-9ee596682310 admin admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:02.427782 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61031ddc-c438-4b69-b5bd-9ee596682310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:02.428189 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61031ddc-c438-4b69-b5bd-9ee596682310 admin admin] PATH_INFO: `/v3/projects/5cb2a49d3bce40aaa397fb5f3e3f5085/users/d231910ad8a74aa4b5b4a3e81a382bb3/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:02.450599 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61031ddc-c438-4b69-b5bd-9ee596682310 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cb2a49d3bce40aaa397fb5f3e3f5085, user_id=d231910ad8a74aa4b5b4a3e81a382bb3, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:02.453281 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61031ddc-c438-4b69-b5bd-9ee596682310 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:02.469604 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1306/2638] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:38:02 2022] PUT /identity/v3/projects/5cb2a49d3bce40aaa397fb5f3e3f5085/users/d231910ad8a74aa4b5b4a3e81a382bb3/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:38:02.473528 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36af7859-0670-41ba-b697-df582531420f admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:02.487483 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36af7859-0670-41ba-b697-df582531420f admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:02.531526 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:38:02.560506 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e1bf99-12b2-4c35-8fd7-68526c591703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:02.561168 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1bf99-12b2-4c35-8fd7-68526c591703 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:02.561454 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1bf99-12b2-4c35-8fd7-68526c591703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:02.561724 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1bf99-12b2-4c35-8fd7-68526c591703 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:02.562416 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e1bf99-12b2-4c35-8fd7-68526c591703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:02.564087 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e1bf99-12b2-4c35-8fd7-68526c591703 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:02.576470 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1333/2639] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:38:02 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:38:02.580739 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61031ddc-c438-4b69-b5bd-9ee596682310 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:02.592730 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61031ddc-c438-4b69-b5bd-9ee596682310 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:02.598197 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2500bee-fc58-4457-9584-44401b634e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:02.598875 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2500bee-fc58-4457-9584-44401b634e95 admin admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:02.599160 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2500bee-fc58-4457-9584-44401b634e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:02.599495 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2500bee-fc58-4457-9584-44401b634e95 admin admin] PATH_INFO: `/v3/projects/5cb2a49d3bce40aaa397fb5f3e3f5085/users/d231910ad8a74aa4b5b4a3e81a382bb3/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:02.602101 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2500bee-fc58-4457-9584-44401b634e95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cb2a49d3bce40aaa397fb5f3e3f5085, user_id=d231910ad8a74aa4b5b4a3e81a382bb3, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:02.605042 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2500bee-fc58-4457-9584-44401b634e95 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:02.616330 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1307/2640] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:38:02 2022] PUT /identity/v3/projects/5cb2a49d3bce40aaa397fb5f3e3f5085/users/d231910ad8a74aa4b5b4a3e81a382bb3/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 15:38:02.628662 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a2260-78c9-444c-85d7-10f7a64c6d50 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:02.628888 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a2260-78c9-444c-85d7-10f7a64c6d50 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:02.629165 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a2260-78c9-444c-85d7-10f7a64c6d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:02.665068 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-af9a2260-78c9-444c-85d7-10f7a64c6d50 None None] MFA Rules not processed for user `d231910ad8a74aa4b5b4a3e81a382bb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:38:02.666289 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-af9a2260-78c9-444c-85d7-10f7a64c6d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:38:02.774575 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1334/2641] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:38:02 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:38:02.787319 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2500bee-fc58-4457-9584-44401b634e95 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:02.789089 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-c2500bee-fc58-4457-9584-44401b634e95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:38:02.859059 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2500bee-fc58-4457-9584-44401b634e95 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:02.865094 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb78fc-f041-45fd-b783-35c3a7267e18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:02.865860 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb78fc-f041-45fd-b783-35c3a7267e18 service cinder] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:02.866142 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb78fc-f041-45fd-b783-35c3a7267e18 service cinder] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:02.866416 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb78fc-f041-45fd-b783-35c3a7267e18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:02.876644 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cb78fc-f041-45fd-b783-35c3a7267e18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:02.878072 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cb78fc-f041-45fd-b783-35c3a7267e18 service cinder] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:02.899206 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1308/2642] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:38:02 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 15:38:03.533339 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a2260-78c9-444c-85d7-10f7a64c6d50 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:03.535198 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-af9a2260-78c9-444c-85d7-10f7a64c6d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:38:03.551297 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a2260-78c9-444c-85d7-10f7a64c6d50 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:03.558784 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa12dca-ee31-47a1-b809-1c46987ebb4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:03.559532 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa12dca-ee31-47a1-b809-1c46987ebb4e service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:03.559904 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa12dca-ee31-47a1-b809-1c46987ebb4e service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:03.560246 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa12dca-ee31-47a1-b809-1c46987ebb4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:03.649467 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa12dca-ee31-47a1-b809-1c46987ebb4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:03.650933 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa12dca-ee31-47a1-b809-1c46987ebb4e service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:03.663820 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1335/2643] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:38:03 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:38:04.586447 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb78fc-f041-45fd-b783-35c3a7267e18 service cinder] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:04.595359 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb78fc-f041-45fd-b783-35c3a7267e18 service cinder] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:04.598880 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aca400-5759-4b07-ab48-db55d7bbb344 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:04.599514 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aca400-5759-4b07-ab48-db55d7bbb344 service cinder] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:04.600442 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aca400-5759-4b07-ab48-db55d7bbb344 service cinder] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:04.600715 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aca400-5759-4b07-ab48-db55d7bbb344 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:04.602442 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-26aca400-5759-4b07-ab48-db55d7bbb344 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:38:04.676020 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aca400-5759-4b07-ab48-db55d7bbb344 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:04.677802 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aca400-5759-4b07-ab48-db55d7bbb344 service cinder] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:04.689072 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1309/2644] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:38:04 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:38:11.405779 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa12dca-ee31-47a1-b809-1c46987ebb4e service cinder] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:11.407198 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-8aa12dca-ee31-47a1-b809-1c46987ebb4e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:38:11.465822 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:38:11.499144 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa12dca-ee31-47a1-b809-1c46987ebb4e service cinder] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:11.504373 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c879c9fd-c58e-4fe2-9155-e48b418a7661 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57dfafee636a45ca98fe0e8bb13dd754', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:11.504990 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879c9fd-c58e-4fe2-9155-e48b418a7661 service placement] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:11.505273 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879c9fd-c58e-4fe2-9155-e48b418a7661 service placement] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:11.505609 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879c9fd-c58e-4fe2-9155-e48b418a7661 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:11.508277 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-c879c9fd-c58e-4fe2-9155-e48b418a7661 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:38:11.519870 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c879c9fd-c58e-4fe2-9155-e48b418a7661 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:11.521457 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c879c9fd-c58e-4fe2-9155-e48b418a7661 service placement] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:11.531164 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1336/2645] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:38:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:38:12.633616 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc671a-e6ab-476a-bf37-72e08e3a8a4b None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:12.634210 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc671a-e6ab-476a-bf37-72e08e3a8a4b None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:12.634210 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc671a-e6ab-476a-bf37-72e08e3a8a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:12.652511 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c879c9fd-c58e-4fe2-9155-e48b418a7661 service placement] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:12.653481 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-57bc671a-e6ab-476a-bf37-72e08e3a8a4b None None] MFA Rules not processed for user `cfb5e907ac594ba6a93d88d665c1d740`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:38:12.654100 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-c879c9fd-c58e-4fe2-9155-e48b418a7661 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:38:12.654679 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-57bc671a-e6ab-476a-bf37-72e08e3a8a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:38:12.661627 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1310/2646] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:38:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:38:12.713006 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c879c9fd-c58e-4fe2-9155-e48b418a7661 service placement] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:12.717220 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee2561-e515-4422-97ab-896dd6527aa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:12.717907 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee2561-e515-4422-97ab-896dd6527aa0 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:12.718213 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee2561-e515-4422-97ab-896dd6527aa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:12.718457 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee2561-e515-4422-97ab-896dd6527aa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:12.720428 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-e5ee2561-e515-4422-97ab-896dd6527aa0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:38:12.730604 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ee2561-e515-4422-97ab-896dd6527aa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:12.732016 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ee2561-e515-4422-97ab-896dd6527aa0 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:12.740304 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1337/2647] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:38:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 15:38:12.868927 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3e99e-ec49-446f-ac2f-3f6f38013d3a None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:12.869286 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3e99e-ec49-446f-ac2f-3f6f38013d3a None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:12.869620 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3e99e-ec49-446f-ac2f-3f6f38013d3a None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:12.871973 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1311/2648] 10.222.0.42 () {54 vars in 921 bytes} [Tue Aug 2 15:38:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:38:12.876830 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53505d-93e4-4dc1-b1f0-024cb9bbd5ff None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:12.877597 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53505d-93e4-4dc1-b1f0-024cb9bbd5ff None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:12.877932 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53505d-93e4-4dc1-b1f0-024cb9bbd5ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:12.914982 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-df53505d-93e4-4dc1-b1f0-024cb9bbd5ff None None] MFA Rules not processed for user `4c0865af59bf43dfa4c84213d7db53c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:38:12.916429 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-df53505d-93e4-4dc1-b1f0-024cb9bbd5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:38:13.012287 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1338/2649] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Aug 2 15:38:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:38:13.021080 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc3e99e-ec49-446f-ac2f-3f6f38013d3a None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:13.023532 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-5cc3e99e-ec49-446f-ac2f-3f6f38013d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:38:13.071239 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df53505d-93e4-4dc1-b1f0-024cb9bbd5ff None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:13.082404 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df53505d-93e4-4dc1-b1f0-024cb9bbd5ff None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:13.088081 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:38:13.090551 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c438a31-7a91-4e6c-b367-d262e3cd957e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:13.092559 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c438a31-7a91-4e6c-b367-d262e3cd957e service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:13.092842 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c438a31-7a91-4e6c-b367-d262e3cd957e service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:13.093199 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c438a31-7a91-4e6c-b367-d262e3cd957e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:13.127515 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc3e99e-ec49-446f-ac2f-3f6f38013d3a None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:13.133201 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63680fe9-695b-4fb2-9f3a-7b9d5af89403 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946af31d75ca41a2a4301e0294cf98f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:13.133833 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63680fe9-695b-4fb2-9f3a-7b9d5af89403 service glance] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:13.134116 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63680fe9-695b-4fb2-9f3a-7b9d5af89403 service glance] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:13.134395 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63680fe9-695b-4fb2-9f3a-7b9d5af89403 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:13.137234 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:38:13.151299 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63680fe9-695b-4fb2-9f3a-7b9d5af89403 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:13.157023 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63680fe9-695b-4fb2-9f3a-7b9d5af89403 service glance] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:13.165886 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1312/2650] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:38:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:38:13.174051 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c438a31-7a91-4e6c-b367-d262e3cd957e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:13.175661 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c438a31-7a91-4e6c-b367-d262e3cd957e service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:13.186113 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1339/2651] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:38:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:38:15.615915 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63680fe9-695b-4fb2-9f3a-7b9d5af89403 service glance] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:15.748192 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63680fe9-695b-4fb2-9f3a-7b9d5af89403 service glance] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:15.759399 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574bc237-42f9-4d85-9b37-bd78b35961f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:15.759612 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574bc237-42f9-4d85-9b37-bd78b35961f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:15.759775 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574bc237-42f9-4d85-9b37-bd78b35961f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:15.760280 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574bc237-42f9-4d85-9b37-bd78b35961f0 admin admin] PATH_INFO: `/v3/users/306cdd51c6a648acacd98f7310732f50` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:15.761783 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574bc237-42f9-4d85-9b37-bd78b35961f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=306cdd51c6a648acacd98f7310732f50)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:15.763850 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574bc237-42f9-4d85-9b37-bd78b35961f0 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:15.813115 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-574bc237-42f9-4d85-9b37-bd78b35961f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '306cdd51c6a648acacd98f7310732f50'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:15.821483 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-574bc237-42f9-4d85-9b37-bd78b35961f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '306cdd51c6a648acacd98f7310732f50'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:15.836514 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-574bc237-42f9-4d85-9b37-bd78b35961f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '306cdd51c6a648acacd98f7310732f50'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:15.837294 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-574bc237-42f9-4d85-9b37-bd78b35961f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '306cdd51c6a648acacd98f7310732f50'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:15.837953 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-574bc237-42f9-4d85-9b37-bd78b35961f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '306cdd51c6a648acacd98f7310732f50'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:15.854156 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1313/2652] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:38:15 2022] DELETE /identity/v3/users/306cdd51c6a648acacd98f7310732f50 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:38:15.861421 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d43cc-7f50-49ea-ae6c-cbab792bed88 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:15.864124 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d43cc-7f50-49ea-ae6c-cbab792bed88 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:15.864387 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d43cc-7f50-49ea-ae6c-cbab792bed88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:15.889965 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-488d43cc-7f50-49ea-ae6c-cbab792bed88 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:38:15.891619 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-488d43cc-7f50-49ea-ae6c-cbab792bed88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:38:15.966358 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1340/2653] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:38:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:38:16.016645 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574bc237-42f9-4d85-9b37-bd78b35961f0 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:16.018482 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-574bc237-42f9-4d85-9b37-bd78b35961f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:38:16.082423 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574bc237-42f9-4d85-9b37-bd78b35961f0 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:16.086659 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1b5d4-6650-4b81-b89b-278b84838e9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:16.087331 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1b5d4-6650-4b81-b89b-278b84838e9c service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:16.087618 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1b5d4-6650-4b81-b89b-278b84838e9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:16.087897 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1b5d4-6650-4b81-b89b-278b84838e9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:16.099248 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec1b5d4-6650-4b81-b89b-278b84838e9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:16.100669 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec1b5d4-6650-4b81-b89b-278b84838e9c service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:16.111951 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1314/2654] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:38:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:38:16.484217 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65944663-1ccb-4fcf-9d27-d177285f1803 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:16.484449 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65944663-1ccb-4fcf-9d27-d177285f1803 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:16.484727 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65944663-1ccb-4fcf-9d27-d177285f1803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:16.490983 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1b5d4-6650-4b81-b89b-278b84838e9c service neutron] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:16.493128 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-cec1b5d4-6650-4b81-b89b-278b84838e9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:38:16.508890 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-65944663-1ccb-4fcf-9d27-d177285f1803 None None] MFA Rules not processed for user `dfe8c00c0c3d4c4b8b6f36e39a3a2e71`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:38:16.510124 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-65944663-1ccb-4fcf-9d27-d177285f1803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:38:16.525674 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1b5d4-6650-4b81-b89b-278b84838e9c service neutron] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:16.532951 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b209c-4f34-43ef-8ef4-9315b2ff7f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:16.533770 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b209c-4f34-43ef-8ef4-9315b2ff7f70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:16.534208 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b209c-4f34-43ef-8ef4-9315b2ff7f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:16.535140 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b209c-4f34-43ef-8ef4-9315b2ff7f70 admin admin] PATH_INFO: `/v3/projects/f66a2fdb6f424290b6d625e823c29364` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:16.536552 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862b209c-4f34-43ef-8ef4-9315b2ff7f70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f66a2fdb6f424290b6d625e823c29364)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:16.539184 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862b209c-4f34-43ef-8ef4-9315b2ff7f70 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:16.541936 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:38:16.580131 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1341/2655] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Aug 2 15:38:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:38:16.596731 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65944663-1ccb-4fcf-9d27-d177285f1803 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:16.597251 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-862b209c-4f34-43ef-8ef4-9315b2ff7f70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f66a2fdb6f424290b6d625e823c29364', 'request_id': 'req-862b209c-4f34-43ef-8ef4-9315b2ff7f70'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:16.599101 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-65944663-1ccb-4fcf-9d27-d177285f1803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:38:16.608301 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-862b209c-4f34-43ef-8ef4-9315b2ff7f70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f66a2fdb6f424290b6d625e823c29364', 'request_id': 'req-862b209c-4f34-43ef-8ef4-9315b2ff7f70'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:16.618175 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-862b209c-4f34-43ef-8ef4-9315b2ff7f70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f66a2fdb6f424290b6d625e823c29364', 'request_id': 'req-862b209c-4f34-43ef-8ef4-9315b2ff7f70'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:16.631791 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-862b209c-4f34-43ef-8ef4-9315b2ff7f70 admin admin] The token cache is being invalidate because project f66a2fdb6f424290b6d625e823c29364 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80360) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:38:16.632085 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-862b209c-4f34-43ef-8ef4-9315b2ff7f70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:16.632976 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-862b209c-4f34-43ef-8ef4-9315b2ff7f70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:16.634604 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1315/2656] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:38:16 2022] DELETE /identity/v3/projects/f66a2fdb6f424290b6d625e823c29364 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:38:16.638752 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b209c-4f34-43ef-8ef4-9315b2ff7f70 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:16.641209 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-862b209c-4f34-43ef-8ef4-9315b2ff7f70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:38:16.683066 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65944663-1ccb-4fcf-9d27-d177285f1803 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:16.714917 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:38:16.720447 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b209c-4f34-43ef-8ef4-9315b2ff7f70 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:16.728417 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc126a-2898-4001-8cf7-a0f3d1c2b6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:16.730236 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc126a-2898-4001-8cf7-a0f3d1c2b6b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:16.730784 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc126a-2898-4001-8cf7-a0f3d1c2b6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:16.731165 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc126a-2898-4001-8cf7-a0f3d1c2b6b9 admin admin] PATH_INFO: `/v3/users/041ffc3de52c4afc9118432595e2cb1c` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:16.732620 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edc126a-2898-4001-8cf7-a0f3d1c2b6b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=041ffc3de52c4afc9118432595e2cb1c)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:16.734792 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edc126a-2898-4001-8cf7-a0f3d1c2b6b9 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:16.758355 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba1df1-9d6d-43f2-8bed-578a75f07765 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4de590df474c8b95f2b1193f7dbcb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:16.759891 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba1df1-9d6d-43f2-8bed-578a75f07765 service swift] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:16.759891 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba1df1-9d6d-43f2-8bed-578a75f07765 service swift] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:16.759891 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba1df1-9d6d-43f2-8bed-578a75f07765 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:16.761654 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-39ba1df1-9d6d-43f2-8bed-578a75f07765 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:38:16.796155 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-8edc126a-2898-4001-8cf7-a0f3d1c2b6b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '041ffc3de52c4afc9118432595e2cb1c'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:16.804988 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-8edc126a-2898-4001-8cf7-a0f3d1c2b6b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '041ffc3de52c4afc9118432595e2cb1c'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:16.819236 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-8edc126a-2898-4001-8cf7-a0f3d1c2b6b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '041ffc3de52c4afc9118432595e2cb1c'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:16.820602 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-8edc126a-2898-4001-8cf7-a0f3d1c2b6b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '041ffc3de52c4afc9118432595e2cb1c'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:16.821378 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-8edc126a-2898-4001-8cf7-a0f3d1c2b6b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '041ffc3de52c4afc9118432595e2cb1c'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:16.831417 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ba1df1-9d6d-43f2-8bed-578a75f07765 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:16.833135 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ba1df1-9d6d-43f2-8bed-578a75f07765 service swift] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:16.837945 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1316/2657] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:38:16 2022] DELETE /identity/v3/users/041ffc3de52c4afc9118432595e2cb1c => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 15:38:16.842730 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1342/2658] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Aug 2 15:38:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 02 15:38:17.433583 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc126a-2898-4001-8cf7-a0f3d1c2b6b9 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:17.435113 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-8edc126a-2898-4001-8cf7-a0f3d1c2b6b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:38:17.459819 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:38:17.552671 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc126a-2898-4001-8cf7-a0f3d1c2b6b9 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:17.559254 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb3d160-6f59-4262-ab9a-32f947f25993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:17.559254 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3d160-6f59-4262-ab9a-32f947f25993 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:17.559563 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3d160-6f59-4262-ab9a-32f947f25993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:17.561858 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3d160-6f59-4262-ab9a-32f947f25993 admin admin] PATH_INFO: `/v3/projects/2fa502f02c7e4760acedaccabc921b54` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:17.562608 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb3d160-6f59-4262-ab9a-32f947f25993 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fa502f02c7e4760acedaccabc921b54)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:17.564635 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb3d160-6f59-4262-ab9a-32f947f25993 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:17.618510 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-fbb3d160-6f59-4262-ab9a-32f947f25993 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fa502f02c7e4760acedaccabc921b54', 'request_id': 'req-fbb3d160-6f59-4262-ab9a-32f947f25993'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:17.626140 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-fbb3d160-6f59-4262-ab9a-32f947f25993 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fa502f02c7e4760acedaccabc921b54', 'request_id': 'req-fbb3d160-6f59-4262-ab9a-32f947f25993'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:17.633238 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-fbb3d160-6f59-4262-ab9a-32f947f25993 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fa502f02c7e4760acedaccabc921b54', 'request_id': 'req-fbb3d160-6f59-4262-ab9a-32f947f25993'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:17.643593 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-fbb3d160-6f59-4262-ab9a-32f947f25993 admin admin] The token cache is being invalidate because project 2fa502f02c7e4760acedaccabc921b54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80360) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:38:17.643905 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-fbb3d160-6f59-4262-ab9a-32f947f25993 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:17.644517 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-fbb3d160-6f59-4262-ab9a-32f947f25993 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:17.646022 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1317/2659] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:38:17 2022] DELETE /identity/v3/projects/2fa502f02c7e4760acedaccabc921b54 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:38:17.650902 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba1df1-9d6d-43f2-8bed-578a75f07765 service swift] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:17.661794 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba1df1-9d6d-43f2-8bed-578a75f07765 service swift] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:17.753677 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1228ea-2f59-4ab8-8ad9-0c0b3596e1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:17.754491 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1228ea-2f59-4ab8-8ad9-0c0b3596e1d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:17.754864 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1228ea-2f59-4ab8-8ad9-0c0b3596e1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:17.755295 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1228ea-2f59-4ab8-8ad9-0c0b3596e1d3 admin admin] PATH_INFO: `/v3/users/d231910ad8a74aa4b5b4a3e81a382bb3` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:17.756591 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1228ea-2f59-4ab8-8ad9-0c0b3596e1d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d231910ad8a74aa4b5b4a3e81a382bb3)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:17.759166 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1228ea-2f59-4ab8-8ad9-0c0b3596e1d3 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:17.809761 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-3f1228ea-2f59-4ab8-8ad9-0c0b3596e1d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd231910ad8a74aa4b5b4a3e81a382bb3'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:17.822072 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-3f1228ea-2f59-4ab8-8ad9-0c0b3596e1d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd231910ad8a74aa4b5b4a3e81a382bb3'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:17.822801 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-3f1228ea-2f59-4ab8-8ad9-0c0b3596e1d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd231910ad8a74aa4b5b4a3e81a382bb3'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:17.827372 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:38:17.830799 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-3f1228ea-2f59-4ab8-8ad9-0c0b3596e1d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd231910ad8a74aa4b5b4a3e81a382bb3'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:17.839185 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-3f1228ea-2f59-4ab8-8ad9-0c0b3596e1d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd231910ad8a74aa4b5b4a3e81a382bb3'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:17.846170 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1343/2660] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:38:17 2022] DELETE /identity/v3/users/d231910ad8a74aa4b5b4a3e81a382bb3 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:38:18.254460 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb3d160-6f59-4262-ab9a-32f947f25993 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:18.256408 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-fbb3d160-6f59-4262-ab9a-32f947f25993 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:38:18.274570 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb3d160-6f59-4262-ab9a-32f947f25993 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:18.372392 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d61aa76-0099-43a7-94c7-e24165dcf9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:18.373048 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d61aa76-0099-43a7-94c7-e24165dcf9a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:18.373330 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d61aa76-0099-43a7-94c7-e24165dcf9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:18.373607 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d61aa76-0099-43a7-94c7-e24165dcf9a5 admin admin] PATH_INFO: `/v3/projects/5cb2a49d3bce40aaa397fb5f3e3f5085` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:18.374775 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d61aa76-0099-43a7-94c7-e24165dcf9a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cb2a49d3bce40aaa397fb5f3e3f5085)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:18.376697 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d61aa76-0099-43a7-94c7-e24165dcf9a5 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:18.431551 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:38:18.436124 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-3d61aa76-0099-43a7-94c7-e24165dcf9a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cb2a49d3bce40aaa397fb5f3e3f5085', 'request_id': 'req-3d61aa76-0099-43a7-94c7-e24165dcf9a5'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:18.446345 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-3d61aa76-0099-43a7-94c7-e24165dcf9a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cb2a49d3bce40aaa397fb5f3e3f5085', 'request_id': 'req-3d61aa76-0099-43a7-94c7-e24165dcf9a5'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:18.463747 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-3d61aa76-0099-43a7-94c7-e24165dcf9a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cb2a49d3bce40aaa397fb5f3e3f5085', 'request_id': 'req-3d61aa76-0099-43a7-94c7-e24165dcf9a5'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:18.494356 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-3d61aa76-0099-43a7-94c7-e24165dcf9a5 admin admin] The token cache is being invalidate because project 5cb2a49d3bce40aaa397fb5f3e3f5085 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80360) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:38:18.495326 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-3d61aa76-0099-43a7-94c7-e24165dcf9a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:18.500723 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-3d61aa76-0099-43a7-94c7-e24165dcf9a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:18.503394 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1318/2661] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:38:18 2022] DELETE /identity/v3/projects/5cb2a49d3bce40aaa397fb5f3e3f5085 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:38:18.510138 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9776cc-1f68-4744-84aa-1daed1b3fe4a None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:18.510637 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9776cc-1f68-4744-84aa-1daed1b3fe4a None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:18.511073 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9776cc-1f68-4744-84aa-1daed1b3fe4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:18.540793 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-5b9776cc-1f68-4744-84aa-1daed1b3fe4a None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:38:18.542139 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-5b9776cc-1f68-4744-84aa-1daed1b3fe4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:38:18.675156 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1344/2662] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:38:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:38:18.677067 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e828b6-60af-4bd3-bb63-ad922872d092 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:18.677502 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e828b6-60af-4bd3-bb63-ad922872d092 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:18.677699 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e828b6-60af-4bd3-bb63-ad922872d092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:18.699878 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-90e828b6-60af-4bd3-bb63-ad922872d092 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:38:18.701106 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-90e828b6-60af-4bd3-bb63-ad922872d092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:38:18.709410 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1319/2663] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:38:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:38:18.713708 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9776cc-1f68-4744-84aa-1daed1b3fe4a None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:18.723501 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9776cc-1f68-4744-84aa-1daed1b3fe4a None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:18.728895 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b5f8b5-1772-4c46-a5c1-6934f286a9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:18.729626 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5f8b5-1772-4c46-a5c1-6934f286a9fd admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:18.729993 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5f8b5-1772-4c46-a5c1-6934f286a9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:18.730376 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5f8b5-1772-4c46-a5c1-6934f286a9fd admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:18.731231 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b5f8b5-1772-4c46-a5c1-6934f286a9fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:38:18.731624 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b5f8b5-1772-4c46-a5c1-6934f286a9fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:18.733440 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b5f8b5-1772-4c46-a5c1-6934f286a9fd admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:18.752090 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1345/2664] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 2 15:38:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:38:18.756152 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e828b6-60af-4bd3-bb63-ad922872d092 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:18.765914 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e828b6-60af-4bd3-bb63-ad922872d092 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:18.770826 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6e6916-ed52-4997-ba9d-1bbe946e23b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:18.771571 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e6916-ed52-4997-ba9d-1bbe946e23b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:18.771919 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e6916-ed52-4997-ba9d-1bbe946e23b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:18.772264 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e6916-ed52-4997-ba9d-1bbe946e23b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:18.773550 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6e6916-ed52-4997-ba9d-1bbe946e23b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:18.783318 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6e6916-ed52-4997-ba9d-1bbe946e23b0 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:18.816359 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1320/2665] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:38:18 2022] POST /identity/v3/projects => generated 383 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:38:18.822507 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b5f8b5-1772-4c46-a5c1-6934f286a9fd admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:18.833486 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b5f8b5-1772-4c46-a5c1-6934f286a9fd admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:18.905240 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5290a117-b653-4140-8eba-c76fadd43f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:18.905839 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290a117-b653-4140-8eba-c76fadd43f8d admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:18.906127 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290a117-b653-4140-8eba-c76fadd43f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:18.906403 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290a117-b653-4140-8eba-c76fadd43f8d admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:18.907093 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5290a117-b653-4140-8eba-c76fadd43f8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:18.909054 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5290a117-b653-4140-8eba-c76fadd43f8d admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:18.932361 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1346/2666] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:38:18 2022] POST /identity/v3/users => generated 292 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:38:18.936318 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6e6916-ed52-4997-ba9d-1bbe946e23b0 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:18.947682 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6e6916-ed52-4997-ba9d-1bbe946e23b0 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:18.952970 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9de045-b9cf-4d9a-b6f4-872592df7457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:18.953784 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9de045-b9cf-4d9a-b6f4-872592df7457 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:18.954310 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9de045-b9cf-4d9a-b6f4-872592df7457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:18.954595 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9de045-b9cf-4d9a-b6f4-872592df7457 admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:18.955685 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9de045-b9cf-4d9a-b6f4-872592df7457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:18.957521 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9de045-b9cf-4d9a-b6f4-872592df7457 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:18.968966 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1321/2667] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 15:38:18.973062 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5290a117-b653-4140-8eba-c76fadd43f8d admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:18.983918 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5290a117-b653-4140-8eba-c76fadd43f8d admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:18.988595 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5c9798-a4d2-4046-95d8-2a1a7a649109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:18.989214 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c9798-a4d2-4046-95d8-2a1a7a649109 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:18.989499 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c9798-a4d2-4046-95d8-2a1a7a649109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:18.989778 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c9798-a4d2-4046-95d8-2a1a7a649109 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:18.990474 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5c9798-a4d2-4046-95d8-2a1a7a649109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:18.992422 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5c9798-a4d2-4046-95d8-2a1a7a649109 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:19.006233 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1347/2668] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:38:19.010667 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9de045-b9cf-4d9a-b6f4-872592df7457 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:19.021586 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9de045-b9cf-4d9a-b6f4-872592df7457 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:19.027690 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b5c21-4cfb-4000-8d2d-002a12992fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:19.028445 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b5c21-4cfb-4000-8d2d-002a12992fc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:19.028828 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b5c21-4cfb-4000-8d2d-002a12992fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:19.029170 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b5c21-4cfb-4000-8d2d-002a12992fc7 admin admin] PATH_INFO: `/v3/projects/2cc4bb82a21146d5b9e2f233f300f2a6/users/2935c06ab9cd46368f0920cc761f2380/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:19.049327 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915b5c21-4cfb-4000-8d2d-002a12992fc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cc4bb82a21146d5b9e2f233f300f2a6, user_id=2935c06ab9cd46368f0920cc761f2380, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:19.052104 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915b5c21-4cfb-4000-8d2d-002a12992fc7 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:19.067775 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1322/2669] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:38:19 2022] PUT /identity/v3/projects/2cc4bb82a21146d5b9e2f233f300f2a6/users/2935c06ab9cd46368f0920cc761f2380/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:38:19.078759 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6df10-c60c-49ab-b238-3fe8a1d414c2 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:19.079055 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6df10-c60c-49ab-b238-3fe8a1d414c2 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:19.079386 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6df10-c60c-49ab-b238-3fe8a1d414c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:19.109627 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-e9f6df10-c60c-49ab-b238-3fe8a1d414c2 None None] MFA Rules not processed for user `2935c06ab9cd46368f0920cc761f2380`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:38:19.110934 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-e9f6df10-c60c-49ab-b238-3fe8a1d414c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:38:19.168692 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:38:19.201108 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1348/2670] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:38:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:38:19.202224 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b5c21-4cfb-4000-8d2d-002a12992fc7 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:19.296928 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b5c21-4cfb-4000-8d2d-002a12992fc7 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:19.301941 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cef70d-67bd-4dd4-8468-a6f7e4187ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:19.302572 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cef70d-67bd-4dd4-8468-a6f7e4187ca8 admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:19.302894 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cef70d-67bd-4dd4-8468-a6f7e4187ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:19.303170 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cef70d-67bd-4dd4-8468-a6f7e4187ca8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:19.303876 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cef70d-67bd-4dd4-8468-a6f7e4187ca8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:19.307550 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cef70d-67bd-4dd4-8468-a6f7e4187ca8 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:19.351400 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1323/2671] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:38:19 2022] POST /identity/v3/projects => generated 381 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 15:38:19.353698 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6df10-c60c-49ab-b238-3fe8a1d414c2 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:19.374536 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6df10-c60c-49ab-b238-3fe8a1d414c2 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:19.463454 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff41bd-7737-407d-a0a6-bf61b31e4ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:19.464088 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff41bd-7737-407d-a0a6-bf61b31e4ddc admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:19.464373 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff41bd-7737-407d-a0a6-bf61b31e4ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:19.464653 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff41bd-7737-407d-a0a6-bf61b31e4ddc admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:19.465336 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ff41bd-7737-407d-a0a6-bf61b31e4ddc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:19.467552 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ff41bd-7737-407d-a0a6-bf61b31e4ddc admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:19.488713 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1349/2672] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:38:19 2022] POST /identity/v3/users => generated 297 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 15:38:19.493406 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cef70d-67bd-4dd4-8468-a6f7e4187ca8 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:19.504497 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cef70d-67bd-4dd4-8468-a6f7e4187ca8 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:19.509841 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a26789-2600-49be-8f8e-68f982414f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:19.510478 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a26789-2600-49be-8f8e-68f982414f58 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:19.510780 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a26789-2600-49be-8f8e-68f982414f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:19.511052 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a26789-2600-49be-8f8e-68f982414f58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:19.511766 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a26789-2600-49be-8f8e-68f982414f58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:19.513384 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a26789-2600-49be-8f8e-68f982414f58 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:19.524946 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1324/2673] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:38:19.528667 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff41bd-7737-407d-a0a6-bf61b31e4ddc admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:19.540059 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff41bd-7737-407d-a0a6-bf61b31e4ddc admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:19.546249 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8247add-1d11-4600-9a04-ea67c35e13a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:19.547275 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8247add-1d11-4600-9a04-ea67c35e13a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:19.547563 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8247add-1d11-4600-9a04-ea67c35e13a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:19.548037 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8247add-1d11-4600-9a04-ea67c35e13a9 admin admin] PATH_INFO: `/v3/projects/c1ed616c5da84a799eebf4ffa8499b25/users/2890441f97e34f449440d02f0b5438d2/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:19.569266 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8247add-1d11-4600-9a04-ea67c35e13a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1ed616c5da84a799eebf4ffa8499b25, user_id=2890441f97e34f449440d02f0b5438d2, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:19.572587 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8247add-1d11-4600-9a04-ea67c35e13a9 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:19.586257 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1350/2674] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:38:19 2022] PUT /identity/v3/projects/c1ed616c5da84a799eebf4ffa8499b25/users/2890441f97e34f449440d02f0b5438d2/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:38:19.590326 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a26789-2600-49be-8f8e-68f982414f58 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:19.600530 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a26789-2600-49be-8f8e-68f982414f58 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:19.646356 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:38:19.667761 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9f6269-4a0c-41d3-a08e-945d995b3438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:19.668561 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9f6269-4a0c-41d3-a08e-945d995b3438 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:19.668969 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9f6269-4a0c-41d3-a08e-945d995b3438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:19.669323 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9f6269-4a0c-41d3-a08e-945d995b3438 admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:19.670244 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9f6269-4a0c-41d3-a08e-945d995b3438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:19.672090 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9f6269-4a0c-41d3-a08e-945d995b3438 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:19.690495 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1325/2675] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:38:19.696028 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8247add-1d11-4600-9a04-ea67c35e13a9 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:19.711643 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8247add-1d11-4600-9a04-ea67c35e13a9 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:19.722034 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b66b7e-5f83-4707-a97a-c9e8b8eeefdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:19.722997 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b66b7e-5f83-4707-a97a-c9e8b8eeefdd admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:19.723477 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b66b7e-5f83-4707-a97a-c9e8b8eeefdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:19.723912 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b66b7e-5f83-4707-a97a-c9e8b8eeefdd admin admin] PATH_INFO: `/v3/projects/c1ed616c5da84a799eebf4ffa8499b25/users/2890441f97e34f449440d02f0b5438d2/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:19.735395 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b66b7e-5f83-4707-a97a-c9e8b8eeefdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1ed616c5da84a799eebf4ffa8499b25, user_id=2890441f97e34f449440d02f0b5438d2, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:19.739542 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b66b7e-5f83-4707-a97a-c9e8b8eeefdd admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:19.755681 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1351/2676] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:38:19 2022] PUT /identity/v3/projects/c1ed616c5da84a799eebf4ffa8499b25/users/2890441f97e34f449440d02f0b5438d2/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:38:19.768049 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd5a57-e450-4845-9a84-67abb1010c6f None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:19.768684 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd5a57-e450-4845-9a84-67abb1010c6f None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:19.768970 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd5a57-e450-4845-9a84-67abb1010c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:19.798575 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-34bd5a57-e450-4845-9a84-67abb1010c6f None None] MFA Rules not processed for user `2890441f97e34f449440d02f0b5438d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:38:19.800135 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-34bd5a57-e450-4845-9a84-67abb1010c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:38:19.886827 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1326/2677] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:38:19 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:38:19.894435 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b66b7e-5f83-4707-a97a-c9e8b8eeefdd admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:19.896143 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-87b66b7e-5f83-4707-a97a-c9e8b8eeefdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:38:19.970365 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b66b7e-5f83-4707-a97a-c9e8b8eeefdd admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:19.974054 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f490d42-7a4f-4e5c-8c71-1e805a4de41e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:19.974666 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f490d42-7a4f-4e5c-8c71-1e805a4de41e service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:19.974950 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f490d42-7a4f-4e5c-8c71-1e805a4de41e service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:19.975238 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f490d42-7a4f-4e5c-8c71-1e805a4de41e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:19.984726 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f490d42-7a4f-4e5c-8c71-1e805a4de41e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:19.986167 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f490d42-7a4f-4e5c-8c71-1e805a4de41e service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:20.001368 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1352/2678] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:38:19 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:38:20.118395 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd5a57-e450-4845-9a84-67abb1010c6f None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:20.128769 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd5a57-e450-4845-9a84-67abb1010c6f None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:20.132566 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc65b67-1c09-4fef-ba7a-25e5a3c9676a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:20.133567 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc65b67-1c09-4fef-ba7a-25e5a3c9676a service cinder] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:20.133906 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc65b67-1c09-4fef-ba7a-25e5a3c9676a service cinder] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:20.134198 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc65b67-1c09-4fef-ba7a-25e5a3c9676a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:20.216687 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc65b67-1c09-4fef-ba7a-25e5a3c9676a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:20.218126 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc65b67-1c09-4fef-ba7a-25e5a3c9676a service cinder] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:20.228003 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1327/2679] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:38:20 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:38:22.922927 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f490d42-7a4f-4e5c-8c71-1e805a4de41e service cinder] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:22.970940 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:38:22.997371 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f490d42-7a4f-4e5c-8c71-1e805a4de41e service cinder] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:23.001917 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dee9ac-8f77-4f14-81ec-3cd7c8af0acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:23.002558 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dee9ac-8f77-4f14-81ec-3cd7c8af0acb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:23.002842 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dee9ac-8f77-4f14-81ec-3cd7c8af0acb admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:23.003123 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dee9ac-8f77-4f14-81ec-3cd7c8af0acb admin admin] PATH_INFO: `/v3/users/2935c06ab9cd46368f0920cc761f2380` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:23.004330 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dee9ac-8f77-4f14-81ec-3cd7c8af0acb admin admin] RBAC: Authorizing `identity:delete_user(user_id=2935c06ab9cd46368f0920cc761f2380)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:23.006253 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dee9ac-8f77-4f14-81ec-3cd7c8af0acb admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:23.075435 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-72dee9ac-8f77-4f14-81ec-3cd7c8af0acb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2935c06ab9cd46368f0920cc761f2380'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:23.099378 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-72dee9ac-8f77-4f14-81ec-3cd7c8af0acb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2935c06ab9cd46368f0920cc761f2380'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:23.100509 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-72dee9ac-8f77-4f14-81ec-3cd7c8af0acb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2935c06ab9cd46368f0920cc761f2380'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:23.109989 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-72dee9ac-8f77-4f14-81ec-3cd7c8af0acb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2935c06ab9cd46368f0920cc761f2380'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:23.124786 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-72dee9ac-8f77-4f14-81ec-3cd7c8af0acb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2935c06ab9cd46368f0920cc761f2380'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:23.131442 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1353/2680] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:38:22 2022] DELETE /identity/v3/users/2935c06ab9cd46368f0920cc761f2380 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:38:23.135882 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f63dda-26c8-4dad-9bc0-71970c869eb4 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:23.136382 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f63dda-26c8-4dad-9bc0-71970c869eb4 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:23.136483 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f63dda-26c8-4dad-9bc0-71970c869eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:23.171465 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-b3f63dda-26c8-4dad-9bc0-71970c869eb4 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:38:23.172700 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-b3f63dda-26c8-4dad-9bc0-71970c869eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:38:23.248298 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1328/2681] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:38:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:38:23.258471 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dee9ac-8f77-4f14-81ec-3cd7c8af0acb admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:23.260127 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-72dee9ac-8f77-4f14-81ec-3cd7c8af0acb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:38:23.339421 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dee9ac-8f77-4f14-81ec-3cd7c8af0acb admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:23.343392 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5914cc4-09a4-4b1c-8025-fd8fcdcbf557 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:23.344044 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5914cc4-09a4-4b1c-8025-fd8fcdcbf557 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:23.344328 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5914cc4-09a4-4b1c-8025-fd8fcdcbf557 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:23.344606 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5914cc4-09a4-4b1c-8025-fd8fcdcbf557 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:23.362082 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5914cc4-09a4-4b1c-8025-fd8fcdcbf557 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:23.364159 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5914cc4-09a4-4b1c-8025-fd8fcdcbf557 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:23.381954 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1354/2682] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:38:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:38:23.718366 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f63dda-26c8-4dad-9bc0-71970c869eb4 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:23.720118 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-b3f63dda-26c8-4dad-9bc0-71970c869eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:38:23.728956 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:38:23.735645 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f63dda-26c8-4dad-9bc0-71970c869eb4 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:23.740652 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65e23bf-84ad-45b3-a43a-6a7e79577ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:23.741337 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e23bf-84ad-45b3-a43a-6a7e79577ca4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:23.741629 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e23bf-84ad-45b3-a43a-6a7e79577ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:23.741913 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e23bf-84ad-45b3-a43a-6a7e79577ca4 admin admin] PATH_INFO: `/v3/projects/2cc4bb82a21146d5b9e2f233f300f2a6` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:23.743627 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65e23bf-84ad-45b3-a43a-6a7e79577ca4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cc4bb82a21146d5b9e2f233f300f2a6)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:23.745693 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65e23bf-84ad-45b3-a43a-6a7e79577ca4 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:23.809036 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-d65e23bf-84ad-45b3-a43a-6a7e79577ca4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cc4bb82a21146d5b9e2f233f300f2a6', 'request_id': 'req-d65e23bf-84ad-45b3-a43a-6a7e79577ca4'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:23.817469 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-d65e23bf-84ad-45b3-a43a-6a7e79577ca4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cc4bb82a21146d5b9e2f233f300f2a6', 'request_id': 'req-d65e23bf-84ad-45b3-a43a-6a7e79577ca4'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:23.825085 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-d65e23bf-84ad-45b3-a43a-6a7e79577ca4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cc4bb82a21146d5b9e2f233f300f2a6', 'request_id': 'req-d65e23bf-84ad-45b3-a43a-6a7e79577ca4'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:23.836450 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-d65e23bf-84ad-45b3-a43a-6a7e79577ca4 admin admin] The token cache is being invalidate because project 2cc4bb82a21146d5b9e2f233f300f2a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80360) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:38:23.836721 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-d65e23bf-84ad-45b3-a43a-6a7e79577ca4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:23.837372 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-d65e23bf-84ad-45b3-a43a-6a7e79577ca4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:23.838902 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1329/2683] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:38:23 2022] DELETE /identity/v3/projects/2cc4bb82a21146d5b9e2f233f300f2a6 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:38:23.842931 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5914cc4-09a4-4b1c-8025-fd8fcdcbf557 service neutron] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:23.852754 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5914cc4-09a4-4b1c-8025-fd8fcdcbf557 service neutron] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:23.922026 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf27ae-8367-4211-a22f-9bce08022836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:23.922892 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf27ae-8367-4211-a22f-9bce08022836 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:23.923476 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf27ae-8367-4211-a22f-9bce08022836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:23.924078 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf27ae-8367-4211-a22f-9bce08022836 admin admin] PATH_INFO: `/v3/users/2890441f97e34f449440d02f0b5438d2` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:23.928465 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cf27ae-8367-4211-a22f-9bce08022836 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2890441f97e34f449440d02f0b5438d2)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:23.931369 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cf27ae-8367-4211-a22f-9bce08022836 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:23.933867 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:38:23.995369 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-b5cf27ae-8367-4211-a22f-9bce08022836 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2890441f97e34f449440d02f0b5438d2'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:24.016201 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-b5cf27ae-8367-4211-a22f-9bce08022836 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2890441f97e34f449440d02f0b5438d2'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:24.017112 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-b5cf27ae-8367-4211-a22f-9bce08022836 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2890441f97e34f449440d02f0b5438d2'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:24.026219 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-b5cf27ae-8367-4211-a22f-9bce08022836 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2890441f97e34f449440d02f0b5438d2'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:24.036271 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-b5cf27ae-8367-4211-a22f-9bce08022836 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2890441f97e34f449440d02f0b5438d2'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:24.044728 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1355/2684] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:38:23 2022] DELETE /identity/v3/users/2890441f97e34f449440d02f0b5438d2 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:38:24.396937 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65e23bf-84ad-45b3-a43a-6a7e79577ca4 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:24.398987 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-d65e23bf-84ad-45b3-a43a-6a7e79577ca4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:38:24.419455 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65e23bf-84ad-45b3-a43a-6a7e79577ca4 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:24.511071 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a47617-c8c5-4396-a74e-c6e5d527c006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:24.511905 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a47617-c8c5-4396-a74e-c6e5d527c006 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:24.512257 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a47617-c8c5-4396-a74e-c6e5d527c006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:24.512572 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a47617-c8c5-4396-a74e-c6e5d527c006 admin admin] PATH_INFO: `/v3/projects/c1ed616c5da84a799eebf4ffa8499b25` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:24.513992 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a47617-c8c5-4396-a74e-c6e5d527c006 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1ed616c5da84a799eebf4ffa8499b25)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:24.516029 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a47617-c8c5-4396-a74e-c6e5d527c006 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:24.603061 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-96a47617-c8c5-4396-a74e-c6e5d527c006 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1ed616c5da84a799eebf4ffa8499b25', 'request_id': 'req-96a47617-c8c5-4396-a74e-c6e5d527c006'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:24.611114 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-96a47617-c8c5-4396-a74e-c6e5d527c006 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1ed616c5da84a799eebf4ffa8499b25', 'request_id': 'req-96a47617-c8c5-4396-a74e-c6e5d527c006'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:24.618025 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-96a47617-c8c5-4396-a74e-c6e5d527c006 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1ed616c5da84a799eebf4ffa8499b25', 'request_id': 'req-96a47617-c8c5-4396-a74e-c6e5d527c006'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:24.628425 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-96a47617-c8c5-4396-a74e-c6e5d527c006 admin admin] The token cache is being invalidate because project c1ed616c5da84a799eebf4ffa8499b25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80360) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:38:24.628711 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-96a47617-c8c5-4396-a74e-c6e5d527c006 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:24.629344 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-96a47617-c8c5-4396-a74e-c6e5d527c006 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:24.630860 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1330/2685] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:38:24 2022] DELETE /identity/v3/projects/c1ed616c5da84a799eebf4ffa8499b25 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:38:24.636146 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd6ba5-0875-4ebf-8de5-80e0653d8ec6 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:24.636435 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd6ba5-0875-4ebf-8de5-80e0653d8ec6 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:24.636720 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd6ba5-0875-4ebf-8de5-80e0653d8ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:24.657336 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-cecd6ba5-0875-4ebf-8de5-80e0653d8ec6 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:38:24.658610 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-cecd6ba5-0875-4ebf-8de5-80e0653d8ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:38:24.730557 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1356/2686] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:38:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:38:24.733383 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b5275-7661-422a-b45c-e967a120792c None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:24.733770 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b5275-7661-422a-b45c-e967a120792c None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:24.734203 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b5275-7661-422a-b45c-e967a120792c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:24.756786 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-0b3b5275-7661-422a-b45c-e967a120792c None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:38:24.758582 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-0b3b5275-7661-422a-b45c-e967a120792c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:38:24.766733 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1331/2687] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:38:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:38:24.771140 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecd6ba5-0875-4ebf-8de5-80e0653d8ec6 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:24.781218 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecd6ba5-0875-4ebf-8de5-80e0653d8ec6 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:24.786001 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b683f-d7c5-4dfd-9284-d686fbea1ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:24.786630 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b683f-d7c5-4dfd-9284-d686fbea1ea9 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:24.786933 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b683f-d7c5-4dfd-9284-d686fbea1ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:24.787192 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b683f-d7c5-4dfd-9284-d686fbea1ea9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:24.787971 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82b683f-d7c5-4dfd-9284-d686fbea1ea9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:38:24.788318 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82b683f-d7c5-4dfd-9284-d686fbea1ea9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:24.789932 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82b683f-d7c5-4dfd-9284-d686fbea1ea9 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:24.808522 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1357/2688] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 2 15:38:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:38:24.809445 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3b5275-7661-422a-b45c-e967a120792c None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:24.820416 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3b5275-7661-422a-b45c-e967a120792c None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:24.825878 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8c98e-6308-49bb-918c-46803a6e8e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:24.826699 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8c98e-6308-49bb-918c-46803a6e8e56 admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:24.826990 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8c98e-6308-49bb-918c-46803a6e8e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:24.827299 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8c98e-6308-49bb-918c-46803a6e8e56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:24.827978 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8c98e-6308-49bb-918c-46803a6e8e56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:24.829903 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8c98e-6308-49bb-918c-46803a6e8e56 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:24.836232 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:38:24.862313 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1332/2689] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:38:24 2022] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 15:38:24.865916 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b683f-d7c5-4dfd-9284-d686fbea1ea9 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:24.876064 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b683f-d7c5-4dfd-9284-d686fbea1ea9 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:24.954898 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c6f425-b533-4f46-ad40-627005f5f80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:24.955656 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6f425-b533-4f46-ad40-627005f5f80f admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:24.955974 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6f425-b533-4f46-ad40-627005f5f80f admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:24.956377 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6f425-b533-4f46-ad40-627005f5f80f admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:24.957122 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c6f425-b533-4f46-ad40-627005f5f80f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:24.959140 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c6f425-b533-4f46-ad40-627005f5f80f admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:24.970663 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:38:24.982821 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1358/2690] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:38:24 2022] POST /identity/v3/users => generated 290 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:38:24.987005 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8c98e-6308-49bb-918c-46803a6e8e56 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:24.997887 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8c98e-6308-49bb-918c-46803a6e8e56 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:25.002416 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf30bde-adfb-4dcf-831d-cbbba1cc2ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:25.003021 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf30bde-adfb-4dcf-831d-cbbba1cc2ab8 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:25.003373 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf30bde-adfb-4dcf-831d-cbbba1cc2ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:25.003652 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf30bde-adfb-4dcf-831d-cbbba1cc2ab8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:25.004339 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf30bde-adfb-4dcf-831d-cbbba1cc2ab8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:25.005908 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf30bde-adfb-4dcf-831d-cbbba1cc2ab8 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:25.016855 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1333/2691] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:38:25.020982 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c6f425-b533-4f46-ad40-627005f5f80f admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:25.044439 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c6f425-b533-4f46-ad40-627005f5f80f admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:25.052632 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c0114-d820-45d9-90c6-b48220979e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:25.054244 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c0114-d820-45d9-90c6-b48220979e34 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:25.054807 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c0114-d820-45d9-90c6-b48220979e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:25.055414 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c0114-d820-45d9-90c6-b48220979e34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:25.056733 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492c0114-d820-45d9-90c6-b48220979e34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:25.059778 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492c0114-d820-45d9-90c6-b48220979e34 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:25.080262 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1359/2692] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:38:25.084507 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf30bde-adfb-4dcf-831d-cbbba1cc2ab8 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:25.097230 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf30bde-adfb-4dcf-831d-cbbba1cc2ab8 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:25.101950 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2efdcb0-89ce-4337-8707-e4853e785b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:25.102612 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2efdcb0-89ce-4337-8707-e4853e785b61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:25.102898 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2efdcb0-89ce-4337-8707-e4853e785b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:25.103178 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2efdcb0-89ce-4337-8707-e4853e785b61 admin admin] PATH_INFO: `/v3/projects/56851dde5f324d21b995a48ab3376909/users/016a689dc63c42a698a6a45920983e95/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:25.125830 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2efdcb0-89ce-4337-8707-e4853e785b61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56851dde5f324d21b995a48ab3376909, user_id=016a689dc63c42a698a6a45920983e95, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:25.129669 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2efdcb0-89ce-4337-8707-e4853e785b61 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:25.150448 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1334/2693] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:38:25 2022] PUT /identity/v3/projects/56851dde5f324d21b995a48ab3376909/users/016a689dc63c42a698a6a45920983e95/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:38:25.160832 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a48ed-7550-4471-bdb9-1884511b8db8 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:25.161130 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a48ed-7550-4471-bdb9-1884511b8db8 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:25.161443 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a48ed-7550-4471-bdb9-1884511b8db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:25.190231 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-fb2a48ed-7550-4471-bdb9-1884511b8db8 None None] MFA Rules not processed for user `016a689dc63c42a698a6a45920983e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:38:25.191546 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-fb2a48ed-7550-4471-bdb9-1884511b8db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:38:25.257916 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1360/2694] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:38:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:38:25.262468 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2efdcb0-89ce-4337-8707-e4853e785b61 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:25.328429 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2efdcb0-89ce-4337-8707-e4853e785b61 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:25.333086 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7cf7a7-4911-4cde-9b0d-a13d11c4418d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:25.333702 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7cf7a7-4911-4cde-9b0d-a13d11c4418d admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:25.334002 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7cf7a7-4911-4cde-9b0d-a13d11c4418d admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:25.334278 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7cf7a7-4911-4cde-9b0d-a13d11c4418d admin admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:25.334934 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7cf7a7-4911-4cde-9b0d-a13d11c4418d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:25.337298 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7cf7a7-4911-4cde-9b0d-a13d11c4418d admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:25.367074 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1335/2695] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:38:25 2022] POST /identity/v3/projects => generated 379 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:38:25.371180 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a48ed-7550-4471-bdb9-1884511b8db8 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:25.383320 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a48ed-7550-4471-bdb9-1884511b8db8 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:25.451898 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ec131-94e0-473b-8259-baefcdc1f544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:25.452526 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ec131-94e0-473b-8259-baefcdc1f544 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:25.452809 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ec131-94e0-473b-8259-baefcdc1f544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:25.453082 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ec131-94e0-473b-8259-baefcdc1f544 admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:25.453743 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6ec131-94e0-473b-8259-baefcdc1f544 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:25.455806 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6ec131-94e0-473b-8259-baefcdc1f544 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:25.480288 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1361/2696] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:38:25 2022] POST /identity/v3/users => generated 296 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:38:25.481452 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7cf7a7-4911-4cde-9b0d-a13d11c4418d admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:25.493286 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7cf7a7-4911-4cde-9b0d-a13d11c4418d admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:25.497961 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57684832-dd1c-4c94-8c6e-bfff1e4c6c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:25.498716 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57684832-dd1c-4c94-8c6e-bfff1e4c6c1b admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:25.499003 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57684832-dd1c-4c94-8c6e-bfff1e4c6c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:25.499308 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57684832-dd1c-4c94-8c6e-bfff1e4c6c1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:25.500006 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57684832-dd1c-4c94-8c6e-bfff1e4c6c1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:25.501597 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57684832-dd1c-4c94-8c6e-bfff1e4c6c1b admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:25.512523 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1336/2697] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 15:38:25.516801 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ec131-94e0-473b-8259-baefcdc1f544 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:25.527237 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ec131-94e0-473b-8259-baefcdc1f544 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:25.531894 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeee32c-5c13-4dc4-b71d-81eb7dc9edc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:25.532558 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeee32c-5c13-4dc4-b71d-81eb7dc9edc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:25.532841 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeee32c-5c13-4dc4-b71d-81eb7dc9edc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:25.533122 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeee32c-5c13-4dc4-b71d-81eb7dc9edc7 admin admin] PATH_INFO: `/v3/projects/b415897165514cdd95ac87931e562acc/users/6782d360481b41f7b693d60d54240219/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:25.552195 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeee32c-5c13-4dc4-b71d-81eb7dc9edc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b415897165514cdd95ac87931e562acc, user_id=6782d360481b41f7b693d60d54240219, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:25.554962 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeee32c-5c13-4dc4-b71d-81eb7dc9edc7 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:25.568610 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1362/2698] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:38:25 2022] PUT /identity/v3/projects/b415897165514cdd95ac87931e562acc/users/6782d360481b41f7b693d60d54240219/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 15:38:25.572740 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57684832-dd1c-4c94-8c6e-bfff1e4c6c1b admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:25.582648 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57684832-dd1c-4c94-8c6e-bfff1e4c6c1b admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:25.638760 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a2ad5-31c9-4ca2-96f1-ca3d981cfbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:25.639422 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a2ad5-31c9-4ca2-96f1-ca3d981cfbf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:25.639692 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a2ad5-31c9-4ca2-96f1-ca3d981cfbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:25.639968 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a2ad5-31c9-4ca2-96f1-ca3d981cfbf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:25.640656 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33a2ad5-31c9-4ca2-96f1-ca3d981cfbf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:25.642228 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33a2ad5-31c9-4ca2-96f1-ca3d981cfbf4 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:25.652752 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1337/2699] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 15:38:25.656970 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeee32c-5c13-4dc4-b71d-81eb7dc9edc7 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:25.668132 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeee32c-5c13-4dc4-b71d-81eb7dc9edc7 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:25.672820 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b22494-271e-4d46-8d13-85196a4dc90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:25.673738 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b22494-271e-4d46-8d13-85196a4dc90b admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:25.674017 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b22494-271e-4d46-8d13-85196a4dc90b admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:25.674294 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b22494-271e-4d46-8d13-85196a4dc90b admin admin] PATH_INFO: `/v3/projects/b415897165514cdd95ac87931e562acc/users/6782d360481b41f7b693d60d54240219/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:25.676338 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b22494-271e-4d46-8d13-85196a4dc90b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b415897165514cdd95ac87931e562acc, user_id=6782d360481b41f7b693d60d54240219, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:25.678977 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b22494-271e-4d46-8d13-85196a4dc90b admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:25.691943 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1363/2700] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:38:25 2022] PUT /identity/v3/projects/b415897165514cdd95ac87931e562acc/users/6782d360481b41f7b693d60d54240219/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:38:25.703272 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa2ee1d-1428-498f-9657-76bafd5a09f4 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:25.703690 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa2ee1d-1428-498f-9657-76bafd5a09f4 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:25.704067 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa2ee1d-1428-498f-9657-76bafd5a09f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:25.733176 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-baa2ee1d-1428-498f-9657-76bafd5a09f4 None None] MFA Rules not processed for user `6782d360481b41f7b693d60d54240219`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:38:25.734392 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-baa2ee1d-1428-498f-9657-76bafd5a09f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:38:25.743657 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:38:25.805148 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1338/2701] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:38:25 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:38:25.815843 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b22494-271e-4d46-8d13-85196a4dc90b admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:25.817536 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-51b22494-271e-4d46-8d13-85196a4dc90b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:38:25.848792 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:38:25.877145 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b22494-271e-4d46-8d13-85196a4dc90b admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:25.880843 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dbdd17-90b0-47a2-9b5d-cb38c4f88556 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:25.881482 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dbdd17-90b0-47a2-9b5d-cb38c4f88556 service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:25.881768 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dbdd17-90b0-47a2-9b5d-cb38c4f88556 service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:25.882563 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dbdd17-90b0-47a2-9b5d-cb38c4f88556 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:25.891547 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dbdd17-90b0-47a2-9b5d-cb38c4f88556 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:25.892931 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dbdd17-90b0-47a2-9b5d-cb38c4f88556 service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:25.902978 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1364/2702] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:38:25 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:38:26.269153 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa2ee1d-1428-498f-9657-76bafd5a09f4 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:26.331326 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa2ee1d-1428-498f-9657-76bafd5a09f4 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:26.335854 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c6076-add5-4f95-9dd9-2f9b3f8b836e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:26.336488 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c6076-add5-4f95-9dd9-2f9b3f8b836e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:26.336769 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c6076-add5-4f95-9dd9-2f9b3f8b836e admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:26.337041 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c6076-add5-4f95-9dd9-2f9b3f8b836e admin admin] PATH_INFO: `/v3/users/016a689dc63c42a698a6a45920983e95` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:26.338185 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c6076-add5-4f95-9dd9-2f9b3f8b836e admin admin] RBAC: Authorizing `identity:delete_user(user_id=016a689dc63c42a698a6a45920983e95)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:26.340106 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c6076-add5-4f95-9dd9-2f9b3f8b836e admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:26.385073 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-f41c6076-add5-4f95-9dd9-2f9b3f8b836e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '016a689dc63c42a698a6a45920983e95'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:26.395436 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-f41c6076-add5-4f95-9dd9-2f9b3f8b836e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '016a689dc63c42a698a6a45920983e95'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:26.409273 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-f41c6076-add5-4f95-9dd9-2f9b3f8b836e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '016a689dc63c42a698a6a45920983e95'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:26.410190 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-f41c6076-add5-4f95-9dd9-2f9b3f8b836e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '016a689dc63c42a698a6a45920983e95'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:26.411154 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-f41c6076-add5-4f95-9dd9-2f9b3f8b836e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '016a689dc63c42a698a6a45920983e95'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:26.428589 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1339/2703] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:38:26 2022] DELETE /identity/v3/users/016a689dc63c42a698a6a45920983e95 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:38:26.434477 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c98dd-2f6e-47b5-bf90-25edef91f501 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:26.434953 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c98dd-2f6e-47b5-bf90-25edef91f501 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:26.435055 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c98dd-2f6e-47b5-bf90-25edef91f501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:26.454887 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-766c98dd-2f6e-47b5-bf90-25edef91f501 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:38:26.456114 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-766c98dd-2f6e-47b5-bf90-25edef91f501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:38:26.514074 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1365/2704] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:38:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:38:26.524425 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c6076-add5-4f95-9dd9-2f9b3f8b836e admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:26.526700 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-f41c6076-add5-4f95-9dd9-2f9b3f8b836e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:38:26.560800 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:38:26.590759 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c6076-add5-4f95-9dd9-2f9b3f8b836e admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:26.594506 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c29c3-e782-453a-b447-5fd9c16ac0d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:26.595131 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c29c3-e782-453a-b447-5fd9c16ac0d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:26.595478 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c29c3-e782-453a-b447-5fd9c16ac0d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:26.595754 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c29c3-e782-453a-b447-5fd9c16ac0d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:26.604920 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13c29c3-e782-453a-b447-5fd9c16ac0d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:26.606345 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13c29c3-e782-453a-b447-5fd9c16ac0d5 service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:26.617151 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1340/2705] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:38:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:38:27.005967 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c98dd-2f6e-47b5-bf90-25edef91f501 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:27.007727 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-766c98dd-2f6e-47b5-bf90-25edef91f501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:38:27.019628 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c98dd-2f6e-47b5-bf90-25edef91f501 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:27.025026 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839bb350-9a72-44d5-b2f9-0d5be8ba14c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:27.025676 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839bb350-9a72-44d5-b2f9-0d5be8ba14c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:27.025957 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839bb350-9a72-44d5-b2f9-0d5be8ba14c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:27.026230 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839bb350-9a72-44d5-b2f9-0d5be8ba14c4 admin admin] PATH_INFO: `/v3/projects/56851dde5f324d21b995a48ab3376909` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:27.027424 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839bb350-9a72-44d5-b2f9-0d5be8ba14c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56851dde5f324d21b995a48ab3376909)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:27.029739 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839bb350-9a72-44d5-b2f9-0d5be8ba14c4 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:27.088080 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-839bb350-9a72-44d5-b2f9-0d5be8ba14c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56851dde5f324d21b995a48ab3376909', 'request_id': 'req-839bb350-9a72-44d5-b2f9-0d5be8ba14c4'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:27.095402 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-839bb350-9a72-44d5-b2f9-0d5be8ba14c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56851dde5f324d21b995a48ab3376909', 'request_id': 'req-839bb350-9a72-44d5-b2f9-0d5be8ba14c4'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:27.102277 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-839bb350-9a72-44d5-b2f9-0d5be8ba14c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56851dde5f324d21b995a48ab3376909', 'request_id': 'req-839bb350-9a72-44d5-b2f9-0d5be8ba14c4'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:27.112637 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-839bb350-9a72-44d5-b2f9-0d5be8ba14c4 admin admin] The token cache is being invalidate because project 56851dde5f324d21b995a48ab3376909 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:38:27.112926 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-839bb350-9a72-44d5-b2f9-0d5be8ba14c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:27.113556 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-839bb350-9a72-44d5-b2f9-0d5be8ba14c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:27.115052 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1366/2706] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:38:27 2022] DELETE /identity/v3/projects/56851dde5f324d21b995a48ab3376909 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:38:27.119482 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c29c3-e782-453a-b447-5fd9c16ac0d5 service neutron] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:27.131351 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c29c3-e782-453a-b447-5fd9c16ac0d5 service neutron] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:27.187644 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f56e711-a470-4fa9-837a-9f53327abe65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:27.188276 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f56e711-a470-4fa9-837a-9f53327abe65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:27.188557 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f56e711-a470-4fa9-837a-9f53327abe65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:27.188826 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f56e711-a470-4fa9-837a-9f53327abe65 admin admin] PATH_INFO: `/v3/users/6782d360481b41f7b693d60d54240219` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:27.189964 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f56e711-a470-4fa9-837a-9f53327abe65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6782d360481b41f7b693d60d54240219)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:27.192000 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f56e711-a470-4fa9-837a-9f53327abe65 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:27.238499 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-6f56e711-a470-4fa9-837a-9f53327abe65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6782d360481b41f7b693d60d54240219'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:27.245843 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-6f56e711-a470-4fa9-837a-9f53327abe65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6782d360481b41f7b693d60d54240219'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:27.258051 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-6f56e711-a470-4fa9-837a-9f53327abe65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6782d360481b41f7b693d60d54240219'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:27.258717 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-6f56e711-a470-4fa9-837a-9f53327abe65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6782d360481b41f7b693d60d54240219'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:27.259353 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-6f56e711-a470-4fa9-837a-9f53327abe65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6782d360481b41f7b693d60d54240219'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:27.271855 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1341/2707] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:38:27 2022] DELETE /identity/v3/users/6782d360481b41f7b693d60d54240219 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:38:27.535939 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839bb350-9a72-44d5-b2f9-0d5be8ba14c4 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:27.537371 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-839bb350-9a72-44d5-b2f9-0d5be8ba14c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:38:27.552515 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839bb350-9a72-44d5-b2f9-0d5be8ba14c4 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:27.602485 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:38:27.614058 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4781837-21cd-4517-a712-ca54957977f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:27.614796 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4781837-21cd-4517-a712-ca54957977f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:27.615079 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4781837-21cd-4517-a712-ca54957977f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:27.615479 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4781837-21cd-4517-a712-ca54957977f4 admin admin] PATH_INFO: `/v3/projects/b415897165514cdd95ac87931e562acc` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:27.617215 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4781837-21cd-4517-a712-ca54957977f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b415897165514cdd95ac87931e562acc)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:27.619204 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4781837-21cd-4517-a712-ca54957977f4 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:27.666808 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-f4781837-21cd-4517-a712-ca54957977f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b415897165514cdd95ac87931e562acc', 'request_id': 'req-f4781837-21cd-4517-a712-ca54957977f4'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:27.675041 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-f4781837-21cd-4517-a712-ca54957977f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b415897165514cdd95ac87931e562acc', 'request_id': 'req-f4781837-21cd-4517-a712-ca54957977f4'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:27.682228 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-f4781837-21cd-4517-a712-ca54957977f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b415897165514cdd95ac87931e562acc', 'request_id': 'req-f4781837-21cd-4517-a712-ca54957977f4'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:27.692811 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-f4781837-21cd-4517-a712-ca54957977f4 admin admin] The token cache is being invalidate because project b415897165514cdd95ac87931e562acc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:38:27.693267 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-f4781837-21cd-4517-a712-ca54957977f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:27.693962 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-f4781837-21cd-4517-a712-ca54957977f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:27.695534 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1367/2708] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:38:27 2022] DELETE /identity/v3/projects/b415897165514cdd95ac87931e562acc => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 15:38:27.700304 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e8933-0028-4368-aa8b-a92f09a0b10b None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:27.700874 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e8933-0028-4368-aa8b-a92f09a0b10b None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:27.700874 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e8933-0028-4368-aa8b-a92f09a0b10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:27.720458 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-b49e8933-0028-4368-aa8b-a92f09a0b10b None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:38:27.721587 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-b49e8933-0028-4368-aa8b-a92f09a0b10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:38:27.771566 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:38:27.793492 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1342/2709] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:38:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:38:27.802725 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a7eac-5a66-4f5b-9f8d-303f3401d33f None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:27.803722 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a7eac-5a66-4f5b-9f8d-303f3401d33f None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:27.804036 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a7eac-5a66-4f5b-9f8d-303f3401d33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:27.829186 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-c70a7eac-5a66-4f5b-9f8d-303f3401d33f None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:38:27.830419 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-c70a7eac-5a66-4f5b-9f8d-303f3401d33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:38:27.839020 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1368/2710] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:38:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:38:27.843536 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49e8933-0028-4368-aa8b-a92f09a0b10b None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:27.854411 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49e8933-0028-4368-aa8b-a92f09a0b10b None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:27.859268 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b0c291-aa6f-43cd-8b97-e7dc2f36e80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:27.859929 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0c291-aa6f-43cd-8b97-e7dc2f36e80a admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:27.860220 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0c291-aa6f-43cd-8b97-e7dc2f36e80a admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:27.860500 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0c291-aa6f-43cd-8b97-e7dc2f36e80a admin admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:27.861208 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b0c291-aa6f-43cd-8b97-e7dc2f36e80a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:38:27.861520 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b0c291-aa6f-43cd-8b97-e7dc2f36e80a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:27.863151 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b0c291-aa6f-43cd-8b97-e7dc2f36e80a admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:27.879500 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1343/2711] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 2 15:38:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 15:38:27.880981 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70a7eac-5a66-4f5b-9f8d-303f3401d33f None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:27.890824 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70a7eac-5a66-4f5b-9f8d-303f3401d33f None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:27.895653 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa9fb68-289e-4942-a835-6d4f5dcf2ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:27.896282 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9fb68-289e-4942-a835-6d4f5dcf2ec2 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:27.896573 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9fb68-289e-4942-a835-6d4f5dcf2ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:27.896851 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9fb68-289e-4942-a835-6d4f5dcf2ec2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:27.898046 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa9fb68-289e-4942-a835-6d4f5dcf2ec2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:27.900039 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa9fb68-289e-4942-a835-6d4f5dcf2ec2 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:27.931356 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1369/2712] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:38:27 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:38:27.935978 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b0c291-aa6f-43cd-8b97-e7dc2f36e80a admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:27.946696 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b0c291-aa6f-43cd-8b97-e7dc2f36e80a admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:28.007167 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723269ea-65be-46bb-bc13-82e68301b7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:28.007871 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723269ea-65be-46bb-bc13-82e68301b7c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:28.008297 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723269ea-65be-46bb-bc13-82e68301b7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:28.008607 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723269ea-65be-46bb-bc13-82e68301b7c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:28.009351 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723269ea-65be-46bb-bc13-82e68301b7c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:28.011336 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723269ea-65be-46bb-bc13-82e68301b7c6 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:28.037323 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1344/2713] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:38:27 2022] POST /identity/v3/users => generated 286 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 15:38:28.039301 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa9fb68-289e-4942-a835-6d4f5dcf2ec2 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:28.050379 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa9fb68-289e-4942-a835-6d4f5dcf2ec2 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:28.055107 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e3f41c-4a52-4db5-9b22-c41552dcce68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:28.055796 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e3f41c-4a52-4db5-9b22-c41552dcce68 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:28.056084 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e3f41c-4a52-4db5-9b22-c41552dcce68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:28.056356 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e3f41c-4a52-4db5-9b22-c41552dcce68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:28.057051 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e3f41c-4a52-4db5-9b22-c41552dcce68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:28.058674 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e3f41c-4a52-4db5-9b22-c41552dcce68 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:28.069498 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1370/2714] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:38:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:38:28.073486 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723269ea-65be-46bb-bc13-82e68301b7c6 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:28.084077 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723269ea-65be-46bb-bc13-82e68301b7c6 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:28.089649 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32bec72-93bf-48d5-8e59-f62347611123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:28.090306 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32bec72-93bf-48d5-8e59-f62347611123 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:28.090595 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32bec72-93bf-48d5-8e59-f62347611123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:28.090874 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32bec72-93bf-48d5-8e59-f62347611123 admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:28.091612 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32bec72-93bf-48d5-8e59-f62347611123 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:28.093216 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32bec72-93bf-48d5-8e59-f62347611123 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:28.108162 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1345/2715] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:38:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 15:38:28.112585 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e3f41c-4a52-4db5-9b22-c41552dcce68 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:28.134609 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e3f41c-4a52-4db5-9b22-c41552dcce68 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:28.140502 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767eec54-e4bc-49e9-9231-c361554819ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:28.141169 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767eec54-e4bc-49e9-9231-c361554819ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:28.141453 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767eec54-e4bc-49e9-9231-c361554819ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:28.141733 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767eec54-e4bc-49e9-9231-c361554819ed admin admin] PATH_INFO: `/v3/projects/1614b25de7d64849960e792103b2a7d1/users/b86724ab098846499445fc648e498e36/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:28.162499 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767eec54-e4bc-49e9-9231-c361554819ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=1614b25de7d64849960e792103b2a7d1, user_id=b86724ab098846499445fc648e498e36, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:28.165295 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767eec54-e4bc-49e9-9231-c361554819ed admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:28.185289 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1371/2716] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:38:28 2022] PUT /identity/v3/projects/1614b25de7d64849960e792103b2a7d1/users/b86724ab098846499445fc648e498e36/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:38:28.190938 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03009a6d-7ee0-448b-b1fb-c89f0a931290 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:28.191181 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03009a6d-7ee0-448b-b1fb-c89f0a931290 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:28.191837 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03009a6d-7ee0-448b-b1fb-c89f0a931290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:28.220452 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-03009a6d-7ee0-448b-b1fb-c89f0a931290 None None] MFA Rules not processed for user `b86724ab098846499445fc648e498e36`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:38:28.221656 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-03009a6d-7ee0-448b-b1fb-c89f0a931290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:38:28.289105 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1346/2717] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:38:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:38:28.300826 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767eec54-e4bc-49e9-9231-c361554819ed admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:28.302658 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-767eec54-e4bc-49e9-9231-c361554819ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:38:28.364189 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767eec54-e4bc-49e9-9231-c361554819ed admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:28.368262 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e98c9b-b6e6-48c7-a906-6807b6daa1ff service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946af31d75ca41a2a4301e0294cf98f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:28.368971 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e98c9b-b6e6-48c7-a906-6807b6daa1ff service glance] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:28.369252 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e98c9b-b6e6-48c7-a906-6807b6daa1ff service glance] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:28.369524 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e98c9b-b6e6-48c7-a906-6807b6daa1ff service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:28.378169 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e98c9b-b6e6-48c7-a906-6807b6daa1ff service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:28.379755 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e98c9b-b6e6-48c7-a906-6807b6daa1ff service glance] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:28.388963 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1372/2718] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:38:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:38:34.820695 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03009a6d-7ee0-448b-b1fb-c89f0a931290 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:34.822141 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-03009a6d-7ee0-448b-b1fb-c89f0a931290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:38:34.869486 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:38:34.881711 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03009a6d-7ee0-448b-b1fb-c89f0a931290 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:34.885937 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf08b26-c15b-4749-aad2-5b6527d22be7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:34.886567 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf08b26-c15b-4749-aad2-5b6527d22be7 service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:34.886852 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf08b26-c15b-4749-aad2-5b6527d22be7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:34.887131 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf08b26-c15b-4749-aad2-5b6527d22be7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:34.888940 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-1cf08b26-c15b-4749-aad2-5b6527d22be7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:38:34.958009 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf08b26-c15b-4749-aad2-5b6527d22be7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:34.959491 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf08b26-c15b-4749-aad2-5b6527d22be7 service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:34.969942 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1347/2719] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:38:34 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:38:38.385017 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=80,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:38:40.568482 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8fc9f-d583-4b00-bb3f-ac593aaa5769 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:40.569128 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8fc9f-d583-4b00-bb3f-ac593aaa5769 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:40.569128 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8fc9f-d583-4b00-bb3f-ac593aaa5769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:40.589496 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-72d8fc9f-d583-4b00-bb3f-ac593aaa5769 None None] MFA Rules not processed for user `dfe8c00c0c3d4c4b8b6f36e39a3a2e71`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:38:40.590831 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-72d8fc9f-d583-4b00-bb3f-ac593aaa5769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:38:40.648309 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1373/2720] 10.222.0.42 () {58 vars in 967 bytes} [Tue Aug 2 15:38:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:38:40.661066 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf08b26-c15b-4749-aad2-5b6527d22be7 service neutron] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:40.662534 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-1cf08b26-c15b-4749-aad2-5b6527d22be7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:38:40.734998 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf08b26-c15b-4749-aad2-5b6527d22be7 service neutron] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:40.740018 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d63d3a-2de3-43be-af52-7b4efb234f58 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4de590df474c8b95f2b1193f7dbcb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:40.740664 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d63d3a-2de3-43be-af52-7b4efb234f58 service swift] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:40.740969 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d63d3a-2de3-43be-af52-7b4efb234f58 service swift] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:40.741783 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d63d3a-2de3-43be-af52-7b4efb234f58 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:40.756460 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d63d3a-2de3-43be-af52-7b4efb234f58 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:40.758905 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d63d3a-2de3-43be-af52-7b4efb234f58 service swift] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:40.768652 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1348/2721] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Aug 2 15:38:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 15:38:50.641470 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=25 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:38:50.764180 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=62 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:38:58.266942 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8fc9f-d583-4b00-bb3f-ac593aaa5769 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:58.328947 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8fc9f-d583-4b00-bb3f-ac593aaa5769 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:58.333366 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da4855-f2e9-42f8-a35d-98e65cff119f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:58.334313 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da4855-f2e9-42f8-a35d-98e65cff119f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:58.335088 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da4855-f2e9-42f8-a35d-98e65cff119f admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:58.335391 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da4855-f2e9-42f8-a35d-98e65cff119f admin admin] PATH_INFO: `/v3/users/b86724ab098846499445fc648e498e36` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:58.336553 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da4855-f2e9-42f8-a35d-98e65cff119f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b86724ab098846499445fc648e498e36)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:58.338468 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da4855-f2e9-42f8-a35d-98e65cff119f admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:58.383804 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-b4da4855-f2e9-42f8-a35d-98e65cff119f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b86724ab098846499445fc648e498e36'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:58.395442 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-b4da4855-f2e9-42f8-a35d-98e65cff119f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b86724ab098846499445fc648e498e36'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:58.396111 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-b4da4855-f2e9-42f8-a35d-98e65cff119f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b86724ab098846499445fc648e498e36'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:58.403788 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-b4da4855-f2e9-42f8-a35d-98e65cff119f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b86724ab098846499445fc648e498e36'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:58.411264 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-b4da4855-f2e9-42f8-a35d-98e65cff119f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b86724ab098846499445fc648e498e36'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:58.417826 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1374/2722] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:38:58 2022] DELETE /identity/v3/users/b86724ab098846499445fc648e498e36 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:38:58.422443 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e015c882-b4b7-4c8d-90f4-a001d7522247 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:58.422943 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e015c882-b4b7-4c8d-90f4-a001d7522247 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:58.423048 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e015c882-b4b7-4c8d-90f4-a001d7522247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:58.442640 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-e015c882-b4b7-4c8d-90f4-a001d7522247 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:38:58.443873 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-e015c882-b4b7-4c8d-90f4-a001d7522247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:38:58.501900 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1349/2723] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:38:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:38:58.511561 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da4855-f2e9-42f8-a35d-98e65cff119f admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:58.513078 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-b4da4855-f2e9-42f8-a35d-98e65cff119f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:38:58.571598 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da4855-f2e9-42f8-a35d-98e65cff119f admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:58.576915 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eaeb43-6531-47a4-ae61-914c30980b42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:58.577660 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eaeb43-6531-47a4-ae61-914c30980b42 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:58.577980 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eaeb43-6531-47a4-ae61-914c30980b42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:58.578240 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eaeb43-6531-47a4-ae61-914c30980b42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:58.588343 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eaeb43-6531-47a4-ae61-914c30980b42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:58.589777 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eaeb43-6531-47a4-ae61-914c30980b42 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:58.599244 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1375/2724] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:38:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:38:58.860559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e015c882-b4b7-4c8d-90f4-a001d7522247 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:58.862096 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-e015c882-b4b7-4c8d-90f4-a001d7522247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:38:58.874478 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e015c882-b4b7-4c8d-90f4-a001d7522247 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:58.879125 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97341447-e836-4a1d-9df5-414bd97a15ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:58.879798 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97341447-e836-4a1d-9df5-414bd97a15ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:58.880086 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97341447-e836-4a1d-9df5-414bd97a15ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:58.880366 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97341447-e836-4a1d-9df5-414bd97a15ce admin admin] PATH_INFO: `/v3/projects/1614b25de7d64849960e792103b2a7d1` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:58.882806 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97341447-e836-4a1d-9df5-414bd97a15ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=1614b25de7d64849960e792103b2a7d1)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:58.884737 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97341447-e836-4a1d-9df5-414bd97a15ce admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:58.931919 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-97341447-e836-4a1d-9df5-414bd97a15ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1614b25de7d64849960e792103b2a7d1', 'request_id': 'req-97341447-e836-4a1d-9df5-414bd97a15ce'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:58.939489 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-97341447-e836-4a1d-9df5-414bd97a15ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1614b25de7d64849960e792103b2a7d1', 'request_id': 'req-97341447-e836-4a1d-9df5-414bd97a15ce'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:58.946828 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-97341447-e836-4a1d-9df5-414bd97a15ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1614b25de7d64849960e792103b2a7d1', 'request_id': 'req-97341447-e836-4a1d-9df5-414bd97a15ce'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:58.957073 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-97341447-e836-4a1d-9df5-414bd97a15ce admin admin] The token cache is being invalidate because project 1614b25de7d64849960e792103b2a7d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80360) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:38:58.957399 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-97341447-e836-4a1d-9df5-414bd97a15ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:58.958124 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-97341447-e836-4a1d-9df5-414bd97a15ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:38:58.959876 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1350/2725] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:38:58 2022] DELETE /identity/v3/projects/1614b25de7d64849960e792103b2a7d1 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:38:58.964757 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f052a5d-b78d-4721-8c6d-532b9e825743 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:58.965044 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f052a5d-b78d-4721-8c6d-532b9e825743 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:58.965314 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f052a5d-b78d-4721-8c6d-532b9e825743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:58.984194 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-5f052a5d-b78d-4721-8c6d-532b9e825743 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:38:58.985388 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-5f052a5d-b78d-4721-8c6d-532b9e825743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:38:59.002317 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:38:59.046991 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1376/2726] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:38:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:38:59.055721 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640eac5-af9d-4feb-9618-3217c80bd002 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:59.056011 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640eac5-af9d-4feb-9618-3217c80bd002 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:59.056290 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640eac5-af9d-4feb-9618-3217c80bd002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:59.076313 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-b640eac5-af9d-4feb-9618-3217c80bd002 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:38:59.077526 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-b640eac5-af9d-4feb-9618-3217c80bd002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:38:59.085365 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1351/2727] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:38:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:38:59.089694 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f052a5d-b78d-4721-8c6d-532b9e825743 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:59.099365 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f052a5d-b78d-4721-8c6d-532b9e825743 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:59.103961 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc282f-b9f8-4cd2-a479-a10ffbb332c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:59.104580 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc282f-b9f8-4cd2-a479-a10ffbb332c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:59.104865 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc282f-b9f8-4cd2-a479-a10ffbb332c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:59.105146 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc282f-b9f8-4cd2-a479-a10ffbb332c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:59.105832 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bc282f-b9f8-4cd2-a479-a10ffbb332c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:38:59.106139 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bc282f-b9f8-4cd2-a479-a10ffbb332c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:59.107778 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bc282f-b9f8-4cd2-a479-a10ffbb332c9 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:59.119570 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1377/2728] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 2 15:38:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:38:59.123645 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b640eac5-af9d-4feb-9618-3217c80bd002 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:59.133347 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b640eac5-af9d-4feb-9618-3217c80bd002 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:59.138031 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4305655-f6a7-4e3c-acf3-c8149424247a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:59.138630 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4305655-f6a7-4e3c-acf3-c8149424247a admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:59.138915 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4305655-f6a7-4e3c-acf3-c8149424247a admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:59.139193 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4305655-f6a7-4e3c-acf3-c8149424247a admin admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:59.139910 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4305655-f6a7-4e3c-acf3-c8149424247a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:59.141823 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4305655-f6a7-4e3c-acf3-c8149424247a admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:59.168711 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1352/2729] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:38:59 2022] POST /identity/v3/projects => generated 365 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:38:59.172893 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc282f-b9f8-4cd2-a479-a10ffbb332c9 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:59.183634 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc282f-b9f8-4cd2-a479-a10ffbb332c9 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:59.238777 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5939b640-7cbf-4868-9151-50215ade7bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:59.239348 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939b640-7cbf-4868-9151-50215ade7bcb admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:59.239636 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939b640-7cbf-4868-9151-50215ade7bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:59.239920 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939b640-7cbf-4868-9151-50215ade7bcb admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:59.240571 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5939b640-7cbf-4868-9151-50215ade7bcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:59.243053 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5939b640-7cbf-4868-9151-50215ade7bcb admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:59.263991 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1378/2730] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:38:59 2022] POST /identity/v3/users => generated 283 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 15:38:59.268068 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4305655-f6a7-4e3c-acf3-c8149424247a admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:59.278124 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4305655-f6a7-4e3c-acf3-c8149424247a admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:59.282645 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab20d83-b416-4180-aaa0-497172c66b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:59.283276 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab20d83-b416-4180-aaa0-497172c66b8c admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:59.283563 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab20d83-b416-4180-aaa0-497172c66b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:59.283841 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab20d83-b416-4180-aaa0-497172c66b8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:59.284525 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab20d83-b416-4180-aaa0-497172c66b8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:59.286104 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab20d83-b416-4180-aaa0-497172c66b8c admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:59.296344 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1353/2731] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:38:59.300373 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5939b640-7cbf-4868-9151-50215ade7bcb admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:59.310614 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5939b640-7cbf-4868-9151-50215ade7bcb admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:59.315067 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a802bb9e-f79e-4f42-bd8c-0331c9fad2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:59.315691 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a802bb9e-f79e-4f42-bd8c-0331c9fad2f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:59.315973 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a802bb9e-f79e-4f42-bd8c-0331c9fad2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:59.316249 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a802bb9e-f79e-4f42-bd8c-0331c9fad2f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:59.316927 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a802bb9e-f79e-4f42-bd8c-0331c9fad2f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:59.318503 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a802bb9e-f79e-4f42-bd8c-0331c9fad2f8 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:59.328800 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1379/2732] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 15:38:59.332700 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab20d83-b416-4180-aaa0-497172c66b8c admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:59.342451 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab20d83-b416-4180-aaa0-497172c66b8c admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:59.347178 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac378d-401e-45dc-a756-39e466b44fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:59.347877 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac378d-401e-45dc-a756-39e466b44fec admin admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:59.348165 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac378d-401e-45dc-a756-39e466b44fec admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:59.348578 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac378d-401e-45dc-a756-39e466b44fec admin admin] PATH_INFO: `/v3/projects/d3b4389265504e91a94ed4d101e201ac/users/0468344dbcac415695ba76d9da98bf50/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:59.364296 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ac378d-401e-45dc-a756-39e466b44fec admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3b4389265504e91a94ed4d101e201ac, user_id=0468344dbcac415695ba76d9da98bf50, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:59.367594 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ac378d-401e-45dc-a756-39e466b44fec admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:59.380153 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1354/2733] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:38:59 2022] PUT /identity/v3/projects/d3b4389265504e91a94ed4d101e201ac/users/0468344dbcac415695ba76d9da98bf50/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:38:59.390374 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a15984-7254-47c2-ba5d-758c6d8c7665 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:59.390672 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a15984-7254-47c2-ba5d-758c6d8c7665 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:59.390957 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a15984-7254-47c2-ba5d-758c6d8c7665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:59.418297 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-e8a15984-7254-47c2-ba5d-758c6d8c7665 None None] MFA Rules not processed for user `0468344dbcac415695ba76d9da98bf50`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:38:59.419537 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-e8a15984-7254-47c2-ba5d-758c6d8c7665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:38:59.487053 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1380/2734] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:38:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:38:59.502502 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac378d-401e-45dc-a756-39e466b44fec admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:38:59.504214 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-39ac378d-401e-45dc-a756-39e466b44fec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:38:59.525446 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:38:59.562408 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac378d-401e-45dc-a756-39e466b44fec admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:38:59.565987 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d25a7-774e-4d1e-af06-4611beb0bb26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:38:59.566592 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d25a7-774e-4d1e-af06-4611beb0bb26 service cinder] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:38:59.566867 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d25a7-774e-4d1e-af06-4611beb0bb26 service cinder] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:38:59.567144 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d25a7-774e-4d1e-af06-4611beb0bb26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:38:59.575279 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0d25a7-774e-4d1e-af06-4611beb0bb26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:38:59.576687 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0d25a7-774e-4d1e-af06-4611beb0bb26 service cinder] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:38:59.585417 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1355/2735] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:38:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:39:09.484076 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:39:09.581371 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=17 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:39:39.753200 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652c03d-2f53-43d5-ae15-a7487e0c397c None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:39:39.753696 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652c03d-2f53-43d5-ae15-a7487e0c397c None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:39:39.753801 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652c03d-2f53-43d5-ae15-a7487e0c397c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:39:39.772265 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-1652c03d-2f53-43d5-ae15-a7487e0c397c None None] MFA Rules not processed for user `5bad05743cdd47139c63fa1f1a8dca1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:39:39.773454 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-1652c03d-2f53-43d5-ae15-a7487e0c397c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:39:39.827316 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1381/2736] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:39:39 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:39:39.923061 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d25a7-774e-4d1e-af06-4611beb0bb26 service cinder] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:39:39.992374 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d25a7-774e-4d1e-af06-4611beb0bb26 service cinder] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:39:39.997130 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d110cb5e-23cd-4a23-9fd2-8126849c24ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:39:39.997776 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110cb5e-23cd-4a23-9fd2-8126849c24ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:39:39.998060 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110cb5e-23cd-4a23-9fd2-8126849c24ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:39:39.998337 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110cb5e-23cd-4a23-9fd2-8126849c24ca admin admin] PATH_INFO: `/v3/users/0468344dbcac415695ba76d9da98bf50` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:39:39.999533 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d110cb5e-23cd-4a23-9fd2-8126849c24ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=0468344dbcac415695ba76d9da98bf50)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:39:40.001482 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d110cb5e-23cd-4a23-9fd2-8126849c24ca admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:39:40.054757 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-d110cb5e-23cd-4a23-9fd2-8126849c24ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0468344dbcac415695ba76d9da98bf50'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:39:40.061731 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-d110cb5e-23cd-4a23-9fd2-8126849c24ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0468344dbcac415695ba76d9da98bf50'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:39:40.073450 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-d110cb5e-23cd-4a23-9fd2-8126849c24ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0468344dbcac415695ba76d9da98bf50'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:39:40.074142 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-d110cb5e-23cd-4a23-9fd2-8126849c24ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0468344dbcac415695ba76d9da98bf50'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:39:40.074748 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-d110cb5e-23cd-4a23-9fd2-8126849c24ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0468344dbcac415695ba76d9da98bf50'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:39:40.088601 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1356/2737] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:39:39 2022] DELETE /identity/v3/users/0468344dbcac415695ba76d9da98bf50 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:39:40.093608 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ede252-9423-4ef5-b952-861564c70abe None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:39:40.093958 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ede252-9423-4ef5-b952-861564c70abe None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:39:40.094247 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ede252-9423-4ef5-b952-861564c70abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:39:40.113575 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-78ede252-9423-4ef5-b952-861564c70abe None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:39:40.114792 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-78ede252-9423-4ef5-b952-861564c70abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:39:40.178014 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1382/2738] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:39:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:39:40.187496 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d110cb5e-23cd-4a23-9fd2-8126849c24ca admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:39:40.189030 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-d110cb5e-23cd-4a23-9fd2-8126849c24ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:39:40.249865 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d110cb5e-23cd-4a23-9fd2-8126849c24ca admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:39:40.253590 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8782498f-1e54-4f3a-aa22-3c1f7e925c56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:39:40.254235 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782498f-1e54-4f3a-aa22-3c1f7e925c56 service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:39:40.254514 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782498f-1e54-4f3a-aa22-3c1f7e925c56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:39:40.254787 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782498f-1e54-4f3a-aa22-3c1f7e925c56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:39:40.264349 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8782498f-1e54-4f3a-aa22-3c1f7e925c56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:39:40.265754 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8782498f-1e54-4f3a-aa22-3c1f7e925c56 service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:39:40.275078 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1357/2739] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:39:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:39:40.587587 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ede252-9423-4ef5-b952-861564c70abe None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:39:40.591687 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-78ede252-9423-4ef5-b952-861564c70abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:39:40.604530 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ede252-9423-4ef5-b952-861564c70abe None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:39:40.609119 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96902f3-cdf6-4803-a315-89843e9a1d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:39:40.609764 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96902f3-cdf6-4803-a315-89843e9a1d08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:39:40.610042 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96902f3-cdf6-4803-a315-89843e9a1d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:39:40.610315 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96902f3-cdf6-4803-a315-89843e9a1d08 admin admin] PATH_INFO: `/v3/projects/d3b4389265504e91a94ed4d101e201ac` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:39:40.611561 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96902f3-cdf6-4803-a315-89843e9a1d08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3b4389265504e91a94ed4d101e201ac)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:39:40.613473 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96902f3-cdf6-4803-a315-89843e9a1d08 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:39:40.663389 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-e96902f3-cdf6-4803-a315-89843e9a1d08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3b4389265504e91a94ed4d101e201ac', 'request_id': 'req-e96902f3-cdf6-4803-a315-89843e9a1d08'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:39:40.671934 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-e96902f3-cdf6-4803-a315-89843e9a1d08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3b4389265504e91a94ed4d101e201ac', 'request_id': 'req-e96902f3-cdf6-4803-a315-89843e9a1d08'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:39:40.678835 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-e96902f3-cdf6-4803-a315-89843e9a1d08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3b4389265504e91a94ed4d101e201ac', 'request_id': 'req-e96902f3-cdf6-4803-a315-89843e9a1d08'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:39:40.690847 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-e96902f3-cdf6-4803-a315-89843e9a1d08 admin admin] The token cache is being invalidate because project d3b4389265504e91a94ed4d101e201ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:39:40.691167 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-e96902f3-cdf6-4803-a315-89843e9a1d08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:39:40.691869 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-e96902f3-cdf6-4803-a315-89843e9a1d08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:39:40.693408 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1383/2740] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:39:40 2022] DELETE /identity/v3/projects/d3b4389265504e91a94ed4d101e201ac => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:39:41.599704 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8782498f-1e54-4f3a-aa22-3c1f7e925c56 service neutron] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:39:41.601247 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-8782498f-1e54-4f3a-aa22-3c1f7e925c56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:39:41.614148 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8782498f-1e54-4f3a-aa22-3c1f7e925c56 service neutron] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:39:41.662543 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:39:41.710322 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0930e31-1d37-4e19-b5d6-06bd60ad013d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:39:41.710956 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0930e31-1d37-4e19-b5d6-06bd60ad013d service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:39:41.711257 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0930e31-1d37-4e19-b5d6-06bd60ad013d service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:39:41.711666 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0930e31-1d37-4e19-b5d6-06bd60ad013d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:39:41.718227 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-a0930e31-1d37-4e19-b5d6-06bd60ad013d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:39:41.805629 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0930e31-1d37-4e19-b5d6-06bd60ad013d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:39:41.807026 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0930e31-1d37-4e19-b5d6-06bd60ad013d service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:39:41.818934 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1358/2741] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:39:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:39:46.578957 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96902f3-cdf6-4803-a315-89843e9a1d08 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:39:46.580450 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-e96902f3-cdf6-4803-a315-89843e9a1d08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:39:46.593129 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96902f3-cdf6-4803-a315-89843e9a1d08 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:39:46.596862 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c3ae52-060b-489c-8825-d070a43fee3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:39:46.597914 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3ae52-060b-489c-8825-d070a43fee3c service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:39:46.597914 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3ae52-060b-489c-8825-d070a43fee3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:39:46.598190 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3ae52-060b-489c-8825-d070a43fee3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:39:46.599783 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-24c3ae52-060b-489c-8825-d070a43fee3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:39:46.614486 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c3ae52-060b-489c-8825-d070a43fee3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:39:46.615992 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c3ae52-060b-489c-8825-d070a43fee3c service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:39:46.627388 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1384/2742] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:39:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:39:51.813812 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=44 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:39:56.622886 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=85,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:40:42.533742 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0930e31-1d37-4e19-b5d6-06bd60ad013d service neutron] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:40:42.535716 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-a0930e31-1d37-4e19-b5d6-06bd60ad013d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:40:42.552439 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0930e31-1d37-4e19-b5d6-06bd60ad013d service neutron] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:40:42.560237 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6010afbd-c592-4ab0-9983-e88df7dccdec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0865af59bf43dfa4c84213d7db53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:40:42.560869 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6010afbd-c592-4ab0-9983-e88df7dccdec service nova] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:40:42.561155 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6010afbd-c592-4ab0-9983-e88df7dccdec service nova] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:40:42.561435 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6010afbd-c592-4ab0-9983-e88df7dccdec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:40:42.563234 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-6010afbd-c592-4ab0-9983-e88df7dccdec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:40:42.576072 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6010afbd-c592-4ab0-9983-e88df7dccdec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:40:42.577662 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6010afbd-c592-4ab0-9983-e88df7dccdec service nova] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:40:42.589721 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1359/2743] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:40:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:40:44.266608 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c3ae52-060b-489c-8825-d070a43fee3c service neutron] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:40:44.275667 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c3ae52-060b-489c-8825-d070a43fee3c service neutron] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:40:44.279826 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3fe143-8801-49fc-936e-a38a2aedb110 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:40:44.280437 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3fe143-8801-49fc-936e-a38a2aedb110 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:40:44.280718 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3fe143-8801-49fc-936e-a38a2aedb110 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:40:44.280994 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3fe143-8801-49fc-936e-a38a2aedb110 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:40:44.282897 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-ef3fe143-8801-49fc-936e-a38a2aedb110 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:40:44.295855 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3fe143-8801-49fc-936e-a38a2aedb110 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:40:44.297308 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3fe143-8801-49fc-936e-a38a2aedb110 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:40:44.305765 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1385/2744] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:40:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:40:45.678404 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6010afbd-c592-4ab0-9983-e88df7dccdec service nova] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:40:45.690428 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6010afbd-c592-4ab0-9983-e88df7dccdec service nova] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:40:45.696292 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ce777-052a-4359-a318-3c05fc5b172a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0865af59bf43dfa4c84213d7db53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:40:45.696913 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ce777-052a-4359-a318-3c05fc5b172a service nova] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:40:45.697196 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ce777-052a-4359-a318-3c05fc5b172a service nova] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:40:45.697468 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ce777-052a-4359-a318-3c05fc5b172a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:40:45.699314 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-259ce777-052a-4359-a318-3c05fc5b172a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:40:45.714488 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ce777-052a-4359-a318-3c05fc5b172a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:40:45.716392 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ce777-052a-4359-a318-3c05fc5b172a service nova] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:40:45.727258 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1360/2745] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:40:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:40:54.302016 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=6 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:40:54.379036 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c6dd8-3363-41d3-b14d-57d20839aa10 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:40:54.379374 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c6dd8-3363-41d3-b14d-57d20839aa10 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:40:54.379661 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c6dd8-3363-41d3-b14d-57d20839aa10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:40:54.442078 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-f68c6dd8-3363-41d3-b14d-57d20839aa10 None None] MFA Rules not processed for user `dfe8c00c0c3d4c4b8b6f36e39a3a2e71`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:40:54.443383 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-f68c6dd8-3363-41d3-b14d-57d20839aa10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:40:54.531905 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1386/2746] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Aug 2 15:40:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:40:54.536837 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ce777-052a-4359-a318-3c05fc5b172a service nova] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:40:54.539183 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-259ce777-052a-4359-a318-3c05fc5b172a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:40:54.572961 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ce777-052a-4359-a318-3c05fc5b172a service nova] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:40:54.592791 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2592d438-af10-459e-99c2-9d2d8f8bc767 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0865af59bf43dfa4c84213d7db53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:40:54.593480 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592d438-af10-459e-99c2-9d2d8f8bc767 service nova] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:40:54.593964 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592d438-af10-459e-99c2-9d2d8f8bc767 service nova] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:40:54.594263 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592d438-af10-459e-99c2-9d2d8f8bc767 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:40:54.602294 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-2592d438-af10-459e-99c2-9d2d8f8bc767 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:40:54.608297 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68c6dd8-3363-41d3-b14d-57d20839aa10 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:40:54.609751 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-f68c6dd8-3363-41d3-b14d-57d20839aa10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:40:54.617618 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2592d438-af10-459e-99c2-9d2d8f8bc767 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:40:54.620115 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2592d438-af10-459e-99c2-9d2d8f8bc767 service nova] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:40:54.639755 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1361/2747] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:40:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:40:54.726145 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68c6dd8-3363-41d3-b14d-57d20839aa10 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:40:54.731142 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2021e860-60b7-4d42-ab9a-cc66e9c4e1f6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4de590df474c8b95f2b1193f7dbcb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:40:54.732156 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021e860-60b7-4d42-ab9a-cc66e9c4e1f6 service swift] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:40:54.732439 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021e860-60b7-4d42-ab9a-cc66e9c4e1f6 service swift] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:40:54.732713 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021e860-60b7-4d42-ab9a-cc66e9c4e1f6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:40:54.740908 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2021e860-60b7-4d42-ab9a-cc66e9c4e1f6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:40:54.742494 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2021e860-60b7-4d42-ab9a-cc66e9c4e1f6 service swift] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:40:54.751042 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1387/2748] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Aug 2 15:40:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 15:40:57.845630 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2592d438-af10-459e-99c2-9d2d8f8bc767 service nova] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:40:57.847175 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-2592d438-af10-459e-99c2-9d2d8f8bc767 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:40:57.862013 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2592d438-af10-459e-99c2-9d2d8f8bc767 service nova] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:40:57.866037 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af864b02-aab2-4c15-b4ec-0a4e2921cce5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:40:57.867049 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af864b02-aab2-4c15-b4ec-0a4e2921cce5 service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:40:57.867520 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af864b02-aab2-4c15-b4ec-0a4e2921cce5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:40:57.868083 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af864b02-aab2-4c15-b4ec-0a4e2921cce5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:40:57.871741 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-af864b02-aab2-4c15-b4ec-0a4e2921cce5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:40:57.959111 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af864b02-aab2-4c15-b4ec-0a4e2921cce5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:40:57.961681 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af864b02-aab2-4c15-b4ec-0a4e2921cce5 service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:40:57.990777 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1362/2749] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:40:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:41:04.747907 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=81 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:41:05.313053 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2021e860-60b7-4d42-ab9a-cc66e9c4e1f6 service swift] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:41:05.314672 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-2021e860-60b7-4d42-ab9a-cc66e9c4e1f6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:41:05.334448 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2021e860-60b7-4d42-ab9a-cc66e9c4e1f6 service swift] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:41:05.339440 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b644b-42be-4f6b-af5a-483d2c1a6f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:41:05.340089 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b644b-42be-4f6b-af5a-483d2c1a6f0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:41:05.340370 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b644b-42be-4f6b-af5a-483d2c1a6f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:41:05.340645 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b644b-42be-4f6b-af5a-483d2c1a6f0a admin admin] PATH_INFO: `/v3/users/cfb5e907ac594ba6a93d88d665c1d740` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:41:05.342046 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4b644b-42be-4f6b-af5a-483d2c1a6f0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfb5e907ac594ba6a93d88d665c1d740)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:41:05.344039 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4b644b-42be-4f6b-af5a-483d2c1a6f0a admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:41:05.396139 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-2f4b644b-42be-4f6b-af5a-483d2c1a6f0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfb5e907ac594ba6a93d88d665c1d740'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:41:05.409440 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-2f4b644b-42be-4f6b-af5a-483d2c1a6f0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfb5e907ac594ba6a93d88d665c1d740'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:41:05.410160 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-2f4b644b-42be-4f6b-af5a-483d2c1a6f0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfb5e907ac594ba6a93d88d665c1d740'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:41:05.418638 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-2f4b644b-42be-4f6b-af5a-483d2c1a6f0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfb5e907ac594ba6a93d88d665c1d740'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:41:05.426860 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-2f4b644b-42be-4f6b-af5a-483d2c1a6f0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfb5e907ac594ba6a93d88d665c1d740'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:41:05.432985 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1388/2750] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:41:05 2022] DELETE /identity/v3/users/cfb5e907ac594ba6a93d88d665c1d740 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:41:05.614919 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af864b02-aab2-4c15-b4ec-0a4e2921cce5 service neutron] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:41:05.625514 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af864b02-aab2-4c15-b4ec-0a4e2921cce5 service neutron] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:41:05.693473 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1664c690-ea45-4fa1-84dd-9e0a80d7b48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:41:05.694144 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664c690-ea45-4fa1-84dd-9e0a80d7b48d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:41:05.694430 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664c690-ea45-4fa1-84dd-9e0a80d7b48d admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:41:05.694711 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664c690-ea45-4fa1-84dd-9e0a80d7b48d admin admin] PATH_INFO: `/v3/projects/812d2ec949d447c7b68157d968bcfa7e` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:41:05.695946 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1664c690-ea45-4fa1-84dd-9e0a80d7b48d admin admin] RBAC: Authorizing `identity:delete_project(project_id=812d2ec949d447c7b68157d968bcfa7e)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:41:05.697878 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1664c690-ea45-4fa1-84dd-9e0a80d7b48d admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:41:05.747459 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-1664c690-ea45-4fa1-84dd-9e0a80d7b48d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '812d2ec949d447c7b68157d968bcfa7e', 'request_id': 'req-1664c690-ea45-4fa1-84dd-9e0a80d7b48d'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:41:05.755116 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-1664c690-ea45-4fa1-84dd-9e0a80d7b48d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '812d2ec949d447c7b68157d968bcfa7e', 'request_id': 'req-1664c690-ea45-4fa1-84dd-9e0a80d7b48d'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:41:05.756761 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:41:05.764098 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-1664c690-ea45-4fa1-84dd-9e0a80d7b48d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '812d2ec949d447c7b68157d968bcfa7e', 'request_id': 'req-1664c690-ea45-4fa1-84dd-9e0a80d7b48d'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:41:05.775596 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-1664c690-ea45-4fa1-84dd-9e0a80d7b48d admin admin] The token cache is being invalidate because project 812d2ec949d447c7b68157d968bcfa7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80360) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:41:05.775891 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-1664c690-ea45-4fa1-84dd-9e0a80d7b48d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:41:05.776593 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-1664c690-ea45-4fa1-84dd-9e0a80d7b48d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:41:05.778701 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1363/2751] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:41:05 2022] DELETE /identity/v3/projects/812d2ec949d447c7b68157d968bcfa7e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:41:05.782830 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b644b-42be-4f6b-af5a-483d2c1a6f0a admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:41:05.784355 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-2f4b644b-42be-4f6b-af5a-483d2c1a6f0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:41:05.798116 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b644b-42be-4f6b-af5a-483d2c1a6f0a admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:41:05.856677 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c530d1-1cf0-4af0-993f-fee0bf0e83b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:41:05.857162 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c530d1-1cf0-4af0-993f-fee0bf0e83b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:41:05.857444 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c530d1-1cf0-4af0-993f-fee0bf0e83b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:41:05.857719 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c530d1-1cf0-4af0-993f-fee0bf0e83b8 admin admin] PATH_INFO: `/v3/users/3fc311b3746c4cf4ac17571d39f00683` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:41:05.858890 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c530d1-1cf0-4af0-993f-fee0bf0e83b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fc311b3746c4cf4ac17571d39f00683)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:41:05.860852 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c530d1-1cf0-4af0-993f-fee0bf0e83b8 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:41:05.906537 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-e3c530d1-1cf0-4af0-993f-fee0bf0e83b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fc311b3746c4cf4ac17571d39f00683'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:41:05.918919 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-e3c530d1-1cf0-4af0-993f-fee0bf0e83b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fc311b3746c4cf4ac17571d39f00683'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:41:05.919607 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-e3c530d1-1cf0-4af0-993f-fee0bf0e83b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fc311b3746c4cf4ac17571d39f00683'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:41:05.926691 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-e3c530d1-1cf0-4af0-993f-fee0bf0e83b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fc311b3746c4cf4ac17571d39f00683'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:41:05.928392 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:41:05.934774 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-e3c530d1-1cf0-4af0-993f-fee0bf0e83b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fc311b3746c4cf4ac17571d39f00683'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:41:05.941873 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1389/2752] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:41:05 2022] DELETE /identity/v3/users/3fc311b3746c4cf4ac17571d39f00683 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:41:06.117099 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1664c690-ea45-4fa1-84dd-9e0a80d7b48d admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:41:06.118647 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-1664c690-ea45-4fa1-84dd-9e0a80d7b48d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:41:06.131535 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1664c690-ea45-4fa1-84dd-9e0a80d7b48d admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:41:06.193196 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c572d6b5-1e1b-47d7-b13e-cf2d395172f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:41:06.193827 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c572d6b5-1e1b-47d7-b13e-cf2d395172f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:41:06.194111 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c572d6b5-1e1b-47d7-b13e-cf2d395172f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:41:06.194389 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c572d6b5-1e1b-47d7-b13e-cf2d395172f9 admin admin] PATH_INFO: `/v3/projects/89748fd810df46aaa0b74e73962fd19c` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:41:06.195581 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c572d6b5-1e1b-47d7-b13e-cf2d395172f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89748fd810df46aaa0b74e73962fd19c)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:41:06.197543 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c572d6b5-1e1b-47d7-b13e-cf2d395172f9 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:41:06.243479 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-c572d6b5-1e1b-47d7-b13e-cf2d395172f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89748fd810df46aaa0b74e73962fd19c', 'request_id': 'req-c572d6b5-1e1b-47d7-b13e-cf2d395172f9'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:41:06.250948 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-c572d6b5-1e1b-47d7-b13e-cf2d395172f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89748fd810df46aaa0b74e73962fd19c', 'request_id': 'req-c572d6b5-1e1b-47d7-b13e-cf2d395172f9'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:41:06.257119 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-c572d6b5-1e1b-47d7-b13e-cf2d395172f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89748fd810df46aaa0b74e73962fd19c', 'request_id': 'req-c572d6b5-1e1b-47d7-b13e-cf2d395172f9'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:41:06.267870 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-c572d6b5-1e1b-47d7-b13e-cf2d395172f9 admin admin] The token cache is being invalidate because project 89748fd810df46aaa0b74e73962fd19c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80360) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:41:06.268156 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-c572d6b5-1e1b-47d7-b13e-cf2d395172f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:41:06.268787 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-c572d6b5-1e1b-47d7-b13e-cf2d395172f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:41:06.270286 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1364/2753] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:41:06 2022] DELETE /identity/v3/projects/89748fd810df46aaa0b74e73962fd19c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:41:09.951287 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4be99-5c2f-4754-a49d-b4d0ba697791 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:41:09.951865 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4be99-5c2f-4754-a49d-b4d0ba697791 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:41:09.951865 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4be99-5c2f-4754-a49d-b4d0ba697791 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:41:09.953251 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1390/2754] 10.222.0.42 () {54 vars in 921 bytes} [Tue Aug 2 15:41:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:41:09.959689 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4421574-2fa5-4bfb-978f-8cafdd768f6b None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:41:09.960158 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4421574-2fa5-4bfb-978f-8cafdd768f6b None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:41:09.960328 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4421574-2fa5-4bfb-978f-8cafdd768f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:41:09.999419 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-f4421574-2fa5-4bfb-978f-8cafdd768f6b None None] MFA Rules not processed for user `4c0865af59bf43dfa4c84213d7db53c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:41:10.000767 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-f4421574-2fa5-4bfb-978f-8cafdd768f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:41:10.058424 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:41:10.076275 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1365/2755] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Aug 2 15:41:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:41:10.091067 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace4be99-5c2f-4754-a49d-b4d0ba697791 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:41:10.092821 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-ace4be99-5c2f-4754-a49d-b4d0ba697791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:41:10.172126 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace4be99-5c2f-4754-a49d-b4d0ba697791 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:41:10.176072 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2875eb-c798-4a6d-922f-18ca4d098626 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946af31d75ca41a2a4301e0294cf98f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:41:10.176693 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2875eb-c798-4a6d-922f-18ca4d098626 service glance] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:41:10.176979 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2875eb-c798-4a6d-922f-18ca4d098626 service glance] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:41:10.177258 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2875eb-c798-4a6d-922f-18ca4d098626 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:41:10.188032 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2875eb-c798-4a6d-922f-18ca4d098626 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:41:10.189464 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2875eb-c798-4a6d-922f-18ca4d098626 service glance] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:41:10.200758 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1391/2756] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:41:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:41:10.268423 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0675eea-d754-4a81-8ccb-5c3fa92040e7 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:41:10.268706 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0675eea-d754-4a81-8ccb-5c3fa92040e7 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:41:10.268984 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0675eea-d754-4a81-8ccb-5c3fa92040e7 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:41:10.270347 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1366/2757] 10.222.0.42 () {54 vars in 921 bytes} [Tue Aug 2 15:41:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:41:10.275106 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf601d95-2a98-4c0f-acd2-e9c16e5a69c2 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:41:10.275449 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf601d95-2a98-4c0f-acd2-e9c16e5a69c2 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:41:10.275729 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf601d95-2a98-4c0f-acd2-e9c16e5a69c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:41:10.313309 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-bf601d95-2a98-4c0f-acd2-e9c16e5a69c2 None None] MFA Rules not processed for user `f6d1caa34f2b41bfbcc95fa58d85f004`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:41:10.314513 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-bf601d95-2a98-4c0f-acd2-e9c16e5a69c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:41:10.365426 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1392/2758] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Aug 2 15:41:10 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:41:10.378467 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0675eea-d754-4a81-8ccb-5c3fa92040e7 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:41:10.380172 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-e0675eea-d754-4a81-8ccb-5c3fa92040e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:41:10.393711 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0675eea-d754-4a81-8ccb-5c3fa92040e7 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:41:10.397182 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451dcbc1-422a-4ae6-a8d2-a4e7c5c905f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:41:10.397776 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451dcbc1-422a-4ae6-a8d2-a4e7c5c905f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:41:10.398053 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451dcbc1-422a-4ae6-a8d2-a4e7c5c905f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:41:10.398326 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451dcbc1-422a-4ae6-a8d2-a4e7c5c905f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:41:10.405221 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451dcbc1-422a-4ae6-a8d2-a4e7c5c905f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:41:10.406653 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451dcbc1-422a-4ae6-a8d2-a4e7c5c905f1 service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:41:10.414254 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1367/2759] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:41:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:41:10.497376 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f9c798-a9fd-4ea0-9be1-1c749a6f8bf1 None None] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:41:10.497766 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f9c798-a9fd-4ea0-9be1-1c749a6f8bf1 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:41:10.498054 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f9c798-a9fd-4ea0-9be1-1c749a6f8bf1 None None] PATH_INFO: `/` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:41:10.499451 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1393/2760] 10.222.0.42 () {54 vars in 921 bytes} [Tue Aug 2 15:41:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 15:41:10.504553 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba89807f-f200-4ab5-a2bf-8049ac7e9047 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:41:10.504840 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba89807f-f200-4ab5-a2bf-8049ac7e9047 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:41:10.505116 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba89807f-f200-4ab5-a2bf-8049ac7e9047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:41:10.524360 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-ba89807f-f200-4ab5-a2bf-8049ac7e9047 None None] MFA Rules not processed for user `4c0865af59bf43dfa4c84213d7db53c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:41:10.525545 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-ba89807f-f200-4ab5-a2bf-8049ac7e9047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:41:10.535022 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1368/2761] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Aug 2 15:41:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:41:10.545707 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f9c798-a9fd-4ea0-9be1-1c749a6f8bf1 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:41:10.557118 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f9c798-a9fd-4ea0-9be1-1c749a6f8bf1 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:41:10.561363 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548994bd-b9ce-4c0d-ac07-a6f86de19bca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:41:10.561989 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548994bd-b9ce-4c0d-ac07-a6f86de19bca service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:41:10.562273 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548994bd-b9ce-4c0d-ac07-a6f86de19bca service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:41:10.562551 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548994bd-b9ce-4c0d-ac07-a6f86de19bca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:41:10.572614 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548994bd-b9ce-4c0d-ac07-a6f86de19bca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:41:10.574047 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548994bd-b9ce-4c0d-ac07-a6f86de19bca service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:41:10.584611 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1394/2762] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:41:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:41:10.644561 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba89807f-f200-4ab5-a2bf-8049ac7e9047 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:41:10.645978 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-ba89807f-f200-4ab5-a2bf-8049ac7e9047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:41:10.713471 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba89807f-f200-4ab5-a2bf-8049ac7e9047 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:41:10.718483 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260626dd-45b1-4560-8e28-cd4f13646a22 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57dfafee636a45ca98fe0e8bb13dd754', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:41:10.719090 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260626dd-45b1-4560-8e28-cd4f13646a22 service placement] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:41:10.719402 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260626dd-45b1-4560-8e28-cd4f13646a22 service placement] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:41:10.719711 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260626dd-45b1-4560-8e28-cd4f13646a22 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:41:10.721455 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-260626dd-45b1-4560-8e28-cd4f13646a22 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:41:10.733094 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260626dd-45b1-4560-8e28-cd4f13646a22 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:41:10.734651 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260626dd-45b1-4560-8e28-cd4f13646a22 service placement] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:41:10.744335 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1369/2763] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:41:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:41:12.555992 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4287c6c-44cb-4ad5-b5e0-3399a4b9f646 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:41:12.556513 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4287c6c-44cb-4ad5-b5e0-3399a4b9f646 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:41:12.556670 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4287c6c-44cb-4ad5-b5e0-3399a4b9f646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:41:12.576845 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-d4287c6c-44cb-4ad5-b5e0-3399a4b9f646 None None] MFA Rules not processed for user `dfe8c00c0c3d4c4b8b6f36e39a3a2e71`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:41:12.578184 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-d4287c6c-44cb-4ad5-b5e0-3399a4b9f646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:41:12.635456 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1395/2764] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Aug 2 15:41:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:41:12.647227 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260626dd-45b1-4560-8e28-cd4f13646a22 service placement] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:41:12.648671 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-260626dd-45b1-4560-8e28-cd4f13646a22 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:41:12.742004 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260626dd-45b1-4560-8e28-cd4f13646a22 service placement] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:41:12.746970 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc577da9-39f3-4fc9-8d12-e6183dafd484 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4de590df474c8b95f2b1193f7dbcb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:41:12.747629 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc577da9-39f3-4fc9-8d12-e6183dafd484 service swift] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:41:12.747914 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc577da9-39f3-4fc9-8d12-e6183dafd484 service swift] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:41:12.748190 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc577da9-39f3-4fc9-8d12-e6183dafd484 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:41:12.756202 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc577da9-39f3-4fc9-8d12-e6183dafd484 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:41:12.757796 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc577da9-39f3-4fc9-8d12-e6183dafd484 service swift] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:41:12.766157 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1370/2765] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Aug 2 15:41:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 15:41:22.628589 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=97 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:41:22.763053 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=76 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:41:28.157982 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096338c-d190-49f1-9e9c-7f499c948f02 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:41:28.157982 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096338c-d190-49f1-9e9c-7f499c948f02 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:41:28.157982 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096338c-d190-49f1-9e9c-7f499c948f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:41:28.178711 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-4096338c-d190-49f1-9e9c-7f499c948f02 None None] MFA Rules not processed for user `dfe8c00c0c3d4c4b8b6f36e39a3a2e71`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:41:28.180542 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-4096338c-d190-49f1-9e9c-7f499c948f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:41:28.190917 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1396/2766] 10.222.0.42 () {58 vars in 967 bytes} [Tue Aug 2 15:41:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:41:28.208790 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc577da9-39f3-4fc9-8d12-e6183dafd484 service swift] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:41:28.219508 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc577da9-39f3-4fc9-8d12-e6183dafd484 service swift] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:41:28.224633 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a92c0-c9c8-4c96-9246-0750173e2f5d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4de590df474c8b95f2b1193f7dbcb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:41:28.225353 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a92c0-c9c8-4c96-9246-0750173e2f5d service swift] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:41:28.225701 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a92c0-c9c8-4c96-9246-0750173e2f5d service swift] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:41:28.226051 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a92c0-c9c8-4c96-9246-0750173e2f5d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:41:28.234952 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246a92c0-c9c8-4c96-9246-0750173e2f5d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:41:28.236672 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246a92c0-c9c8-4c96-9246-0750173e2f5d service swift] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:41:28.245514 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1371/2767] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Aug 2 15:41:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 15:41:38.170938 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=3 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:41:38.242167 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=6 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:42:02.239001 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096338c-d190-49f1-9e9c-7f499c948f02 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:42:02.241025 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-4096338c-d190-49f1-9e9c-7f499c948f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:42:02.425322 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096338c-d190-49f1-9e9c-7f499c948f02 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:42:02.428882 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0624b7-5d9a-485c-a29f-d2ca44fd7cd0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:42:02.429499 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0624b7-5d9a-485c-a29f-d2ca44fd7cd0 service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:42:02.429777 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0624b7-5d9a-485c-a29f-d2ca44fd7cd0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:42:02.430046 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0624b7-5d9a-485c-a29f-d2ca44fd7cd0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:42:02.431813 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-fd0624b7-5d9a-485c-a29f-d2ca44fd7cd0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:42:02.496692 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0624b7-5d9a-485c-a29f-d2ca44fd7cd0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:42:02.498743 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0624b7-5d9a-485c-a29f-d2ca44fd7cd0 service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:42:02.508105 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1397/2768] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:42:02 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:42:10.714898 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a92c0-c9c8-4c96-9246-0750173e2f5d service swift] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:42:10.716386 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-246a92c0-c9c8-4c96-9246-0750173e2f5d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:42:10.729575 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a92c0-c9c8-4c96-9246-0750173e2f5d service swift] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:42:10.733083 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e543f5-3a5d-4e31-b4b3-a7d833e8f22f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:42:10.733706 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e543f5-3a5d-4e31-b4b3-a7d833e8f22f service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:42:10.734003 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e543f5-3a5d-4e31-b4b3-a7d833e8f22f service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:42:10.734248 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e543f5-3a5d-4e31-b4b3-a7d833e8f22f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:42:10.735993 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-91e543f5-3a5d-4e31-b4b3-a7d833e8f22f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:42:10.801545 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e543f5-3a5d-4e31-b4b3-a7d833e8f22f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:42:10.802988 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e543f5-3a5d-4e31-b4b3-a7d833e8f22f service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:42:10.812746 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1372/2769] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:42:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:42:12.504375 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=48 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:42:14.036630 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0624b7-5d9a-485c-a29f-d2ca44fd7cd0 service cinder] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:42:14.049716 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0624b7-5d9a-485c-a29f-d2ca44fd7cd0 service cinder] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:42:14.054967 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7cd3b-51db-4d5d-8a38-2eda7af82ae9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57dfafee636a45ca98fe0e8bb13dd754', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:42:14.055609 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7cd3b-51db-4d5d-8a38-2eda7af82ae9 service placement] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:42:14.055889 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7cd3b-51db-4d5d-8a38-2eda7af82ae9 service placement] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:42:14.056162 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7cd3b-51db-4d5d-8a38-2eda7af82ae9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:42:14.057961 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-efd7cd3b-51db-4d5d-8a38-2eda7af82ae9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:42:14.070675 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd7cd3b-51db-4d5d-8a38-2eda7af82ae9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:42:14.072332 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd7cd3b-51db-4d5d-8a38-2eda7af82ae9 service placement] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:42:14.083174 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1398/2770] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:42:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 15:42:14.136785 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e543f5-3a5d-4e31-b4b3-a7d833e8f22f service neutron] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:42:14.142964 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-91e543f5-3a5d-4e31-b4b3-a7d833e8f22f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:42:14.162903 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e543f5-3a5d-4e31-b4b3-a7d833e8f22f service neutron] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:42:14.168636 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f6cb7-5e09-4b7b-ab26-a176f788ca6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:42:14.169600 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f6cb7-5e09-4b7b-ab26-a176f788ca6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:42:14.169910 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f6cb7-5e09-4b7b-ab26-a176f788ca6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:42:14.170186 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f6cb7-5e09-4b7b-ab26-a176f788ca6b admin admin] PATH_INFO: `/v3/users/5bad05743cdd47139c63fa1f1a8dca1c` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:42:14.171646 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40f6cb7-5e09-4b7b-ab26-a176f788ca6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bad05743cdd47139c63fa1f1a8dca1c)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:42:14.174425 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40f6cb7-5e09-4b7b-ab26-a176f788ca6b admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:42:14.257146 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-d40f6cb7-5e09-4b7b-ab26-a176f788ca6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bad05743cdd47139c63fa1f1a8dca1c'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:42:14.264424 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-d40f6cb7-5e09-4b7b-ab26-a176f788ca6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bad05743cdd47139c63fa1f1a8dca1c'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:42:14.284546 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-d40f6cb7-5e09-4b7b-ab26-a176f788ca6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bad05743cdd47139c63fa1f1a8dca1c'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:42:14.285326 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-d40f6cb7-5e09-4b7b-ab26-a176f788ca6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bad05743cdd47139c63fa1f1a8dca1c'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:42:14.286421 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-d40f6cb7-5e09-4b7b-ab26-a176f788ca6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bad05743cdd47139c63fa1f1a8dca1c'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:42:14.310890 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1373/2771] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:42:14 2022] DELETE /identity/v3/users/5bad05743cdd47139c63fa1f1a8dca1c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:42:14.511625 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7cd3b-51db-4d5d-8a38-2eda7af82ae9 service placement] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:42:14.528774 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7cd3b-51db-4d5d-8a38-2eda7af82ae9 service placement] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:42:14.600607 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef77335-fa2b-4c49-876e-5acec908c04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:42:14.601204 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef77335-fa2b-4c49-876e-5acec908c04d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:42:14.601484 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef77335-fa2b-4c49-876e-5acec908c04d admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:42:14.601759 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef77335-fa2b-4c49-876e-5acec908c04d admin admin] PATH_INFO: `/v3/projects/6c2ac5d6c05f475189cb3cf0596db094` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:42:14.603076 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef77335-fa2b-4c49-876e-5acec908c04d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c2ac5d6c05f475189cb3cf0596db094)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:42:14.605051 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef77335-fa2b-4c49-876e-5acec908c04d admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:42:14.664891 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-3ef77335-fa2b-4c49-876e-5acec908c04d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c2ac5d6c05f475189cb3cf0596db094', 'request_id': 'req-3ef77335-fa2b-4c49-876e-5acec908c04d'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:42:14.673937 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-3ef77335-fa2b-4c49-876e-5acec908c04d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c2ac5d6c05f475189cb3cf0596db094', 'request_id': 'req-3ef77335-fa2b-4c49-876e-5acec908c04d'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:42:14.681409 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-3ef77335-fa2b-4c49-876e-5acec908c04d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c2ac5d6c05f475189cb3cf0596db094', 'request_id': 'req-3ef77335-fa2b-4c49-876e-5acec908c04d'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:42:14.694049 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-3ef77335-fa2b-4c49-876e-5acec908c04d admin admin] The token cache is being invalidate because project 6c2ac5d6c05f475189cb3cf0596db094 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:42:14.694360 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-3ef77335-fa2b-4c49-876e-5acec908c04d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:42:14.695012 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-3ef77335-fa2b-4c49-876e-5acec908c04d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:42:14.696796 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1399/2772] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:42:14 2022] DELETE /identity/v3/projects/6c2ac5d6c05f475189cb3cf0596db094 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:42:14.702857 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337acefa-a116-449e-bc13-f7ee55b25a55 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:42:14.703197 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337acefa-a116-449e-bc13-f7ee55b25a55 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:42:14.703629 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337acefa-a116-449e-bc13-f7ee55b25a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:42:14.724633 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-337acefa-a116-449e-bc13-f7ee55b25a55 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:42:14.725903 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-337acefa-a116-449e-bc13-f7ee55b25a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:42:14.793898 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1374/2773] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:42:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:42:14.802835 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515df81-8e6a-473d-8045-e7c32c57015d None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:42:14.803136 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515df81-8e6a-473d-8045-e7c32c57015d None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:42:14.803459 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515df81-8e6a-473d-8045-e7c32c57015d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:42:14.824763 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-7515df81-8e6a-473d-8045-e7c32c57015d None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:42:14.827344 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-7515df81-8e6a-473d-8045-e7c32c57015d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:42:14.834925 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1400/2774] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:42:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:42:14.839649 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337acefa-a116-449e-bc13-f7ee55b25a55 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:42:14.850170 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337acefa-a116-449e-bc13-f7ee55b25a55 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:42:14.856422 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030cfc72-e5d6-460a-9b3b-e23a045856ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:42:14.857081 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030cfc72-e5d6-460a-9b3b-e23a045856ca admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:42:14.857684 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030cfc72-e5d6-460a-9b3b-e23a045856ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:42:14.858126 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030cfc72-e5d6-460a-9b3b-e23a045856ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:42:14.859758 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030cfc72-e5d6-460a-9b3b-e23a045856ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:42:14.860340 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030cfc72-e5d6-460a-9b3b-e23a045856ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:42:14.862753 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030cfc72-e5d6-460a-9b3b-e23a045856ca admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:42:14.865002 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:42:14.888486 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1375/2775] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 2 15:42:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:42:14.893179 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515df81-8e6a-473d-8045-e7c32c57015d None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:42:14.904851 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515df81-8e6a-473d-8045-e7c32c57015d None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:42:14.910913 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dbea3e-c263-49dc-86cd-f5cd4f5c7a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:42:14.911706 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dbea3e-c263-49dc-86cd-f5cd4f5c7a11 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:42:14.912339 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dbea3e-c263-49dc-86cd-f5cd4f5c7a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:42:14.912764 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dbea3e-c263-49dc-86cd-f5cd4f5c7a11 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:42:14.913643 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dbea3e-c263-49dc-86cd-f5cd4f5c7a11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:42:14.915717 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dbea3e-c263-49dc-86cd-f5cd4f5c7a11 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:42:14.953775 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1401/2776] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:42:14 2022] POST /identity/v3/projects => generated 377 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:42:14.958101 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030cfc72-e5d6-460a-9b3b-e23a045856ca admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:42:14.973056 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030cfc72-e5d6-460a-9b3b-e23a045856ca admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:42:15.044694 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501543b2-3966-4541-ac4c-9a288f129cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:42:15.045324 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501543b2-3966-4541-ac4c-9a288f129cea admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:42:15.045672 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501543b2-3966-4541-ac4c-9a288f129cea admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:42:15.045974 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501543b2-3966-4541-ac4c-9a288f129cea admin admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:42:15.047191 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501543b2-3966-4541-ac4c-9a288f129cea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:42:15.049326 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501543b2-3966-4541-ac4c-9a288f129cea admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:42:15.072566 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1376/2777] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:42:14 2022] POST /identity/v3/users => generated 289 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:42:15.077325 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dbea3e-c263-49dc-86cd-f5cd4f5c7a11 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:42:15.089373 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dbea3e-c263-49dc-86cd-f5cd4f5c7a11 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:42:15.094677 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c65822-b652-4430-b470-84cb5aa40c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:42:15.095385 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c65822-b652-4430-b470-84cb5aa40c49 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:42:15.095662 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c65822-b652-4430-b470-84cb5aa40c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:42:15.096047 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c65822-b652-4430-b470-84cb5aa40c49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:42:15.096643 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c65822-b652-4430-b470-84cb5aa40c49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:42:15.098340 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c65822-b652-4430-b470-84cb5aa40c49 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:42:15.116552 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1402/2778] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:42:15.123059 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501543b2-3966-4541-ac4c-9a288f129cea admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:42:15.137103 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501543b2-3966-4541-ac4c-9a288f129cea admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:42:15.143056 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf00242-5b91-446a-89ac-8b633b5e4313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:42:15.144021 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf00242-5b91-446a-89ac-8b633b5e4313 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:42:15.144492 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf00242-5b91-446a-89ac-8b633b5e4313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:42:15.144971 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf00242-5b91-446a-89ac-8b633b5e4313 admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:42:15.146198 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf00242-5b91-446a-89ac-8b633b5e4313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:42:15.148847 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf00242-5b91-446a-89ac-8b633b5e4313 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:42:15.168628 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1377/2779] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:42:15.175490 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c65822-b652-4430-b470-84cb5aa40c49 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:42:15.188849 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c65822-b652-4430-b470-84cb5aa40c49 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:42:15.193905 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7196f08-f2bd-459e-9c91-cb4cfa56bd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:42:15.194592 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7196f08-f2bd-459e-9c91-cb4cfa56bd2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:42:15.194879 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7196f08-f2bd-459e-9c91-cb4cfa56bd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:42:15.195158 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7196f08-f2bd-459e-9c91-cb4cfa56bd2d admin admin] PATH_INFO: `/v3/projects/eb80df3530064d15b29495e9bf027ebd/users/e33ec390eb95447695c28ed29f674db3/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:42:15.212889 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7196f08-f2bd-459e-9c91-cb4cfa56bd2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb80df3530064d15b29495e9bf027ebd, user_id=e33ec390eb95447695c28ed29f674db3, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:42:15.215695 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7196f08-f2bd-459e-9c91-cb4cfa56bd2d admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:42:15.231463 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1403/2780] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:42:15 2022] PUT /identity/v3/projects/eb80df3530064d15b29495e9bf027ebd/users/e33ec390eb95447695c28ed29f674db3/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:42:15.238768 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ded191-a1ee-40ec-b831-cb74ef62c8be None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:42:15.239374 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ded191-a1ee-40ec-b831-cb74ef62c8be None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:42:15.239898 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ded191-a1ee-40ec-b831-cb74ef62c8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:42:15.264003 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-58ded191-a1ee-40ec-b831-cb74ef62c8be None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:42:15.265709 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-58ded191-a1ee-40ec-b831-cb74ef62c8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:42:15.332224 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1378/2781] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:42:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:42:15.342332 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7196f08-f2bd-459e-9c91-cb4cfa56bd2d admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:42:15.344833 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-e7196f08-f2bd-459e-9c91-cb4cfa56bd2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:42:15.360970 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:42:15.414823 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7196f08-f2bd-459e-9c91-cb4cfa56bd2d admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:42:15.418823 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97897b-2e82-4995-8aa0-c2b32528063b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:42:15.419472 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97897b-2e82-4995-8aa0-c2b32528063b service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:42:15.419814 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97897b-2e82-4995-8aa0-c2b32528063b service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:42:15.420340 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97897b-2e82-4995-8aa0-c2b32528063b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:42:15.431372 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed97897b-2e82-4995-8aa0-c2b32528063b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:42:15.432878 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed97897b-2e82-4995-8aa0-c2b32528063b service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:42:15.443079 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1404/2782] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:42:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:42:19.314371 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b0f54-1050-499b-9174-3c69c3d516b2 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:42:19.314939 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b0f54-1050-499b-9174-3c69c3d516b2 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:42:19.314939 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b0f54-1050-499b-9174-3c69c3d516b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:42:19.350351 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-067b0f54-1050-499b-9174-3c69c3d516b2 None None] MFA Rules not processed for user `e33ec390eb95447695c28ed29f674db3`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:42:19.351894 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-067b0f54-1050-499b-9174-3c69c3d516b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:42:19.451903 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1379/2783] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:42:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:42:19.470808 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97897b-2e82-4995-8aa0-c2b32528063b service neutron] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:42:19.472823 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-ed97897b-2e82-4995-8aa0-c2b32528063b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:42:19.566789 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97897b-2e82-4995-8aa0-c2b32528063b service neutron] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:42:19.572910 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a739791b-bda6-4449-b2c8-94bdfd25a80a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0865af59bf43dfa4c84213d7db53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:42:19.573572 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a739791b-bda6-4449-b2c8-94bdfd25a80a service nova] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:42:19.573862 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a739791b-bda6-4449-b2c8-94bdfd25a80a service nova] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:42:19.574132 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a739791b-bda6-4449-b2c8-94bdfd25a80a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:42:19.583826 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a739791b-bda6-4449-b2c8-94bdfd25a80a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:42:19.585775 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a739791b-bda6-4449-b2c8-94bdfd25a80a service nova] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:42:19.595669 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1405/2784] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:42:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:42:21.333916 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc6af3-5913-4d11-a501-b13b13cc2ce7 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:42:21.334461 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc6af3-5913-4d11-a501-b13b13cc2ce7 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:42:21.334461 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc6af3-5913-4d11-a501-b13b13cc2ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:42:21.342170 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:42:21.357764 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-effc6af3-5913-4d11-a501-b13b13cc2ce7 None None] MFA Rules not processed for user `e33ec390eb95447695c28ed29f674db3`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:42:21.359755 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-effc6af3-5913-4d11-a501-b13b13cc2ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:42:21.367367 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1380/2785] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:42:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:42:21.714649 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a739791b-bda6-4449-b2c8-94bdfd25a80a service nova] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:42:21.725624 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a739791b-bda6-4449-b2c8-94bdfd25a80a service nova] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:42:21.729284 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea4720b-b3de-4ede-9dd1-8e0e4544672d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:42:21.729914 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea4720b-b3de-4ede-9dd1-8e0e4544672d service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:42:21.730205 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea4720b-b3de-4ede-9dd1-8e0e4544672d service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:42:21.730481 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea4720b-b3de-4ede-9dd1-8e0e4544672d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:42:21.732363 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-bea4720b-b3de-4ede-9dd1-8e0e4544672d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:42:21.744219 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea4720b-b3de-4ede-9dd1-8e0e4544672d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:42:21.745714 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea4720b-b3de-4ede-9dd1-8e0e4544672d service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:42:21.755931 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1406/2786] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:42:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 15:42:31.352643 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=2 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:42:31.751426 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=60 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:43:55.676850 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc6af3-5913-4d11-a501-b13b13cc2ce7 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:43:55.678305 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-effc6af3-5913-4d11-a501-b13b13cc2ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:43:55.751036 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc6af3-5913-4d11-a501-b13b13cc2ce7 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:43:55.756131 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c54b333-21b2-4110-9c27-743272edb914 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57dfafee636a45ca98fe0e8bb13dd754', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:43:55.757388 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54b333-21b2-4110-9c27-743272edb914 service placement] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:43:55.757677 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54b333-21b2-4110-9c27-743272edb914 service placement] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:43:55.757958 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54b333-21b2-4110-9c27-743272edb914 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:43:55.759809 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-8c54b333-21b2-4110-9c27-743272edb914 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:43:55.772102 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c54b333-21b2-4110-9c27-743272edb914 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:43:55.773791 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c54b333-21b2-4110-9c27-743272edb914 service placement] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:43:55.784935 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1381/2787] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:43:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:44:05.779960 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=32 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:45:09.262935 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea4720b-b3de-4ede-9dd1-8e0e4544672d service neutron] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:45:09.271845 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea4720b-b3de-4ede-9dd1-8e0e4544672d service neutron] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:45:09.275807 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7447adbb-e7fb-49d0-8a53-a5f0b7b9f0ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:45:09.276421 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447adbb-e7fb-49d0-8a53-a5f0b7b9f0ef service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:45:09.276701 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447adbb-e7fb-49d0-8a53-a5f0b7b9f0ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:45:09.276980 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447adbb-e7fb-49d0-8a53-a5f0b7b9f0ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:45:09.278853 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-7447adbb-e7fb-49d0-8a53-a5f0b7b9f0ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:45:09.293124 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7447adbb-e7fb-49d0-8a53-a5f0b7b9f0ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:45:09.294557 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7447adbb-e7fb-49d0-8a53-a5f0b7b9f0ef service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:45:09.307234 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1407/2788] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:45:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:45:10.492855 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c54b333-21b2-4110-9c27-743272edb914 service placement] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:45:10.502657 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c54b333-21b2-4110-9c27-743272edb914 service placement] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:45:10.506349 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177176db-2809-4688-92fd-7c70833bfd73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:45:10.506955 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177176db-2809-4688-92fd-7c70833bfd73 service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:45:10.507264 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177176db-2809-4688-92fd-7c70833bfd73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:45:10.508236 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177176db-2809-4688-92fd-7c70833bfd73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:45:10.510024 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-177176db-2809-4688-92fd-7c70833bfd73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:45:10.523700 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177176db-2809-4688-92fd-7c70833bfd73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:45:10.525114 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177176db-2809-4688-92fd-7c70833bfd73 service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:45:10.537380 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1382/2789] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:45:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:45:16.270486 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ee264-2e73-458e-aa6b-32f4794dfa64 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:45:16.271049 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ee264-2e73-458e-aa6b-32f4794dfa64 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:45:16.271049 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ee264-2e73-458e-aa6b-32f4794dfa64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:45:16.291108 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-2c3ee264-2e73-458e-aa6b-32f4794dfa64 None None] MFA Rules not processed for user `e33ec390eb95447695c28ed29f674db3`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:45:16.292348 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-2c3ee264-2e73-458e-aa6b-32f4794dfa64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:45:16.299161 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1408/2790] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:45:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:45:16.610535 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177176db-2809-4688-92fd-7c70833bfd73 service neutron] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:45:16.620265 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177176db-2809-4688-92fd-7c70833bfd73 service neutron] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:45:16.623965 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac953c7-8daa-4744-be60-876e6af0c979 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:45:16.624579 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac953c7-8daa-4744-be60-876e6af0c979 service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:45:16.624872 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac953c7-8daa-4744-be60-876e6af0c979 service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:45:16.625153 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac953c7-8daa-4744-be60-876e6af0c979 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:45:16.626928 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-2ac953c7-8daa-4744-be60-876e6af0c979 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:45:16.637679 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac953c7-8daa-4744-be60-876e6af0c979 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:45:16.639115 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac953c7-8daa-4744-be60-876e6af0c979 service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:45:16.647534 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1383/2791] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:45:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:45:26.285488 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=9 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:45:26.643764 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=12 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:46:04.339440 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ee264-2e73-458e-aa6b-32f4794dfa64 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:46:04.354421 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ee264-2e73-458e-aa6b-32f4794dfa64 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:46:04.360061 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c1247-bd9a-4959-a45d-b6b61c847284 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:46:04.360844 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c1247-bd9a-4959-a45d-b6b61c847284 service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:46:04.361198 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c1247-bd9a-4959-a45d-b6b61c847284 service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:46:04.361466 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c1247-bd9a-4959-a45d-b6b61c847284 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:46:04.363354 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-b78c1247-bd9a-4959-a45d-b6b61c847284 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:46:04.386260 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78c1247-bd9a-4959-a45d-b6b61c847284 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:46:04.387787 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78c1247-bd9a-4959-a45d-b6b61c847284 service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:46:04.397436 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1409/2792] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:46:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:46:14.392522 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=12 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:46:30.469335 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac953c7-8daa-4744-be60-876e6af0c979 service neutron] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:46:30.548280 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac953c7-8daa-4744-be60-876e6af0c979 service neutron] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:46:30.555054 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34651b94-e735-4495-935b-8ae2139641ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0865af59bf43dfa4c84213d7db53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:46:30.556073 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34651b94-e735-4495-935b-8ae2139641ee service nova] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:46:30.556703 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34651b94-e735-4495-935b-8ae2139641ee service nova] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:46:30.557188 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34651b94-e735-4495-935b-8ae2139641ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:46:30.559279 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-34651b94-e735-4495-935b-8ae2139641ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:46:30.593060 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34651b94-e735-4495-935b-8ae2139641ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:46:30.595027 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34651b94-e735-4495-935b-8ae2139641ee service nova] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:46:30.608015 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1384/2793] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:46:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 15:46:39.790800 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c1247-bd9a-4959-a45d-b6b61c847284 service neutron] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:46:39.792538 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-b78c1247-bd9a-4959-a45d-b6b61c847284 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:46:39.825924 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c1247-bd9a-4959-a45d-b6b61c847284 service neutron] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:46:39.831551 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9c54d4-8604-45eb-b307-99fcb752ad9e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57dfafee636a45ca98fe0e8bb13dd754', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:46:39.832270 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c54d4-8604-45eb-b307-99fcb752ad9e service placement] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:46:39.832581 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c54d4-8604-45eb-b307-99fcb752ad9e service placement] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:46:39.833394 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c54d4-8604-45eb-b307-99fcb752ad9e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:46:39.835350 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-7d9c54d4-8604-45eb-b307-99fcb752ad9e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:46:39.847166 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34651b94-e735-4495-935b-8ae2139641ee service nova] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:46:39.857260 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9c54d4-8604-45eb-b307-99fcb752ad9e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:46:39.858926 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9c54d4-8604-45eb-b307-99fcb752ad9e service placement] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:46:39.870053 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1410/2794] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:46:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:46:39.878037 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34651b94-e735-4495-935b-8ae2139641ee service nova] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:46:39.882669 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef6ab9-46f6-4cf8-8394-daef2a01d5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:46:39.883377 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef6ab9-46f6-4cf8-8394-daef2a01d5a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:46:39.883691 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef6ab9-46f6-4cf8-8394-daef2a01d5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:46:39.883973 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef6ab9-46f6-4cf8-8394-daef2a01d5a5 admin admin] PATH_INFO: `/v3/users/e33ec390eb95447695c28ed29f674db3` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:46:39.885527 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cef6ab9-46f6-4cf8-8394-daef2a01d5a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e33ec390eb95447695c28ed29f674db3)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:46:39.888087 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cef6ab9-46f6-4cf8-8394-daef2a01d5a5 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:46:39.949689 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-5cef6ab9-46f6-4cf8-8394-daef2a01d5a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e33ec390eb95447695c28ed29f674db3'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:46:39.956783 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-5cef6ab9-46f6-4cf8-8394-daef2a01d5a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e33ec390eb95447695c28ed29f674db3'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:46:39.969378 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-5cef6ab9-46f6-4cf8-8394-daef2a01d5a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e33ec390eb95447695c28ed29f674db3'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:46:39.970114 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-5cef6ab9-46f6-4cf8-8394-daef2a01d5a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e33ec390eb95447695c28ed29f674db3'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:46:39.970719 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-5cef6ab9-46f6-4cf8-8394-daef2a01d5a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e33ec390eb95447695c28ed29f674db3'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:46:39.984698 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1385/2795] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:46:39 2022] DELETE /identity/v3/users/e33ec390eb95447695c28ed29f674db3 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:46:40.166866 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9c54d4-8604-45eb-b307-99fcb752ad9e service placement] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:46:40.177934 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9c54d4-8604-45eb-b307-99fcb752ad9e service placement] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:46:40.240465 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bffa25-70e8-4b5f-ab31-e2d17e9ebb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:46:40.241206 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bffa25-70e8-4b5f-ab31-e2d17e9ebb2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:46:40.241539 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bffa25-70e8-4b5f-ab31-e2d17e9ebb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:46:40.241858 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bffa25-70e8-4b5f-ab31-e2d17e9ebb2a admin admin] PATH_INFO: `/v3/projects/eb80df3530064d15b29495e9bf027ebd` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:46:40.243109 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bffa25-70e8-4b5f-ab31-e2d17e9ebb2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb80df3530064d15b29495e9bf027ebd)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:46:40.245807 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bffa25-70e8-4b5f-ab31-e2d17e9ebb2a admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:46:40.294507 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-e5bffa25-70e8-4b5f-ab31-e2d17e9ebb2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb80df3530064d15b29495e9bf027ebd', 'request_id': 'req-e5bffa25-70e8-4b5f-ab31-e2d17e9ebb2a'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:46:40.304413 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-e5bffa25-70e8-4b5f-ab31-e2d17e9ebb2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb80df3530064d15b29495e9bf027ebd', 'request_id': 'req-e5bffa25-70e8-4b5f-ab31-e2d17e9ebb2a'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:46:40.311001 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-e5bffa25-70e8-4b5f-ab31-e2d17e9ebb2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb80df3530064d15b29495e9bf027ebd', 'request_id': 'req-e5bffa25-70e8-4b5f-ab31-e2d17e9ebb2a'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:46:40.335142 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-e5bffa25-70e8-4b5f-ab31-e2d17e9ebb2a admin admin] The token cache is being invalidate because project eb80df3530064d15b29495e9bf027ebd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:46:40.335468 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-e5bffa25-70e8-4b5f-ab31-e2d17e9ebb2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:46:40.336105 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-e5bffa25-70e8-4b5f-ab31-e2d17e9ebb2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:46:40.337610 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1411/2796] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:46:40 2022] DELETE /identity/v3/projects/eb80df3530064d15b29495e9bf027ebd => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:46:40.342804 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0306763-70aa-41b1-b425-62f246ec044a None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:46:40.343133 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0306763-70aa-41b1-b425-62f246ec044a None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:46:40.343444 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0306763-70aa-41b1-b425-62f246ec044a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:46:40.401609 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-c0306763-70aa-41b1-b425-62f246ec044a None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:46:40.402838 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-c0306763-70aa-41b1-b425-62f246ec044a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:46:40.432527 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:46:40.472538 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1386/2797] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:46:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:46:40.480410 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108a566-42e4-4fb3-a4d5-564a6b4de730 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:46:40.480752 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108a566-42e4-4fb3-a4d5-564a6b4de730 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:46:40.481030 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108a566-42e4-4fb3-a4d5-564a6b4de730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:46:40.501819 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-0108a566-42e4-4fb3-a4d5-564a6b4de730 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:46:40.502883 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-0108a566-42e4-4fb3-a4d5-564a6b4de730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:46:40.511404 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1412/2798] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:46:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:46:40.515687 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0306763-70aa-41b1-b425-62f246ec044a None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:46:40.525865 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0306763-70aa-41b1-b425-62f246ec044a None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:46:40.530506 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d1eee-e247-4475-a049-1bc4efcb6254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:46:40.531160 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d1eee-e247-4475-a049-1bc4efcb6254 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:46:40.531484 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d1eee-e247-4475-a049-1bc4efcb6254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:46:40.531763 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d1eee-e247-4475-a049-1bc4efcb6254 admin admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:46:40.532490 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d1eee-e247-4475-a049-1bc4efcb6254 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:46:40.532796 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d1eee-e247-4475-a049-1bc4efcb6254 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:46:40.534401 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d1eee-e247-4475-a049-1bc4efcb6254 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:46:40.546691 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1387/2799] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 2 15:46:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:46:40.551174 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0108a566-42e4-4fb3-a4d5-564a6b4de730 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:46:40.563201 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0108a566-42e4-4fb3-a4d5-564a6b4de730 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:46:40.568491 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970e6f1-acd6-4b7e-a173-f62b063a4845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:46:40.569101 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970e6f1-acd6-4b7e-a173-f62b063a4845 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:46:40.569381 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970e6f1-acd6-4b7e-a173-f62b063a4845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:46:40.569653 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970e6f1-acd6-4b7e-a173-f62b063a4845 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:46:40.570332 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9970e6f1-acd6-4b7e-a173-f62b063a4845 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:46:40.572268 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9970e6f1-acd6-4b7e-a173-f62b063a4845 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:46:40.618590 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1413/2800] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:46:40 2022] POST /identity/v3/projects => generated 383 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:46:40.624308 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d1eee-e247-4475-a049-1bc4efcb6254 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:46:40.641427 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d1eee-e247-4475-a049-1bc4efcb6254 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:46:40.715198 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0423d609-3a37-4996-bf80-d5e8bd225a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:46:40.715785 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423d609-3a37-4996-bf80-d5e8bd225a38 admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:46:40.716069 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423d609-3a37-4996-bf80-d5e8bd225a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:46:40.716344 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423d609-3a37-4996-bf80-d5e8bd225a38 admin admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:46:40.717013 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0423d609-3a37-4996-bf80-d5e8bd225a38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:46:40.719013 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0423d609-3a37-4996-bf80-d5e8bd225a38 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:46:40.744279 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1388/2801] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:46:40 2022] POST /identity/v3/users => generated 292 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:46:40.748314 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970e6f1-acd6-4b7e-a173-f62b063a4845 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:46:40.759979 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970e6f1-acd6-4b7e-a173-f62b063a4845 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:46:40.764868 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995242fb-e4bf-49bb-b4df-c2b1d465795b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:46:40.765491 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995242fb-e4bf-49bb-b4df-c2b1d465795b admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:46:40.765775 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995242fb-e4bf-49bb-b4df-c2b1d465795b admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:46:40.766052 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995242fb-e4bf-49bb-b4df-c2b1d465795b admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:46:40.766750 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995242fb-e4bf-49bb-b4df-c2b1d465795b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:46:40.768401 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995242fb-e4bf-49bb-b4df-c2b1d465795b admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:46:40.779321 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1414/2802] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:46:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:46:40.783563 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0423d609-3a37-4996-bf80-d5e8bd225a38 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:46:40.793808 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0423d609-3a37-4996-bf80-d5e8bd225a38 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:46:40.798490 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef99fa-235b-428b-9ac5-2a7eac9fefbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:46:40.799105 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef99fa-235b-428b-9ac5-2a7eac9fefbb admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:46:40.799421 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef99fa-235b-428b-9ac5-2a7eac9fefbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:46:40.799694 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef99fa-235b-428b-9ac5-2a7eac9fefbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:46:40.800406 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aef99fa-235b-428b-9ac5-2a7eac9fefbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:46:40.802744 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aef99fa-235b-428b-9ac5-2a7eac9fefbb admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:46:40.813876 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1389/2803] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:46:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:46:40.818860 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995242fb-e4bf-49bb-b4df-c2b1d465795b admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:46:40.824240 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:46:40.830795 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995242fb-e4bf-49bb-b4df-c2b1d465795b admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:46:40.836787 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4802abb-06dc-4754-837b-0b12aa485fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:46:40.837655 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4802abb-06dc-4754-837b-0b12aa485fec admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:46:40.837936 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4802abb-06dc-4754-837b-0b12aa485fec admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:46:40.838279 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4802abb-06dc-4754-837b-0b12aa485fec admin admin] PATH_INFO: `/v3/projects/ae8781a094f3427889ff5a19eab223cf/users/5ccafcda3f294c45b9a285af4c0f7b38/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:46:40.854030 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4802abb-06dc-4754-837b-0b12aa485fec admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae8781a094f3427889ff5a19eab223cf, user_id=5ccafcda3f294c45b9a285af4c0f7b38, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:46:40.856726 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4802abb-06dc-4754-837b-0b12aa485fec admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:46:40.870450 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1415/2804] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:46:40 2022] PUT /identity/v3/projects/ae8781a094f3427889ff5a19eab223cf/users/5ccafcda3f294c45b9a285af4c0f7b38/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:46:40.882624 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e62ab-b9e8-4bf4-89cc-aa8502853e94 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:46:40.882624 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e62ab-b9e8-4bf4-89cc-aa8502853e94 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:46:40.882624 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e62ab-b9e8-4bf4-89cc-aa8502853e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:46:40.913768 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-d02e62ab-b9e8-4bf4-89cc-aa8502853e94 None None] MFA Rules not processed for user `5ccafcda3f294c45b9a285af4c0f7b38`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:46:40.915031 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-d02e62ab-b9e8-4bf4-89cc-aa8502853e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:46:40.989995 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1390/2805] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:46:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:46:41.002239 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4802abb-06dc-4754-837b-0b12aa485fec admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:46:41.004692 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-b4802abb-06dc-4754-837b-0b12aa485fec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:46:41.087106 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4802abb-06dc-4754-837b-0b12aa485fec admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:46:41.092854 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8df3ed-5a34-48e8-957f-6da480c9cca9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0865af59bf43dfa4c84213d7db53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:46:41.093473 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8df3ed-5a34-48e8-957f-6da480c9cca9 service nova] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:46:41.093750 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8df3ed-5a34-48e8-957f-6da480c9cca9 service nova] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:46:41.094022 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8df3ed-5a34-48e8-957f-6da480c9cca9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:46:41.102651 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8df3ed-5a34-48e8-957f-6da480c9cca9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:46:41.104273 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8df3ed-5a34-48e8-957f-6da480c9cca9 service nova] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:46:41.113266 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1416/2806] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:46:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:46:48.499973 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e62ab-b9e8-4bf4-89cc-aa8502853e94 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:46:48.528957 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:46:48.563152 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e62ab-b9e8-4bf4-89cc-aa8502853e94 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:46:48.568392 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b04152-4baf-4585-9a29-009d6b87e435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:46:48.569046 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b04152-4baf-4585-9a29-009d6b87e435 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:46:48.569332 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b04152-4baf-4585-9a29-009d6b87e435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:46:48.569610 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b04152-4baf-4585-9a29-009d6b87e435 admin admin] PATH_INFO: `/v3/users/5ccafcda3f294c45b9a285af4c0f7b38` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:46:48.570899 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b04152-4baf-4585-9a29-009d6b87e435 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ccafcda3f294c45b9a285af4c0f7b38)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:46:48.572981 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b04152-4baf-4585-9a29-009d6b87e435 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:46:48.620609 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-e5b04152-4baf-4585-9a29-009d6b87e435 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ccafcda3f294c45b9a285af4c0f7b38'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:46:48.627575 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-e5b04152-4baf-4585-9a29-009d6b87e435 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ccafcda3f294c45b9a285af4c0f7b38'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:46:48.641941 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-e5b04152-4baf-4585-9a29-009d6b87e435 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ccafcda3f294c45b9a285af4c0f7b38'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:46:48.643144 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-e5b04152-4baf-4585-9a29-009d6b87e435 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ccafcda3f294c45b9a285af4c0f7b38'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:46:48.643827 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-e5b04152-4baf-4585-9a29-009d6b87e435 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ccafcda3f294c45b9a285af4c0f7b38'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:46:48.661936 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1391/2807] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:46:48 2022] DELETE /identity/v3/users/5ccafcda3f294c45b9a285af4c0f7b38 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:46:48.667626 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ad709-fec8-452f-a429-2de17384aefd None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:46:48.668150 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ad709-fec8-452f-a429-2de17384aefd None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:46:48.668258 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ad709-fec8-452f-a429-2de17384aefd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:46:48.687422 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-3f0ad709-fec8-452f-a429-2de17384aefd None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:46:48.688642 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-3f0ad709-fec8-452f-a429-2de17384aefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:46:48.749102 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1417/2808] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:46:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:46:48.759576 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b04152-4baf-4585-9a29-009d6b87e435 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:46:48.761049 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-e5b04152-4baf-4585-9a29-009d6b87e435 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:46:48.841771 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b04152-4baf-4585-9a29-009d6b87e435 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:46:48.845499 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acdd347-3408-4291-bc75-a5cb81fd1ea1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:46:48.846123 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acdd347-3408-4291-bc75-a5cb81fd1ea1 service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:46:48.846402 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acdd347-3408-4291-bc75-a5cb81fd1ea1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:46:48.846676 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acdd347-3408-4291-bc75-a5cb81fd1ea1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:46:48.855989 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acdd347-3408-4291-bc75-a5cb81fd1ea1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:46:48.857417 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acdd347-3408-4291-bc75-a5cb81fd1ea1 service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:46:48.867920 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1392/2809] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:46:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:46:49.159966 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ad709-fec8-452f-a429-2de17384aefd None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:46:49.161533 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-3f0ad709-fec8-452f-a429-2de17384aefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:46:49.174194 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ad709-fec8-452f-a429-2de17384aefd None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:46:49.179495 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d39d06-08fd-48f2-a3e2-f386c7a2ec33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:46:49.180407 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d39d06-08fd-48f2-a3e2-f386c7a2ec33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:46:49.180407 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d39d06-08fd-48f2-a3e2-f386c7a2ec33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:46:49.180707 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d39d06-08fd-48f2-a3e2-f386c7a2ec33 admin admin] PATH_INFO: `/v3/projects/ae8781a094f3427889ff5a19eab223cf` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:46:49.181932 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d39d06-08fd-48f2-a3e2-f386c7a2ec33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae8781a094f3427889ff5a19eab223cf)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:46:49.183922 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d39d06-08fd-48f2-a3e2-f386c7a2ec33 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:46:49.256388 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-48d39d06-08fd-48f2-a3e2-f386c7a2ec33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae8781a094f3427889ff5a19eab223cf', 'request_id': 'req-48d39d06-08fd-48f2-a3e2-f386c7a2ec33'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:46:49.263614 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-48d39d06-08fd-48f2-a3e2-f386c7a2ec33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae8781a094f3427889ff5a19eab223cf', 'request_id': 'req-48d39d06-08fd-48f2-a3e2-f386c7a2ec33'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:46:49.265619 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:46:49.270340 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-48d39d06-08fd-48f2-a3e2-f386c7a2ec33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae8781a094f3427889ff5a19eab223cf', 'request_id': 'req-48d39d06-08fd-48f2-a3e2-f386c7a2ec33'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:46:49.283436 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-48d39d06-08fd-48f2-a3e2-f386c7a2ec33 admin admin] The token cache is being invalidate because project ae8781a094f3427889ff5a19eab223cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:46:49.283723 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-48d39d06-08fd-48f2-a3e2-f386c7a2ec33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:46:49.284367 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-48d39d06-08fd-48f2-a3e2-f386c7a2ec33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:46:49.286406 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1418/2810] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:46:49 2022] DELETE /identity/v3/projects/ae8781a094f3427889ff5a19eab223cf => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:46:49.292262 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea425c-4b1b-418e-9129-b76620a66045 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:46:49.292548 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea425c-4b1b-418e-9129-b76620a66045 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:46:49.292825 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea425c-4b1b-418e-9129-b76620a66045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:46:49.313502 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-bbea425c-4b1b-418e-9129-b76620a66045 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:46:49.314703 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-bbea425c-4b1b-418e-9129-b76620a66045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:46:49.340797 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:46:49.385602 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1393/2811] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:46:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:46:49.395141 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1368668-2b7d-4048-b573-84e2f01c8478 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:46:49.395473 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1368668-2b7d-4048-b573-84e2f01c8478 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:46:49.395754 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1368668-2b7d-4048-b573-84e2f01c8478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:46:49.416358 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-e1368668-2b7d-4048-b573-84e2f01c8478 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:46:49.417590 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-e1368668-2b7d-4048-b573-84e2f01c8478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:46:49.425642 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1419/2812] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:46:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:46:49.430802 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea425c-4b1b-418e-9129-b76620a66045 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:46:49.440896 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea425c-4b1b-418e-9129-b76620a66045 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:46:49.445538 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15926f1b-b9e0-43b6-8457-e1fc567bd6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:46:49.446166 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15926f1b-b9e0-43b6-8457-e1fc567bd6d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:46:49.446457 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15926f1b-b9e0-43b6-8457-e1fc567bd6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:46:49.446735 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15926f1b-b9e0-43b6-8457-e1fc567bd6d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:46:49.447494 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15926f1b-b9e0-43b6-8457-e1fc567bd6d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:46:49.447802 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15926f1b-b9e0-43b6-8457-e1fc567bd6d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:46:49.449464 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15926f1b-b9e0-43b6-8457-e1fc567bd6d4 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:46:49.462410 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1394/2813] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 2 15:46:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:46:49.466840 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1368668-2b7d-4048-b573-84e2f01c8478 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:46:49.477072 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1368668-2b7d-4048-b573-84e2f01c8478 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:46:49.481736 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4e474-dbed-42ca-8426-27db4b039840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:46:49.482350 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4e474-dbed-42ca-8426-27db4b039840 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:46:49.482635 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4e474-dbed-42ca-8426-27db4b039840 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:46:49.482914 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4e474-dbed-42ca-8426-27db4b039840 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:46:49.483634 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b4e474-dbed-42ca-8426-27db4b039840 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:46:49.485544 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b4e474-dbed-42ca-8426-27db4b039840 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:46:49.522794 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1420/2814] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:46:49 2022] POST /identity/v3/projects => generated 381 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:46:49.528213 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15926f1b-b9e0-43b6-8457-e1fc567bd6d4 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:46:49.537945 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15926f1b-b9e0-43b6-8457-e1fc567bd6d4 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:46:49.595899 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059e575-405e-4931-b160-30ce52c5632d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:46:49.596606 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059e575-405e-4931-b160-30ce52c5632d admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:46:49.596948 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059e575-405e-4931-b160-30ce52c5632d admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:46:49.597266 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059e575-405e-4931-b160-30ce52c5632d admin admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:46:49.597991 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7059e575-405e-4931-b160-30ce52c5632d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:46:49.600639 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7059e575-405e-4931-b160-30ce52c5632d admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:46:49.622555 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1395/2815] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:46:49 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:46:49.626727 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4e474-dbed-42ca-8426-27db4b039840 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:46:49.637491 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4e474-dbed-42ca-8426-27db4b039840 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:46:49.642330 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4bc11f-aad8-49cc-b318-3c38e27e702e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:46:49.642946 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4bc11f-aad8-49cc-b318-3c38e27e702e admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:46:49.643249 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4bc11f-aad8-49cc-b318-3c38e27e702e admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:46:49.643528 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4bc11f-aad8-49cc-b318-3c38e27e702e admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:46:49.644224 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4bc11f-aad8-49cc-b318-3c38e27e702e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:46:49.646317 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4bc11f-aad8-49cc-b318-3c38e27e702e admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:46:49.658365 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1421/2816] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:46:49.663163 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059e575-405e-4931-b160-30ce52c5632d admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:46:49.673581 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059e575-405e-4931-b160-30ce52c5632d admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:46:49.678732 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e39683e-f3a4-4281-9874-724df347d160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:46:49.679387 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39683e-f3a4-4281-9874-724df347d160 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:46:49.679675 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39683e-f3a4-4281-9874-724df347d160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:46:49.679952 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39683e-f3a4-4281-9874-724df347d160 admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:46:49.680648 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e39683e-f3a4-4281-9874-724df347d160 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:46:49.682356 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e39683e-f3a4-4281-9874-724df347d160 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:46:49.693397 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1396/2817] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 15:46:49.697701 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4bc11f-aad8-49cc-b318-3c38e27e702e admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:46:49.708362 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4bc11f-aad8-49cc-b318-3c38e27e702e admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:46:49.714004 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2fde00-cf56-42bc-bc2a-b0812952f8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:46:49.714004 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2fde00-cf56-42bc-bc2a-b0812952f8ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:46:49.714004 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2fde00-cf56-42bc-bc2a-b0812952f8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:46:49.714569 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2fde00-cf56-42bc-bc2a-b0812952f8ca admin admin] PATH_INFO: `/v3/projects/4c53e3cd9e5846789e9d9e292359b543/users/738540b83cb048be9cd2174ccf1d4a2e/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:46:49.730336 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2fde00-cf56-42bc-bc2a-b0812952f8ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c53e3cd9e5846789e9d9e292359b543, user_id=738540b83cb048be9cd2174ccf1d4a2e, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:46:49.733013 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2fde00-cf56-42bc-bc2a-b0812952f8ca admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:46:49.752372 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1422/2818] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:46:49 2022] PUT /identity/v3/projects/4c53e3cd9e5846789e9d9e292359b543/users/738540b83cb048be9cd2174ccf1d4a2e/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:46:49.762909 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988c2f2-4f4c-4a3d-aa9b-4ea76b411ff4 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:46:49.763198 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988c2f2-4f4c-4a3d-aa9b-4ea76b411ff4 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:46:49.763515 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988c2f2-4f4c-4a3d-aa9b-4ea76b411ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:46:49.792875 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-a988c2f2-4f4c-4a3d-aa9b-4ea76b411ff4 None None] MFA Rules not processed for user `738540b83cb048be9cd2174ccf1d4a2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:46:49.793991 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-a988c2f2-4f4c-4a3d-aa9b-4ea76b411ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:46:49.860823 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1397/2819] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:46:49 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:46:49.866139 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2fde00-cf56-42bc-bc2a-b0812952f8ca admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:46:49.932191 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2fde00-cf56-42bc-bc2a-b0812952f8ca admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:46:49.936856 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa26f78-591d-456a-82ab-a9de5f1f5104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:46:49.937472 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa26f78-591d-456a-82ab-a9de5f1f5104 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:46:49.937752 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa26f78-591d-456a-82ab-a9de5f1f5104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:46:49.938024 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa26f78-591d-456a-82ab-a9de5f1f5104 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:46:49.938699 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa26f78-591d-456a-82ab-a9de5f1f5104 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:46:49.940633 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa26f78-591d-456a-82ab-a9de5f1f5104 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:46:49.968083 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1423/2820] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:46:49 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:46:49.972568 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a988c2f2-4f4c-4a3d-aa9b-4ea76b411ff4 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:46:49.984371 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a988c2f2-4f4c-4a3d-aa9b-4ea76b411ff4 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:46:50.010919 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:46:50.046766 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a49eb78-c0d0-4643-ad2c-73be20e0665b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:46:50.047295 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49eb78-c0d0-4643-ad2c-73be20e0665b admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:46:50.047598 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49eb78-c0d0-4643-ad2c-73be20e0665b admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:46:50.047899 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49eb78-c0d0-4643-ad2c-73be20e0665b admin admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:46:50.048582 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a49eb78-c0d0-4643-ad2c-73be20e0665b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:46:50.050617 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a49eb78-c0d0-4643-ad2c-73be20e0665b admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:46:50.073565 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1398/2821] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:46:49 2022] POST /identity/v3/users => generated 295 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:46:50.077747 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa26f78-591d-456a-82ab-a9de5f1f5104 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:46:50.088785 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa26f78-591d-456a-82ab-a9de5f1f5104 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:46:50.093553 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a41405-8152-4c07-9117-235a45a0382c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:46:50.094176 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a41405-8152-4c07-9117-235a45a0382c admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:46:50.094482 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a41405-8152-4c07-9117-235a45a0382c admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:46:50.094797 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a41405-8152-4c07-9117-235a45a0382c admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:46:50.095556 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a41405-8152-4c07-9117-235a45a0382c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:46:50.097163 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a41405-8152-4c07-9117-235a45a0382c admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:46:50.108863 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1424/2822] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:46:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:46:50.114726 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a49eb78-c0d0-4643-ad2c-73be20e0665b admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:46:50.125103 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a49eb78-c0d0-4643-ad2c-73be20e0665b admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:46:50.129804 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab92ca2-a03f-4506-82f1-7a620f071d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:46:50.130473 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab92ca2-a03f-4506-82f1-7a620f071d45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:46:50.130758 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab92ca2-a03f-4506-82f1-7a620f071d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:46:50.131038 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab92ca2-a03f-4506-82f1-7a620f071d45 admin admin] PATH_INFO: `/v3/projects/cb2eb9bb751e401689cbe312a53e1e22/users/dfd7eb3bb66d449582cdbae57cd0bbc6/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:46:50.153319 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab92ca2-a03f-4506-82f1-7a620f071d45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb2eb9bb751e401689cbe312a53e1e22, user_id=dfd7eb3bb66d449582cdbae57cd0bbc6, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:46:50.156266 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab92ca2-a03f-4506-82f1-7a620f071d45 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:46:50.175528 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1399/2823] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:46:50 2022] PUT /identity/v3/projects/cb2eb9bb751e401689cbe312a53e1e22/users/dfd7eb3bb66d449582cdbae57cd0bbc6/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:46:50.180311 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a41405-8152-4c07-9117-235a45a0382c admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:46:50.190462 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a41405-8152-4c07-9117-235a45a0382c admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:46:50.241742 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:46:50.248958 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f88cf9-0a70-49db-8ff5-637689957ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:46:50.249766 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f88cf9-0a70-49db-8ff5-637689957ea3 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:46:50.250213 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f88cf9-0a70-49db-8ff5-637689957ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:46:50.251055 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f88cf9-0a70-49db-8ff5-637689957ea3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:46:50.252374 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f88cf9-0a70-49db-8ff5-637689957ea3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:46:50.255177 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f88cf9-0a70-49db-8ff5-637689957ea3 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:46:50.265429 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1425/2824] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:46:50 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:46:50.269584 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab92ca2-a03f-4506-82f1-7a620f071d45 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:46:50.280498 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab92ca2-a03f-4506-82f1-7a620f071d45 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:46:50.285143 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932b2b4e-04b3-4810-b9f6-529d58ee6815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:46:50.286376 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b2b4e-04b3-4810-b9f6-529d58ee6815 admin admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:46:50.286657 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b2b4e-04b3-4810-b9f6-529d58ee6815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:46:50.286933 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b2b4e-04b3-4810-b9f6-529d58ee6815 admin admin] PATH_INFO: `/v3/projects/cb2eb9bb751e401689cbe312a53e1e22/users/dfd7eb3bb66d449582cdbae57cd0bbc6/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:46:50.289001 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932b2b4e-04b3-4810-b9f6-529d58ee6815 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb2eb9bb751e401689cbe312a53e1e22, user_id=dfd7eb3bb66d449582cdbae57cd0bbc6, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:46:50.291676 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932b2b4e-04b3-4810-b9f6-529d58ee6815 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:46:50.303206 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1400/2825] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:46:50 2022] PUT /identity/v3/projects/cb2eb9bb751e401689cbe312a53e1e22/users/dfd7eb3bb66d449582cdbae57cd0bbc6/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:46:50.314615 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681bad42-4c94-4377-ba48-f5ca1ec95966 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:46:50.314908 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681bad42-4c94-4377-ba48-f5ca1ec95966 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:46:50.315195 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681bad42-4c94-4377-ba48-f5ca1ec95966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:46:50.353435 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-681bad42-4c94-4377-ba48-f5ca1ec95966 None None] MFA Rules not processed for user `dfd7eb3bb66d449582cdbae57cd0bbc6`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:46:50.354672 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-681bad42-4c94-4377-ba48-f5ca1ec95966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:46:50.432785 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1426/2826] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:46:50 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:46:50.445238 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932b2b4e-04b3-4810-b9f6-529d58ee6815 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:46:50.447018 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-932b2b4e-04b3-4810-b9f6-529d58ee6815 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:46:50.516276 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932b2b4e-04b3-4810-b9f6-529d58ee6815 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:46:50.520625 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a18421e-b7cb-4b68-925e-c6d1e21cb459 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:46:50.521262 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18421e-b7cb-4b68-925e-c6d1e21cb459 service cinder] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:46:50.521548 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18421e-b7cb-4b68-925e-c6d1e21cb459 service cinder] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:46:50.521828 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18421e-b7cb-4b68-925e-c6d1e21cb459 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:46:50.540772 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a18421e-b7cb-4b68-925e-c6d1e21cb459 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:46:50.542266 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a18421e-b7cb-4b68-925e-c6d1e21cb459 service cinder] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:46:50.552940 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1401/2827] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:46:50 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:46:50.884636 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681bad42-4c94-4377-ba48-f5ca1ec95966 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:46:50.894518 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681bad42-4c94-4377-ba48-f5ca1ec95966 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:46:50.899655 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b13fdf7-9221-48aa-a18d-60a3d5cb3395 tempest-VolumeQuotaClassesTest-32382439 tempest-VolumeQuotaClassesTest-32382439-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfd7eb3bb66d449582cdbae57cd0bbc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb2eb9bb751e401689cbe312a53e1e22', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:46:50.900265 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13fdf7-9221-48aa-a18d-60a3d5cb3395 tempest-VolumeQuotaClassesTest-32382439 tempest-VolumeQuotaClassesTest-32382439-project-admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:46:50.900559 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13fdf7-9221-48aa-a18d-60a3d5cb3395 tempest-VolumeQuotaClassesTest-32382439 tempest-VolumeQuotaClassesTest-32382439-project-admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:46:50.900843 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13fdf7-9221-48aa-a18d-60a3d5cb3395 tempest-VolumeQuotaClassesTest-32382439 tempest-VolumeQuotaClassesTest-32382439-project-admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:46:50.901546 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b13fdf7-9221-48aa-a18d-60a3d5cb3395 tempest-VolumeQuotaClassesTest-32382439 tempest-VolumeQuotaClassesTest-32382439-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:46:50.901856 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b13fdf7-9221-48aa-a18d-60a3d5cb3395 tempest-VolumeQuotaClassesTest-32382439 tempest-VolumeQuotaClassesTest-32382439-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:46:50.903486 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b13fdf7-9221-48aa-a18d-60a3d5cb3395 tempest-VolumeQuotaClassesTest-32382439 tempest-VolumeQuotaClassesTest-32382439-project-admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:46:50.917647 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1427/2828] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 2 15:46:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:46:50.922051 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a18421e-b7cb-4b68-925e-c6d1e21cb459 service cinder] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:46:50.931601 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a18421e-b7cb-4b68-925e-c6d1e21cb459 service cinder] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:46:50.936243 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e670c0-3b45-45c3-928d-5e7ad5de8047 tempest-VolumeQuotaClassesTest-32382439 tempest-VolumeQuotaClassesTest-32382439-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfd7eb3bb66d449582cdbae57cd0bbc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb2eb9bb751e401689cbe312a53e1e22', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:46:50.936850 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e670c0-3b45-45c3-928d-5e7ad5de8047 tempest-VolumeQuotaClassesTest-32382439 tempest-VolumeQuotaClassesTest-32382439-project-admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:46:50.937133 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e670c0-3b45-45c3-928d-5e7ad5de8047 tempest-VolumeQuotaClassesTest-32382439 tempest-VolumeQuotaClassesTest-32382439-project-admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:46:50.937411 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e670c0-3b45-45c3-928d-5e7ad5de8047 tempest-VolumeQuotaClassesTest-32382439 tempest-VolumeQuotaClassesTest-32382439-project-admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:46:50.938084 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e670c0-3b45-45c3-928d-5e7ad5de8047 tempest-VolumeQuotaClassesTest-32382439 tempest-VolumeQuotaClassesTest-32382439-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:46:50.940022 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e670c0-3b45-45c3-928d-5e7ad5de8047 tempest-VolumeQuotaClassesTest-32382439 tempest-VolumeQuotaClassesTest-32382439-project-admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:46:50.969478 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1402/2829] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:46:50 2022] POST /identity/v3/projects => generated 355 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:46:50.973598 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b13fdf7-9221-48aa-a18d-60a3d5cb3395 tempest-VolumeQuotaClassesTest-32382439 tempest-VolumeQuotaClassesTest-32382439-project-admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:46:50.983803 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b13fdf7-9221-48aa-a18d-60a3d5cb3395 tempest-VolumeQuotaClassesTest-32382439 tempest-VolumeQuotaClassesTest-32382439-project-admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:46:51.042071 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6bffac-79e6-4680-8947-7c8e280edaf7 tempest-VolumeQuotaClassesTest-32382439 tempest-VolumeQuotaClassesTest-32382439-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfd7eb3bb66d449582cdbae57cd0bbc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb2eb9bb751e401689cbe312a53e1e22', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:46:51.042687 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6bffac-79e6-4680-8947-7c8e280edaf7 tempest-VolumeQuotaClassesTest-32382439 tempest-VolumeQuotaClassesTest-32382439-project-admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:46:51.042969 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6bffac-79e6-4680-8947-7c8e280edaf7 tempest-VolumeQuotaClassesTest-32382439 tempest-VolumeQuotaClassesTest-32382439-project-admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:46:51.043270 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6bffac-79e6-4680-8947-7c8e280edaf7 tempest-VolumeQuotaClassesTest-32382439 tempest-VolumeQuotaClassesTest-32382439-project-admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:46:51.044007 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6bffac-79e6-4680-8947-7c8e280edaf7 tempest-VolumeQuotaClassesTest-32382439 tempest-VolumeQuotaClassesTest-32382439-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:46:51.044313 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6bffac-79e6-4680-8947-7c8e280edaf7 tempest-VolumeQuotaClassesTest-32382439 tempest-VolumeQuotaClassesTest-32382439-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:46:51.045915 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6bffac-79e6-4680-8947-7c8e280edaf7 tempest-VolumeQuotaClassesTest-32382439 tempest-VolumeQuotaClassesTest-32382439-project-admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:46:51.059701 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1428/2830] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 2 15:46:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:46:51.097392 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e670c0-3b45-45c3-928d-5e7ad5de8047 tempest-VolumeQuotaClassesTest-32382439 tempest-VolumeQuotaClassesTest-32382439-project-admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:46:51.107890 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e670c0-3b45-45c3-928d-5e7ad5de8047 tempest-VolumeQuotaClassesTest-32382439 tempest-VolumeQuotaClassesTest-32382439-project-admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:46:51.112695 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc864488-a7b8-4b8d-aafc-758f8896a920 tempest-VolumeQuotaClassesTest-32382439 tempest-VolumeQuotaClassesTest-32382439-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfd7eb3bb66d449582cdbae57cd0bbc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb2eb9bb751e401689cbe312a53e1e22', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:46:51.113341 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc864488-a7b8-4b8d-aafc-758f8896a920 tempest-VolumeQuotaClassesTest-32382439 tempest-VolumeQuotaClassesTest-32382439-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:46:51.114138 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc864488-a7b8-4b8d-aafc-758f8896a920 tempest-VolumeQuotaClassesTest-32382439 tempest-VolumeQuotaClassesTest-32382439-project-admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:46:51.116321 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc864488-a7b8-4b8d-aafc-758f8896a920 tempest-VolumeQuotaClassesTest-32382439 tempest-VolumeQuotaClassesTest-32382439-project-admin] PATH_INFO: `/v3/projects/0e5058573e2f460ea506c78bdaee5bc7` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:46:51.116321 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc864488-a7b8-4b8d-aafc-758f8896a920 tempest-VolumeQuotaClassesTest-32382439 tempest-VolumeQuotaClassesTest-32382439-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0e5058573e2f460ea506c78bdaee5bc7)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:46:51.117570 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc864488-a7b8-4b8d-aafc-758f8896a920 tempest-VolumeQuotaClassesTest-32382439 tempest-VolumeQuotaClassesTest-32382439-project-admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:46:51.165912 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-fc864488-a7b8-4b8d-aafc-758f8896a920 tempest-VolumeQuotaClassesTest-32382439 tempest-VolumeQuotaClassesTest-32382439-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e5058573e2f460ea506c78bdaee5bc7', 'request_id': 'req-fc864488-a7b8-4b8d-aafc-758f8896a920'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:46:51.169753 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=88,keystone:INSERT=7,keystone:DELETE=5 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:46:51.174871 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-fc864488-a7b8-4b8d-aafc-758f8896a920 tempest-VolumeQuotaClassesTest-32382439 tempest-VolumeQuotaClassesTest-32382439-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e5058573e2f460ea506c78bdaee5bc7', 'request_id': 'req-fc864488-a7b8-4b8d-aafc-758f8896a920'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:46:51.185184 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-fc864488-a7b8-4b8d-aafc-758f8896a920 tempest-VolumeQuotaClassesTest-32382439 tempest-VolumeQuotaClassesTest-32382439-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e5058573e2f460ea506c78bdaee5bc7', 'request_id': 'req-fc864488-a7b8-4b8d-aafc-758f8896a920'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:46:51.197491 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-fc864488-a7b8-4b8d-aafc-758f8896a920 tempest-VolumeQuotaClassesTest-32382439 tempest-VolumeQuotaClassesTest-32382439-project-admin] The token cache is being invalidate because project 0e5058573e2f460ea506c78bdaee5bc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80360) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:46:51.197780 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-fc864488-a7b8-4b8d-aafc-758f8896a920 tempest-VolumeQuotaClassesTest-32382439 tempest-VolumeQuotaClassesTest-32382439-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:46:51.198475 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-fc864488-a7b8-4b8d-aafc-758f8896a920 tempest-VolumeQuotaClassesTest-32382439 tempest-VolumeQuotaClassesTest-32382439-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:46:51.200031 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1403/2831] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:46:51 2022] DELETE /identity/v3/projects/0e5058573e2f460ea506c78bdaee5bc7 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:46:51.397577 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6bffac-79e6-4680-8947-7c8e280edaf7 tempest-VolumeQuotaClassesTest-32382439 tempest-VolumeQuotaClassesTest-32382439-project-admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:46:51.399312 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-1a6bffac-79e6-4680-8947-7c8e280edaf7 tempest-VolumeQuotaClassesTest-32382439 tempest-VolumeQuotaClassesTest-32382439-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:46:51.475015 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6bffac-79e6-4680-8947-7c8e280edaf7 tempest-VolumeQuotaClassesTest-32382439 tempest-VolumeQuotaClassesTest-32382439-project-admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:46:51.478590 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=100 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:46:51.531791 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3278195-398b-4f99-8ac5-36d321693eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:46:51.532434 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3278195-398b-4f99-8ac5-36d321693eb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:46:51.532714 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3278195-398b-4f99-8ac5-36d321693eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:46:51.532990 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3278195-398b-4f99-8ac5-36d321693eb4 admin admin] PATH_INFO: `/v3/users/738540b83cb048be9cd2174ccf1d4a2e` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:46:51.534166 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3278195-398b-4f99-8ac5-36d321693eb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=738540b83cb048be9cd2174ccf1d4a2e)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:46:51.536649 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3278195-398b-4f99-8ac5-36d321693eb4 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:46:51.585289 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-e3278195-398b-4f99-8ac5-36d321693eb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '738540b83cb048be9cd2174ccf1d4a2e'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:46:51.597389 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-e3278195-398b-4f99-8ac5-36d321693eb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '738540b83cb048be9cd2174ccf1d4a2e'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:46:51.598608 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-e3278195-398b-4f99-8ac5-36d321693eb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '738540b83cb048be9cd2174ccf1d4a2e'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:46:51.605837 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-e3278195-398b-4f99-8ac5-36d321693eb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '738540b83cb048be9cd2174ccf1d4a2e'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:46:51.614439 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-e3278195-398b-4f99-8ac5-36d321693eb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '738540b83cb048be9cd2174ccf1d4a2e'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:46:51.620809 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1429/2832] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:46:51 2022] DELETE /identity/v3/users/738540b83cb048be9cd2174ccf1d4a2e => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:46:51.625711 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab9f40-c119-44bd-bea4-aae90b868135 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:46:51.626194 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab9f40-c119-44bd-bea4-aae90b868135 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:46:51.626320 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab9f40-c119-44bd-bea4-aae90b868135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:46:51.645621 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-53ab9f40-c119-44bd-bea4-aae90b868135 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:46:51.646727 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-53ab9f40-c119-44bd-bea4-aae90b868135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:46:51.706786 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1404/2833] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:46:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:46:51.718041 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3278195-398b-4f99-8ac5-36d321693eb4 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:46:51.722571 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-e3278195-398b-4f99-8ac5-36d321693eb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:46:51.781951 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3278195-398b-4f99-8ac5-36d321693eb4 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:46:51.786206 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d57de1-5253-4ce1-aea1-a7095068677e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:46:51.786822 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d57de1-5253-4ce1-aea1-a7095068677e service neutron] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:46:51.787104 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d57de1-5253-4ce1-aea1-a7095068677e service neutron] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:46:51.787408 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d57de1-5253-4ce1-aea1-a7095068677e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:46:51.797324 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d57de1-5253-4ce1-aea1-a7095068677e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:46:51.798779 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d57de1-5253-4ce1-aea1-a7095068677e service neutron] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:46:51.809209 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1430/2834] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:46:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:46:52.100775 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab9f40-c119-44bd-bea4-aae90b868135 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:46:52.102201 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-53ab9f40-c119-44bd-bea4-aae90b868135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:46:52.115067 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab9f40-c119-44bd-bea4-aae90b868135 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:46:52.123565 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4240187-047a-4d42-83fb-f2054b799904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:46:52.124324 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4240187-047a-4d42-83fb-f2054b799904 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:46:52.124606 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4240187-047a-4d42-83fb-f2054b799904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:46:52.125215 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4240187-047a-4d42-83fb-f2054b799904 admin admin] PATH_INFO: `/v3/projects/4c53e3cd9e5846789e9d9e292359b543` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:46:52.126605 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4240187-047a-4d42-83fb-f2054b799904 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c53e3cd9e5846789e9d9e292359b543)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:46:52.128929 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4240187-047a-4d42-83fb-f2054b799904 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:46:52.190408 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-e4240187-047a-4d42-83fb-f2054b799904 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c53e3cd9e5846789e9d9e292359b543', 'request_id': 'req-e4240187-047a-4d42-83fb-f2054b799904'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:46:52.199364 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-e4240187-047a-4d42-83fb-f2054b799904 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c53e3cd9e5846789e9d9e292359b543', 'request_id': 'req-e4240187-047a-4d42-83fb-f2054b799904'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:46:52.209566 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-e4240187-047a-4d42-83fb-f2054b799904 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c53e3cd9e5846789e9d9e292359b543', 'request_id': 'req-e4240187-047a-4d42-83fb-f2054b799904'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:46:52.225577 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-e4240187-047a-4d42-83fb-f2054b799904 admin admin] The token cache is being invalidate because project 4c53e3cd9e5846789e9d9e292359b543 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80360) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:46:52.225854 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-e4240187-047a-4d42-83fb-f2054b799904 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:46:52.226521 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-e4240187-047a-4d42-83fb-f2054b799904 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:46:52.228124 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1405/2835] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:46:52 2022] DELETE /identity/v3/projects/4c53e3cd9e5846789e9d9e292359b543 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:46:52.232283 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d57de1-5253-4ce1-aea1-a7095068677e service neutron] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:46:52.242104 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d57de1-5253-4ce1-aea1-a7095068677e service neutron] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:46:52.270479 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:46:52.304189 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe7fa8a-40b1-4897-8ff0-ca09d6004c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:46:52.304834 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe7fa8a-40b1-4897-8ff0-ca09d6004c1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:46:52.305115 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe7fa8a-40b1-4897-8ff0-ca09d6004c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:46:52.305389 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe7fa8a-40b1-4897-8ff0-ca09d6004c1d admin admin] PATH_INFO: `/v3/users/dfd7eb3bb66d449582cdbae57cd0bbc6` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:46:52.306610 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe7fa8a-40b1-4897-8ff0-ca09d6004c1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfd7eb3bb66d449582cdbae57cd0bbc6)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:46:52.308591 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe7fa8a-40b1-4897-8ff0-ca09d6004c1d admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:46:52.357629 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-abe7fa8a-40b1-4897-8ff0-ca09d6004c1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfd7eb3bb66d449582cdbae57cd0bbc6'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:46:52.369646 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-abe7fa8a-40b1-4897-8ff0-ca09d6004c1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfd7eb3bb66d449582cdbae57cd0bbc6'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:46:52.370372 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-abe7fa8a-40b1-4897-8ff0-ca09d6004c1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfd7eb3bb66d449582cdbae57cd0bbc6'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:46:52.377567 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-abe7fa8a-40b1-4897-8ff0-ca09d6004c1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfd7eb3bb66d449582cdbae57cd0bbc6'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:46:52.386304 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-abe7fa8a-40b1-4897-8ff0-ca09d6004c1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfd7eb3bb66d449582cdbae57cd0bbc6'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:46:52.392889 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1431/2836] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:46:52 2022] DELETE /identity/v3/users/dfd7eb3bb66d449582cdbae57cd0bbc6 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:46:52.670945 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4240187-047a-4d42-83fb-f2054b799904 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:46:52.672431 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-e4240187-047a-4d42-83fb-f2054b799904 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:46:52.691447 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4240187-047a-4d42-83fb-f2054b799904 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:46:52.749820 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c72941-c0d3-45f6-9e48-b46e5cfc8dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:46:52.750404 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c72941-c0d3-45f6-9e48-b46e5cfc8dac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:46:52.750682 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c72941-c0d3-45f6-9e48-b46e5cfc8dac admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:46:52.750956 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c72941-c0d3-45f6-9e48-b46e5cfc8dac admin admin] PATH_INFO: `/v3/projects/cb2eb9bb751e401689cbe312a53e1e22` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:46:52.752141 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c72941-c0d3-45f6-9e48-b46e5cfc8dac admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb2eb9bb751e401689cbe312a53e1e22)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:46:52.754035 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c72941-c0d3-45f6-9e48-b46e5cfc8dac admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:46:52.763147 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:46:52.803227 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-65c72941-c0d3-45f6-9e48-b46e5cfc8dac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb2eb9bb751e401689cbe312a53e1e22', 'request_id': 'req-65c72941-c0d3-45f6-9e48-b46e5cfc8dac'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:46:52.811975 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-65c72941-c0d3-45f6-9e48-b46e5cfc8dac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb2eb9bb751e401689cbe312a53e1e22', 'request_id': 'req-65c72941-c0d3-45f6-9e48-b46e5cfc8dac'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:46:52.819601 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-65c72941-c0d3-45f6-9e48-b46e5cfc8dac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb2eb9bb751e401689cbe312a53e1e22', 'request_id': 'req-65c72941-c0d3-45f6-9e48-b46e5cfc8dac'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:46:52.830590 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-65c72941-c0d3-45f6-9e48-b46e5cfc8dac admin admin] The token cache is being invalidate because project cb2eb9bb751e401689cbe312a53e1e22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80360) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:46:52.830879 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-65c72941-c0d3-45f6-9e48-b46e5cfc8dac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:46:52.831679 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-65c72941-c0d3-45f6-9e48-b46e5cfc8dac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:46:52.833262 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1406/2837] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:46:52 2022] DELETE /identity/v3/projects/cb2eb9bb751e401689cbe312a53e1e22 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 15:46:52.838194 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069229e-4da6-4803-b8c7-cae0480a7e95 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:46:52.838490 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069229e-4da6-4803-b8c7-cae0480a7e95 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:46:52.838771 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069229e-4da6-4803-b8c7-cae0480a7e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:46:52.859391 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-6069229e-4da6-4803-b8c7-cae0480a7e95 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:46:52.860605 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-6069229e-4da6-4803-b8c7-cae0480a7e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:46:52.920922 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1432/2838] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:46:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:46:52.931957 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001166c-a650-4dd4-b728-2d9a266aa7ab None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:46:52.932459 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001166c-a650-4dd4-b728-2d9a266aa7ab None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:46:52.932939 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001166c-a650-4dd4-b728-2d9a266aa7ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:46:52.954735 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-6001166c-a650-4dd4-b728-2d9a266aa7ab None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:46:52.956026 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-6001166c-a650-4dd4-b728-2d9a266aa7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:46:52.964294 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1407/2839] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:46:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:46:52.972228 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6069229e-4da6-4803-b8c7-cae0480a7e95 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:46:52.982859 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6069229e-4da6-4803-b8c7-cae0480a7e95 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:46:52.987637 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72833f94-34fb-4c65-8001-97e65a42061e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:46:52.988251 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72833f94-34fb-4c65-8001-97e65a42061e admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:46:52.988531 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72833f94-34fb-4c65-8001-97e65a42061e admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:46:52.989333 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72833f94-34fb-4c65-8001-97e65a42061e admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:46:52.990033 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72833f94-34fb-4c65-8001-97e65a42061e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:46:52.990481 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72833f94-34fb-4c65-8001-97e65a42061e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:46:52.991981 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72833f94-34fb-4c65-8001-97e65a42061e admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:46:53.004936 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1433/2840] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 2 15:46:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:46:53.010925 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6001166c-a650-4dd4-b728-2d9a266aa7ab None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:46:53.022438 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6001166c-a650-4dd4-b728-2d9a266aa7ab None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:46:53.029721 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1968b7-4910-4325-9f32-177e2de5a583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:46:53.030336 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1968b7-4910-4325-9f32-177e2de5a583 admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:46:53.030615 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1968b7-4910-4325-9f32-177e2de5a583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:46:53.030897 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1968b7-4910-4325-9f32-177e2de5a583 admin admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:46:53.031589 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1968b7-4910-4325-9f32-177e2de5a583 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:46:53.033482 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1968b7-4910-4325-9f32-177e2de5a583 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:46:53.062473 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1408/2841] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:46:53 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:46:53.066662 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72833f94-34fb-4c65-8001-97e65a42061e admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:46:53.076824 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72833f94-34fb-4c65-8001-97e65a42061e admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:46:53.109254 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:46:53.140421 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb61907-fb8c-4681-a8b7-2d22eafd168b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:46:53.141033 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb61907-fb8c-4681-a8b7-2d22eafd168b admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:46:53.141311 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb61907-fb8c-4681-a8b7-2d22eafd168b admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:46:53.141583 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb61907-fb8c-4681-a8b7-2d22eafd168b admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:46:53.142236 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb61907-fb8c-4681-a8b7-2d22eafd168b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:46:53.144246 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb61907-fb8c-4681-a8b7-2d22eafd168b admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:46:53.166168 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1434/2842] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:46:53 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:46:53.170470 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1968b7-4910-4325-9f32-177e2de5a583 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:46:53.181672 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1968b7-4910-4325-9f32-177e2de5a583 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:46:53.186271 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc997c6-7834-429f-93c3-b499cd41fdb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:46:53.186876 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc997c6-7834-429f-93c3-b499cd41fdb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:46:53.187156 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc997c6-7834-429f-93c3-b499cd41fdb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:46:53.187459 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc997c6-7834-429f-93c3-b499cd41fdb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:46:53.188146 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc997c6-7834-429f-93c3-b499cd41fdb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:46:53.189732 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc997c6-7834-429f-93c3-b499cd41fdb7 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:46:53.200045 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1409/2843] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:46:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:46:53.204160 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb61907-fb8c-4681-a8b7-2d22eafd168b admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:46:53.214683 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb61907-fb8c-4681-a8b7-2d22eafd168b admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:46:53.219454 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d83affe-c656-4c08-82ff-7af880727915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:46:53.220075 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d83affe-c656-4c08-82ff-7af880727915 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:46:53.220356 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d83affe-c656-4c08-82ff-7af880727915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:46:53.220631 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d83affe-c656-4c08-82ff-7af880727915 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:46:53.221325 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d83affe-c656-4c08-82ff-7af880727915 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:46:53.223046 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d83affe-c656-4c08-82ff-7af880727915 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:46:53.234028 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1435/2844] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:46:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:46:53.238256 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc997c6-7834-429f-93c3-b499cd41fdb7 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:46:53.248584 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc997c6-7834-429f-93c3-b499cd41fdb7 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:46:53.253469 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff526c-860a-4263-9cbf-b5c4fe364530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:46:53.254151 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff526c-860a-4263-9cbf-b5c4fe364530 admin admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:46:53.254434 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff526c-860a-4263-9cbf-b5c4fe364530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:46:53.254716 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff526c-860a-4263-9cbf-b5c4fe364530 admin admin] PATH_INFO: `/v3/projects/e3351dec69964e639e9ebd45cfd265aa/users/abcc057b99a14e438e4732748c1a7818/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:46:53.270629 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ff526c-860a-4263-9cbf-b5c4fe364530 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3351dec69964e639e9ebd45cfd265aa, user_id=abcc057b99a14e438e4732748c1a7818, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:46:53.273306 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ff526c-860a-4263-9cbf-b5c4fe364530 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:46:53.286677 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1410/2845] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:46:53 2022] PUT /identity/v3/projects/e3351dec69964e639e9ebd45cfd265aa/users/abcc057b99a14e438e4732748c1a7818/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:46:53.291999 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64ac3f-845e-4092-a4b0-c1f840c4f787 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:46:53.292321 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64ac3f-845e-4092-a4b0-c1f840c4f787 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:46:53.292606 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64ac3f-845e-4092-a4b0-c1f840c4f787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:46:53.312001 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-bb64ac3f-845e-4092-a4b0-c1f840c4f787 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:46:53.313217 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-bb64ac3f-845e-4092-a4b0-c1f840c4f787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:46:53.372409 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1436/2846] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:46:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:46:53.382111 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff526c-860a-4263-9cbf-b5c4fe364530 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:46:53.383839 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-83ff526c-860a-4263-9cbf-b5c4fe364530 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:46:53.442344 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff526c-860a-4263-9cbf-b5c4fe364530 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:46:53.446323 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba84ffc-496d-49c4-bdd1-e728128ee4ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:46:53.446949 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba84ffc-496d-49c4-bdd1-e728128ee4ae service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:46:53.447262 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba84ffc-496d-49c4-bdd1-e728128ee4ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:46:53.447548 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba84ffc-496d-49c4-bdd1-e728128ee4ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:46:53.456848 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba84ffc-496d-49c4-bdd1-e728128ee4ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:46:53.458837 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba84ffc-496d-49c4-bdd1-e728128ee4ae service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:46:53.468472 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1411/2847] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:46:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:46:54.134819 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0dab9-1e57-4ea3-8362-1b82a4fd127c None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:46:54.135157 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0dab9-1e57-4ea3-8362-1b82a4fd127c None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:46:54.135481 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0dab9-1e57-4ea3-8362-1b82a4fd127c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:46:54.173489 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-ddf0dab9-1e57-4ea3-8362-1b82a4fd127c None None] MFA Rules not processed for user `abcc057b99a14e438e4732748c1a7818`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:46:54.174730 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-ddf0dab9-1e57-4ea3-8362-1b82a4fd127c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:46:54.252285 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1437/2848] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:46:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:46:54.257723 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba84ffc-496d-49c4-bdd1-e728128ee4ae service neutron] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:46:54.267947 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba84ffc-496d-49c4-bdd1-e728128ee4ae service neutron] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:46:54.273174 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1115b3-e476-47ae-bce4-d01f4be7c5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:46:54.274001 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1115b3-e476-47ae-bce4-d01f4be7c5dd admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:46:54.274150 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1115b3-e476-47ae-bce4-d01f4be7c5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:46:54.274332 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1115b3-e476-47ae-bce4-d01f4be7c5dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:46:54.275025 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1115b3-e476-47ae-bce4-d01f4be7c5dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:46:54.276972 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1115b3-e476-47ae-bce4-d01f4be7c5dd admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:46:54.312021 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1412/2849] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:46:54 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 15:46:54.313516 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf0dab9-1e57-4ea3-8362-1b82a4fd127c None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:46:54.325934 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf0dab9-1e57-4ea3-8362-1b82a4fd127c None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:46:54.369379 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:46:54.385263 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e2f821-359e-43a4-b316-d063b5858c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:46:54.385886 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2f821-359e-43a4-b316-d063b5858c68 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:46:54.386168 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2f821-359e-43a4-b316-d063b5858c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:46:54.386446 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2f821-359e-43a4-b316-d063b5858c68 admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:46:54.387112 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e2f821-359e-43a4-b316-d063b5858c68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:46:54.389067 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e2f821-359e-43a4-b316-d063b5858c68 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:46:54.409714 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1438/2850] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:46:54 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:46:54.414369 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1115b3-e476-47ae-bce4-d01f4be7c5dd admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:46:54.425005 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1115b3-e476-47ae-bce4-d01f4be7c5dd admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:46:54.430352 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf75bec-035d-465f-8814-1809e4946fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:46:54.430966 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf75bec-035d-465f-8814-1809e4946fb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:46:54.431268 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf75bec-035d-465f-8814-1809e4946fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:46:54.431549 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf75bec-035d-465f-8814-1809e4946fb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:46:54.432255 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf75bec-035d-465f-8814-1809e4946fb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:46:54.433851 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf75bec-035d-465f-8814-1809e4946fb3 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:46:54.444784 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1413/2851] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:46:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 15:46:54.449176 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e2f821-359e-43a4-b316-d063b5858c68 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:46:54.459470 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e2f821-359e-43a4-b316-d063b5858c68 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:46:54.464044 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a3a56-25d4-4d4a-a9d3-8402afb24ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:46:54.464708 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a3a56-25d4-4d4a-a9d3-8402afb24ddb admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:46:54.464990 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a3a56-25d4-4d4a-a9d3-8402afb24ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:46:54.465269 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a3a56-25d4-4d4a-a9d3-8402afb24ddb admin admin] PATH_INFO: `/v3/projects/e08944700d91446e8e30c758d358b27a/users/d1583e98b8d746d687c53cf763ad39cd/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:46:54.482106 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a3a56-25d4-4d4a-a9d3-8402afb24ddb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e08944700d91446e8e30c758d358b27a, user_id=d1583e98b8d746d687c53cf763ad39cd, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:46:54.484767 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a3a56-25d4-4d4a-a9d3-8402afb24ddb admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:46:54.499388 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1439/2852] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:46:54 2022] PUT /identity/v3/projects/e08944700d91446e8e30c758d358b27a/users/d1583e98b8d746d687c53cf763ad39cd/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:46:54.503727 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf75bec-035d-465f-8814-1809e4946fb3 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:46:54.509105 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:46:54.515578 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf75bec-035d-465f-8814-1809e4946fb3 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:46:54.574967 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d3300-1327-411c-856b-bc96b961b8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:46:54.575524 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d3300-1327-411c-856b-bc96b961b8dc admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:46:54.575802 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d3300-1327-411c-856b-bc96b961b8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:46:54.576077 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d3300-1327-411c-856b-bc96b961b8dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:46:54.576757 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4d3300-1327-411c-856b-bc96b961b8dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:46:54.578350 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4d3300-1327-411c-856b-bc96b961b8dc admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:46:54.589145 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1414/2853] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:46:54 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 15:46:54.593763 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a3a56-25d4-4d4a-a9d3-8402afb24ddb admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:46:54.604588 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a3a56-25d4-4d4a-a9d3-8402afb24ddb admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:46:54.610420 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786ce85a-fc24-46b5-8a4d-4f68d9e8e6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:46:54.611087 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ce85a-fc24-46b5-8a4d-4f68d9e8e6e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:46:54.611400 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ce85a-fc24-46b5-8a4d-4f68d9e8e6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:46:54.611678 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ce85a-fc24-46b5-8a4d-4f68d9e8e6e8 admin admin] PATH_INFO: `/v3/projects/e08944700d91446e8e30c758d358b27a/users/d1583e98b8d746d687c53cf763ad39cd/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:46:54.613660 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786ce85a-fc24-46b5-8a4d-4f68d9e8e6e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e08944700d91446e8e30c758d358b27a, user_id=d1583e98b8d746d687c53cf763ad39cd, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:46:54.616345 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786ce85a-fc24-46b5-8a4d-4f68d9e8e6e8 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:46:54.627033 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1440/2854] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:46:54 2022] PUT /identity/v3/projects/e08944700d91446e8e30c758d358b27a/users/d1583e98b8d746d687c53cf763ad39cd/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:46:55.299102 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb83c73-95c0-454e-9bb2-8245d8d5ae48 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:46:55.299683 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb83c73-95c0-454e-9bb2-8245d8d5ae48 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:46:55.299774 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb83c73-95c0-454e-9bb2-8245d8d5ae48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:46:55.331559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-edb83c73-95c0-454e-9bb2-8245d8d5ae48 None None] MFA Rules not processed for user `d1583e98b8d746d687c53cf763ad39cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:46:55.332834 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-edb83c73-95c0-454e-9bb2-8245d8d5ae48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:46:55.409547 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1415/2855] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:46:55 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 15:46:55.423769 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786ce85a-fc24-46b5-8a4d-4f68d9e8e6e8 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:46:55.425524 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-786ce85a-fc24-46b5-8a4d-4f68d9e8e6e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:46:55.495269 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786ce85a-fc24-46b5-8a4d-4f68d9e8e6e8 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:46:55.498879 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28997365-ec77-4095-b8b1-9637bbc21bd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:46:55.499532 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28997365-ec77-4095-b8b1-9637bbc21bd4 service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:46:55.499818 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28997365-ec77-4095-b8b1-9637bbc21bd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:46:55.500094 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28997365-ec77-4095-b8b1-9637bbc21bd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:46:55.556179 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28997365-ec77-4095-b8b1-9637bbc21bd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:46:55.557976 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28997365-ec77-4095-b8b1-9637bbc21bd4 service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:46:55.566901 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1441/2856] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:46:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:46:56.930390 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb83c73-95c0-454e-9bb2-8245d8d5ae48 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:46:56.931797 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-edb83c73-95c0-454e-9bb2-8245d8d5ae48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:46:56.944464 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb83c73-95c0-454e-9bb2-8245d8d5ae48 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:46:56.948031 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26735faf-c9ef-47e9-91f3-59755811c245 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:46:56.948648 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26735faf-c9ef-47e9-91f3-59755811c245 service cinder] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:46:56.948927 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26735faf-c9ef-47e9-91f3-59755811c245 service cinder] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:46:56.949199 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26735faf-c9ef-47e9-91f3-59755811c245 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:46:56.959331 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26735faf-c9ef-47e9-91f3-59755811c245 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:46:56.960795 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26735faf-c9ef-47e9-91f3-59755811c245 service cinder] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:46:56.970616 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1416/2857] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:46:56 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:47:05.562851 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=72,keystone:INSERT=5 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:47:06.966178 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=68 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:47:10.203568 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28997365-ec77-4095-b8b1-9637bbc21bd4 service cinder] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:47:10.271359 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28997365-ec77-4095-b8b1-9637bbc21bd4 service cinder] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:47:10.276159 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d51b2a-d6ea-426f-a85a-cd8a17c27a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:47:10.276806 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d51b2a-d6ea-426f-a85a-cd8a17c27a34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:47:10.277091 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d51b2a-d6ea-426f-a85a-cd8a17c27a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:47:10.277369 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d51b2a-d6ea-426f-a85a-cd8a17c27a34 admin admin] PATH_INFO: `/v3/users/abcc057b99a14e438e4732748c1a7818` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:47:10.278554 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d51b2a-d6ea-426f-a85a-cd8a17c27a34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abcc057b99a14e438e4732748c1a7818)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:47:10.280516 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d51b2a-d6ea-426f-a85a-cd8a17c27a34 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:47:10.334862 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-87d51b2a-d6ea-426f-a85a-cd8a17c27a34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abcc057b99a14e438e4732748c1a7818'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:47:10.348289 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-87d51b2a-d6ea-426f-a85a-cd8a17c27a34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abcc057b99a14e438e4732748c1a7818'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:47:10.349366 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-87d51b2a-d6ea-426f-a85a-cd8a17c27a34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abcc057b99a14e438e4732748c1a7818'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:47:10.358091 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-87d51b2a-d6ea-426f-a85a-cd8a17c27a34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abcc057b99a14e438e4732748c1a7818'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:47:10.366529 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-87d51b2a-d6ea-426f-a85a-cd8a17c27a34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abcc057b99a14e438e4732748c1a7818'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:47:10.373106 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1442/2858] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:47:10 2022] DELETE /identity/v3/users/abcc057b99a14e438e4732748c1a7818 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:47:10.557059 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26735faf-c9ef-47e9-91f3-59755811c245 service cinder] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:47:10.568550 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26735faf-c9ef-47e9-91f3-59755811c245 service cinder] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:47:10.628181 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fb897c-0589-49d0-b54a-3761f23cb745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:47:10.628764 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb897c-0589-49d0-b54a-3761f23cb745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:47:10.629048 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb897c-0589-49d0-b54a-3761f23cb745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:47:10.629326 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb897c-0589-49d0-b54a-3761f23cb745 admin admin] PATH_INFO: `/v3/projects/e3351dec69964e639e9ebd45cfd265aa` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:47:10.630493 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fb897c-0589-49d0-b54a-3761f23cb745 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3351dec69964e639e9ebd45cfd265aa)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:47:10.632460 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fb897c-0589-49d0-b54a-3761f23cb745 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:47:10.691491 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-63fb897c-0589-49d0-b54a-3761f23cb745 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3351dec69964e639e9ebd45cfd265aa', 'request_id': 'req-63fb897c-0589-49d0-b54a-3761f23cb745'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:47:10.701215 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-63fb897c-0589-49d0-b54a-3761f23cb745 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3351dec69964e639e9ebd45cfd265aa', 'request_id': 'req-63fb897c-0589-49d0-b54a-3761f23cb745'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:47:10.708347 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-63fb897c-0589-49d0-b54a-3761f23cb745 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3351dec69964e639e9ebd45cfd265aa', 'request_id': 'req-63fb897c-0589-49d0-b54a-3761f23cb745'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:47:10.719054 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-63fb897c-0589-49d0-b54a-3761f23cb745 admin admin] The token cache is being invalidate because project e3351dec69964e639e9ebd45cfd265aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80360) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:47:10.719402 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-63fb897c-0589-49d0-b54a-3761f23cb745 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:47:10.720055 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-63fb897c-0589-49d0-b54a-3761f23cb745 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:47:10.721618 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1417/2859] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:47:10 2022] DELETE /identity/v3/projects/e3351dec69964e639e9ebd45cfd265aa => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:47:10.729489 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d51b2a-d6ea-426f-a85a-cd8a17c27a34 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:47:10.730973 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-87d51b2a-d6ea-426f-a85a-cd8a17c27a34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:47:10.744795 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d51b2a-d6ea-426f-a85a-cd8a17c27a34 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:47:10.802781 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a427738-2379-47c0-9a54-bea0b60d9c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:47:10.803465 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a427738-2379-47c0-9a54-bea0b60d9c31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:47:10.803747 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a427738-2379-47c0-9a54-bea0b60d9c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:47:10.804028 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a427738-2379-47c0-9a54-bea0b60d9c31 admin admin] PATH_INFO: `/v3/users/d1583e98b8d746d687c53cf763ad39cd` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:47:10.805227 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a427738-2379-47c0-9a54-bea0b60d9c31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1583e98b8d746d687c53cf763ad39cd)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:47:10.807165 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a427738-2379-47c0-9a54-bea0b60d9c31 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:47:10.830640 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:47:10.858133 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-2a427738-2379-47c0-9a54-bea0b60d9c31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1583e98b8d746d687c53cf763ad39cd'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:47:10.870568 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-2a427738-2379-47c0-9a54-bea0b60d9c31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1583e98b8d746d687c53cf763ad39cd'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:47:10.871344 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-2a427738-2379-47c0-9a54-bea0b60d9c31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1583e98b8d746d687c53cf763ad39cd'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:47:10.879595 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-2a427738-2379-47c0-9a54-bea0b60d9c31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1583e98b8d746d687c53cf763ad39cd'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:47:10.888307 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-2a427738-2379-47c0-9a54-bea0b60d9c31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1583e98b8d746d687c53cf763ad39cd'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:47:10.895457 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1443/2860] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:47:10 2022] DELETE /identity/v3/users/d1583e98b8d746d687c53cf763ad39cd => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:47:11.076838 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fb897c-0589-49d0-b54a-3761f23cb745 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:47:11.078487 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-63fb897c-0589-49d0-b54a-3761f23cb745 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:47:11.092151 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fb897c-0589-49d0-b54a-3761f23cb745 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:47:11.155485 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f722000f-172e-46ee-bd63-71c4baaab89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:47:11.156252 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722000f-172e-46ee-bd63-71c4baaab89a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:47:11.156543 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722000f-172e-46ee-bd63-71c4baaab89a admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:47:11.156822 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722000f-172e-46ee-bd63-71c4baaab89a admin admin] PATH_INFO: `/v3/projects/e08944700d91446e8e30c758d358b27a` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:47:11.158086 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f722000f-172e-46ee-bd63-71c4baaab89a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e08944700d91446e8e30c758d358b27a)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:47:11.160113 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f722000f-172e-46ee-bd63-71c4baaab89a admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:47:11.201118 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:47:11.215525 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-f722000f-172e-46ee-bd63-71c4baaab89a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e08944700d91446e8e30c758d358b27a', 'request_id': 'req-f722000f-172e-46ee-bd63-71c4baaab89a'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:47:11.223660 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-f722000f-172e-46ee-bd63-71c4baaab89a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e08944700d91446e8e30c758d358b27a', 'request_id': 'req-f722000f-172e-46ee-bd63-71c4baaab89a'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:47:11.230851 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-f722000f-172e-46ee-bd63-71c4baaab89a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e08944700d91446e8e30c758d358b27a', 'request_id': 'req-f722000f-172e-46ee-bd63-71c4baaab89a'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:47:11.242072 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-f722000f-172e-46ee-bd63-71c4baaab89a admin admin] The token cache is being invalidate because project e08944700d91446e8e30c758d358b27a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80360) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:47:11.242360 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-f722000f-172e-46ee-bd63-71c4baaab89a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:47:11.243085 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-f722000f-172e-46ee-bd63-71c4baaab89a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:47:11.244649 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1418/2861] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:47:11 2022] DELETE /identity/v3/projects/e08944700d91446e8e30c758d358b27a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:47:11.249768 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3a59e-4f83-45c9-864c-92f442039425 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:47:11.250295 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3a59e-4f83-45c9-864c-92f442039425 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:47:11.250403 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3a59e-4f83-45c9-864c-92f442039425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:47:11.270640 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-def3a59e-4f83-45c9-864c-92f442039425 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:47:11.272180 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-def3a59e-4f83-45c9-864c-92f442039425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:47:11.335899 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1444/2862] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:47:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:47:11.344173 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea383bb-17e0-4581-8966-a73ec98d9fa5 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:47:11.344463 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea383bb-17e0-4581-8966-a73ec98d9fa5 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:47:11.344745 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea383bb-17e0-4581-8966-a73ec98d9fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:47:11.365467 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-4ea383bb-17e0-4581-8966-a73ec98d9fa5 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:47:11.366710 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-4ea383bb-17e0-4581-8966-a73ec98d9fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:47:11.374885 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1419/2863] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:47:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:47:11.380007 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def3a59e-4f83-45c9-864c-92f442039425 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:47:11.389957 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def3a59e-4f83-45c9-864c-92f442039425 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:47:11.396772 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243dc640-93f6-43bf-95f5-9b046ad0260a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:47:11.397401 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243dc640-93f6-43bf-95f5-9b046ad0260a admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:47:11.397684 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243dc640-93f6-43bf-95f5-9b046ad0260a admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:47:11.398164 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243dc640-93f6-43bf-95f5-9b046ad0260a admin admin] PATH_INFO: `/v3/domains` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:47:11.398874 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243dc640-93f6-43bf-95f5-9b046ad0260a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:47:11.399181 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243dc640-93f6-43bf-95f5-9b046ad0260a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:47:11.400816 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243dc640-93f6-43bf-95f5-9b046ad0260a admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:47:11.413676 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1445/2864] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 2 15:47:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:47:11.418537 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea383bb-17e0-4581-8966-a73ec98d9fa5 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:47:11.432915 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea383bb-17e0-4581-8966-a73ec98d9fa5 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:47:11.440819 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29511b20-9343-43f2-83fc-32d1514ce826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:47:11.442459 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29511b20-9343-43f2-83fc-32d1514ce826 admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:47:11.442899 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29511b20-9343-43f2-83fc-32d1514ce826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:47:11.443397 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29511b20-9343-43f2-83fc-32d1514ce826 admin admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:47:11.444365 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29511b20-9343-43f2-83fc-32d1514ce826 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:47:11.447440 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29511b20-9343-43f2-83fc-32d1514ce826 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:47:11.489339 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1420/2865] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:47:11 2022] POST /identity/v3/projects => generated 377 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 15:47:11.493536 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243dc640-93f6-43bf-95f5-9b046ad0260a admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:47:11.504406 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243dc640-93f6-43bf-95f5-9b046ad0260a admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:47:11.561767 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e007b3ed-2218-4b70-8e72-62a8b28c571d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:47:11.562381 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e007b3ed-2218-4b70-8e72-62a8b28c571d admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:47:11.562662 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e007b3ed-2218-4b70-8e72-62a8b28c571d admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:47:11.562938 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e007b3ed-2218-4b70-8e72-62a8b28c571d admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:47:11.563647 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e007b3ed-2218-4b70-8e72-62a8b28c571d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:47:11.565587 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e007b3ed-2218-4b70-8e72-62a8b28c571d admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:47:11.587900 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1446/2866] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:47:11 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:47:11.592148 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29511b20-9343-43f2-83fc-32d1514ce826 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:47:11.603406 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29511b20-9343-43f2-83fc-32d1514ce826 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:47:11.608140 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f5331-759e-47b7-8e0e-4c462d6d2135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:47:11.608757 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f5331-759e-47b7-8e0e-4c462d6d2135 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:47:11.609042 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f5331-759e-47b7-8e0e-4c462d6d2135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:47:11.609317 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f5331-759e-47b7-8e0e-4c462d6d2135 admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:47:11.610007 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9f5331-759e-47b7-8e0e-4c462d6d2135 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:47:11.611700 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9f5331-759e-47b7-8e0e-4c462d6d2135 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:47:11.625482 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1421/2867] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:47:11.632836 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e007b3ed-2218-4b70-8e72-62a8b28c571d admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:47:11.643413 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e007b3ed-2218-4b70-8e72-62a8b28c571d admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:47:11.648670 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db4275-1f1b-4adf-9550-a54224937872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:47:11.649516 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db4275-1f1b-4adf-9550-a54224937872 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:47:11.649970 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db4275-1f1b-4adf-9550-a54224937872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:47:11.650258 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db4275-1f1b-4adf-9550-a54224937872 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:47:11.651084 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90db4275-1f1b-4adf-9550-a54224937872 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:47:11.653518 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90db4275-1f1b-4adf-9550-a54224937872 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:47:11.665988 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1447/2868] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:47:11.670404 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f5331-759e-47b7-8e0e-4c462d6d2135 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:47:11.681687 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f5331-759e-47b7-8e0e-4c462d6d2135 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:47:11.687143 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26cd1f0-73b0-4a88-af8f-48efbb5d74af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:47:11.687836 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26cd1f0-73b0-4a88-af8f-48efbb5d74af admin admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:47:11.688114 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26cd1f0-73b0-4a88-af8f-48efbb5d74af admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:47:11.688399 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26cd1f0-73b0-4a88-af8f-48efbb5d74af admin admin] PATH_INFO: `/v3/projects/92d3362bdf8b4708ac7bab3ef8daa36b/users/3a1bf14f5a3744f0b3ed834a94a2d43b/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:47:11.703441 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26cd1f0-73b0-4a88-af8f-48efbb5d74af admin admin] RBAC: Authorizing `identity:create_grant(project_id=92d3362bdf8b4708ac7bab3ef8daa36b, user_id=3a1bf14f5a3744f0b3ed834a94a2d43b, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:47:11.706245 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26cd1f0-73b0-4a88-af8f-48efbb5d74af admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:47:11.725378 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1422/2869] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:47:11 2022] PUT /identity/v3/projects/92d3362bdf8b4708ac7bab3ef8daa36b/users/3a1bf14f5a3744f0b3ed834a94a2d43b/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:47:11.736105 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e64083-ec8e-437f-9959-932950de3e14 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:47:11.736444 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e64083-ec8e-437f-9959-932950de3e14 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:47:11.736642 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e64083-ec8e-437f-9959-932950de3e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:47:11.745592 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:47:11.769391 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-f7e64083-ec8e-437f-9959-932950de3e14 None None] MFA Rules not processed for user `3a1bf14f5a3744f0b3ed834a94a2d43b`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:47:11.770598 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-f7e64083-ec8e-437f-9959-932950de3e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:47:11.837171 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1448/2870] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:47:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:47:11.841762 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26cd1f0-73b0-4a88-af8f-48efbb5d74af admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:47:11.905626 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26cd1f0-73b0-4a88-af8f-48efbb5d74af admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:47:11.910977 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5dc9b9-300d-440e-a9c7-c85edb867086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:47:11.911642 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5dc9b9-300d-440e-a9c7-c85edb867086 admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:47:11.911927 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5dc9b9-300d-440e-a9c7-c85edb867086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:47:11.912207 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5dc9b9-300d-440e-a9c7-c85edb867086 admin admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:47:11.912874 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5dc9b9-300d-440e-a9c7-c85edb867086 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:47:11.914780 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5dc9b9-300d-440e-a9c7-c85edb867086 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:47:11.943620 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1423/2871] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:47:11 2022] POST /identity/v3/projects => generated 375 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:47:11.947682 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e64083-ec8e-437f-9959-932950de3e14 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:47:11.958913 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e64083-ec8e-437f-9959-932950de3e14 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:47:12.017723 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b52f52-ef0c-43af-9d51-f313fdef9994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:47:12.018344 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b52f52-ef0c-43af-9d51-f313fdef9994 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:47:12.018627 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b52f52-ef0c-43af-9d51-f313fdef9994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:47:12.018903 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b52f52-ef0c-43af-9d51-f313fdef9994 admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:47:12.020138 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b52f52-ef0c-43af-9d51-f313fdef9994 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:47:12.022063 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b52f52-ef0c-43af-9d51-f313fdef9994 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:47:12.043786 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1449/2872] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:47:11 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:47:12.048045 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5dc9b9-300d-440e-a9c7-c85edb867086 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:47:12.058853 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5dc9b9-300d-440e-a9c7-c85edb867086 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:47:12.063569 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a6105b-def3-4e09-8582-57ec7ea24310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:47:12.064189 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a6105b-def3-4e09-8582-57ec7ea24310 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:47:12.064477 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a6105b-def3-4e09-8582-57ec7ea24310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:47:12.064759 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a6105b-def3-4e09-8582-57ec7ea24310 admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:47:12.065456 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a6105b-def3-4e09-8582-57ec7ea24310 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:47:12.067096 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a6105b-def3-4e09-8582-57ec7ea24310 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:47:12.078970 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1424/2873] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:47:12.083600 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b52f52-ef0c-43af-9d51-f313fdef9994 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:47:12.093743 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b52f52-ef0c-43af-9d51-f313fdef9994 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:47:12.099011 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0398099-93ed-4b49-a8e1-aa422c1cd297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:47:12.099660 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0398099-93ed-4b49-a8e1-aa422c1cd297 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:47:12.099949 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0398099-93ed-4b49-a8e1-aa422c1cd297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:47:12.100222 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0398099-93ed-4b49-a8e1-aa422c1cd297 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:47:12.100940 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0398099-93ed-4b49-a8e1-aa422c1cd297 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:47:12.102546 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0398099-93ed-4b49-a8e1-aa422c1cd297 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:47:12.113042 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1450/2874] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:47:12.117388 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a6105b-def3-4e09-8582-57ec7ea24310 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:47:12.128103 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a6105b-def3-4e09-8582-57ec7ea24310 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:47:12.133251 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3997f67f-68f5-40ac-a149-8bf63d24956d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:47:12.133961 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997f67f-68f5-40ac-a149-8bf63d24956d admin admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:47:12.134259 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997f67f-68f5-40ac-a149-8bf63d24956d admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:47:12.134528 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997f67f-68f5-40ac-a149-8bf63d24956d admin admin] PATH_INFO: `/v3/projects/3ed06b34db9a4195b5ca8a180e431e3e/users/06b46b00bdb44351be2828b04f3e3d93/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:47:12.153855 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3997f67f-68f5-40ac-a149-8bf63d24956d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ed06b34db9a4195b5ca8a180e431e3e, user_id=06b46b00bdb44351be2828b04f3e3d93, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:47:12.156589 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3997f67f-68f5-40ac-a149-8bf63d24956d admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:47:12.172172 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1425/2875] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:47:12 2022] PUT /identity/v3/projects/3ed06b34db9a4195b5ca8a180e431e3e/users/06b46b00bdb44351be2828b04f3e3d93/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:47:12.183876 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e2852-bc7d-4f11-88b5-22a738633143 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:47:12.184226 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e2852-bc7d-4f11-88b5-22a738633143 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:47:12.184507 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e2852-bc7d-4f11-88b5-22a738633143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:47:12.213631 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-568e2852-bc7d-4f11-88b5-22a738633143 None None] MFA Rules not processed for user `06b46b00bdb44351be2828b04f3e3d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:47:12.214755 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-568e2852-bc7d-4f11-88b5-22a738633143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:47:12.281897 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1451/2876] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:47:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:47:12.287095 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3997f67f-68f5-40ac-a149-8bf63d24956d admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:47:12.296488 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:47:12.355499 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3997f67f-68f5-40ac-a149-8bf63d24956d admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:47:12.360077 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5c671-6e59-4f41-af83-4680e2487610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:47:12.360686 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5c671-6e59-4f41-af83-4680e2487610 admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:47:12.360963 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5c671-6e59-4f41-af83-4680e2487610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:47:12.361232 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5c671-6e59-4f41-af83-4680e2487610 admin admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:47:12.361896 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a5c671-6e59-4f41-af83-4680e2487610 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:47:12.363850 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a5c671-6e59-4f41-af83-4680e2487610 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:47:12.390298 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1426/2877] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:47:12 2022] POST /identity/v3/projects => generated 375 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:47:12.396920 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e2852-bc7d-4f11-88b5-22a738633143 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:47:12.400719 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:47:12.408405 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e2852-bc7d-4f11-88b5-22a738633143 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:47:12.467361 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55b4a5-45f4-4cd6-8f7d-43b078f639a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:47:12.467890 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55b4a5-45f4-4cd6-8f7d-43b078f639a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:47:12.468174 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55b4a5-45f4-4cd6-8f7d-43b078f639a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:47:12.468451 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55b4a5-45f4-4cd6-8f7d-43b078f639a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:47:12.469127 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc55b4a5-45f4-4cd6-8f7d-43b078f639a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:47:12.471080 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc55b4a5-45f4-4cd6-8f7d-43b078f639a8 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:47:12.493872 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1452/2878] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:47:12 2022] POST /identity/v3/users => generated 294 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:47:12.498117 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5c671-6e59-4f41-af83-4680e2487610 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:47:12.509101 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5c671-6e59-4f41-af83-4680e2487610 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:47:12.513793 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d3a772-ff63-4a3d-91df-f481888702b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:47:12.514450 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3a772-ff63-4a3d-91df-f481888702b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:47:12.514766 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3a772-ff63-4a3d-91df-f481888702b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:47:12.515055 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3a772-ff63-4a3d-91df-f481888702b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:47:12.515813 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d3a772-ff63-4a3d-91df-f481888702b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:47:12.517454 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d3a772-ff63-4a3d-91df-f481888702b6 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:47:12.530595 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1427/2879] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:47:12.538455 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55b4a5-45f4-4cd6-8f7d-43b078f639a8 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:47:12.549194 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55b4a5-45f4-4cd6-8f7d-43b078f639a8 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:47:12.554267 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c9d5d4-f229-48af-bf3a-a1e73d9e32cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:47:12.554991 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9d5d4-f229-48af-bf3a-a1e73d9e32cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:47:12.555326 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9d5d4-f229-48af-bf3a-a1e73d9e32cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:47:12.555523 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9d5d4-f229-48af-bf3a-a1e73d9e32cf admin admin] PATH_INFO: `/v3/projects/39831e9ec2cd41d980681d0dfeb619b3/users/2274c321faa343ce9296f64462c71d85/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:47:12.571492 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c9d5d4-f229-48af-bf3a-a1e73d9e32cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=39831e9ec2cd41d980681d0dfeb619b3, user_id=2274c321faa343ce9296f64462c71d85, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:47:12.574167 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c9d5d4-f229-48af-bf3a-a1e73d9e32cf admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:47:12.589932 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1453/2880] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:47:12 2022] PUT /identity/v3/projects/39831e9ec2cd41d980681d0dfeb619b3/users/2274c321faa343ce9296f64462c71d85/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:47:12.594905 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d3a772-ff63-4a3d-91df-f481888702b6 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:47:12.605626 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d3a772-ff63-4a3d-91df-f481888702b6 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:47:12.669542 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a8950-525e-4d98-ad98-2c0485bef4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:47:12.670160 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a8950-525e-4d98-ad98-2c0485bef4f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:47:12.670440 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a8950-525e-4d98-ad98-2c0485bef4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:47:12.670716 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a8950-525e-4d98-ad98-2c0485bef4f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:47:12.671434 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468a8950-525e-4d98-ad98-2c0485bef4f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:47:12.673023 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468a8950-525e-4d98-ad98-2c0485bef4f3 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:47:12.683309 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1428/2881] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:47:12.687600 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c9d5d4-f229-48af-bf3a-a1e73d9e32cf admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:47:12.698583 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c9d5d4-f229-48af-bf3a-a1e73d9e32cf admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:47:12.703494 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f4e0a5-1d2d-4dd9-b53b-2701f3fadc77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:47:12.704162 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4e0a5-1d2d-4dd9-b53b-2701f3fadc77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:47:12.704461 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4e0a5-1d2d-4dd9-b53b-2701f3fadc77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:47:12.704717 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4e0a5-1d2d-4dd9-b53b-2701f3fadc77 admin admin] PATH_INFO: `/v3/projects/39831e9ec2cd41d980681d0dfeb619b3/users/2274c321faa343ce9296f64462c71d85/roles/d75c9572cb294caeb8eb456521ff6f57` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:47:12.707380 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f4e0a5-1d2d-4dd9-b53b-2701f3fadc77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39831e9ec2cd41d980681d0dfeb619b3, user_id=2274c321faa343ce9296f64462c71d85, role_id=d75c9572cb294caeb8eb456521ff6f57)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:47:12.710049 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f4e0a5-1d2d-4dd9-b53b-2701f3fadc77 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:47:12.721012 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1454/2882] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:47:12 2022] PUT /identity/v3/projects/39831e9ec2cd41d980681d0dfeb619b3/users/2274c321faa343ce9296f64462c71d85/roles/d75c9572cb294caeb8eb456521ff6f57 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:47:12.731262 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd522082-04d6-468e-8fc4-b499bbd06d79 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:47:12.731554 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd522082-04d6-468e-8fc4-b499bbd06d79 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:47:12.731834 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd522082-04d6-468e-8fc4-b499bbd06d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:47:12.761073 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-bd522082-04d6-468e-8fc4-b499bbd06d79 None None] MFA Rules not processed for user `2274c321faa343ce9296f64462c71d85`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:47:12.762304 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-bd522082-04d6-468e-8fc4-b499bbd06d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:47:12.833170 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1429/2883] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:47:12 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:47:12.844542 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f4e0a5-1d2d-4dd9-b53b-2701f3fadc77 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:47:12.846359 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-71f4e0a5-1d2d-4dd9-b53b-2701f3fadc77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:47:12.907035 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f4e0a5-1d2d-4dd9-b53b-2701f3fadc77 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:47:12.911303 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a88ae0f-43aa-4434-85cb-ad69296c7ef7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:47:12.911922 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88ae0f-43aa-4434-85cb-ad69296c7ef7 service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:47:12.912201 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88ae0f-43aa-4434-85cb-ad69296c7ef7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:47:12.912475 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88ae0f-43aa-4434-85cb-ad69296c7ef7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:47:12.971810 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a88ae0f-43aa-4434-85cb-ad69296c7ef7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:47:12.973788 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a88ae0f-43aa-4434-85cb-ad69296c7ef7 service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:47:12.983114 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1455/2884] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:47:12 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:47:14.518266 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd522082-04d6-468e-8fc4-b499bbd06d79 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:47:14.519809 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-bd522082-04d6-468e-8fc4-b499bbd06d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:47:14.527618 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:47:14.533505 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd522082-04d6-468e-8fc4-b499bbd06d79 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:47:14.537579 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3e9a5-40e9-4463-824d-f1127e3c06f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:47:14.538204 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3e9a5-40e9-4463-824d-f1127e3c06f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:47:14.538559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3e9a5-40e9-4463-824d-f1127e3c06f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:47:14.538830 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3e9a5-40e9-4463-824d-f1127e3c06f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:47:14.603018 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f3e9a5-40e9-4463-824d-f1127e3c06f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:47:14.604576 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f3e9a5-40e9-4463-824d-f1127e3c06f6 service cinder] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:47:14.614518 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1430/2885] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:47:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:47:15.189560 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a88ae0f-43aa-4434-85cb-ad69296c7ef7 service cinder] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:47:15.199042 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a88ae0f-43aa-4434-85cb-ad69296c7ef7 service cinder] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:47:15.202736 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af712a3d-9416-4825-be0d-06a1bbe8b00f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:47:15.203376 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af712a3d-9416-4825-be0d-06a1bbe8b00f service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:47:15.203656 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af712a3d-9416-4825-be0d-06a1bbe8b00f service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:47:15.203927 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af712a3d-9416-4825-be0d-06a1bbe8b00f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:47:15.211268 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:47:15.213624 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af712a3d-9416-4825-be0d-06a1bbe8b00f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:47:15.215090 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af712a3d-9416-4825-be0d-06a1bbe8b00f service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:47:15.226892 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1456/2886] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:47:15 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:47:19.136956 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3e9a5-40e9-4463-824d-f1127e3c06f6 service cinder] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:47:19.204917 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3e9a5-40e9-4463-824d-f1127e3c06f6 service cinder] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:47:19.210233 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699194b3-fbef-47f2-a2c4-38ed6049b254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:47:19.210884 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699194b3-fbef-47f2-a2c4-38ed6049b254 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:47:19.211164 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699194b3-fbef-47f2-a2c4-38ed6049b254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:47:19.211469 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699194b3-fbef-47f2-a2c4-38ed6049b254 admin admin] PATH_INFO: `/v3/users/3a1bf14f5a3744f0b3ed834a94a2d43b` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:47:19.212656 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699194b3-fbef-47f2-a2c4-38ed6049b254 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a1bf14f5a3744f0b3ed834a94a2d43b)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:47:19.214575 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699194b3-fbef-47f2-a2c4-38ed6049b254 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:47:19.263312 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-699194b3-fbef-47f2-a2c4-38ed6049b254 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a1bf14f5a3744f0b3ed834a94a2d43b'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:47:19.271151 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-699194b3-fbef-47f2-a2c4-38ed6049b254 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a1bf14f5a3744f0b3ed834a94a2d43b'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:47:19.283449 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-699194b3-fbef-47f2-a2c4-38ed6049b254 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a1bf14f5a3744f0b3ed834a94a2d43b'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:47:19.284210 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-699194b3-fbef-47f2-a2c4-38ed6049b254 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a1bf14f5a3744f0b3ed834a94a2d43b'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:47:19.284826 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-699194b3-fbef-47f2-a2c4-38ed6049b254 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a1bf14f5a3744f0b3ed834a94a2d43b'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:47:19.303353 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1431/2887] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:47:19 2022] DELETE /identity/v3/users/3a1bf14f5a3744f0b3ed834a94a2d43b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 15:47:19.308026 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91749310-2805-45fb-9759-61875b928421 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:47:19.308523 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91749310-2805-45fb-9759-61875b928421 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:47:19.308655 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91749310-2805-45fb-9759-61875b928421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:47:19.327786 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-91749310-2805-45fb-9759-61875b928421 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:47:19.328982 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-91749310-2805-45fb-9759-61875b928421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:47:19.389922 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1457/2888] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:47:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:47:19.400390 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699194b3-fbef-47f2-a2c4-38ed6049b254 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:47:19.401823 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-699194b3-fbef-47f2-a2c4-38ed6049b254 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:47:19.424037 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:47:19.463017 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699194b3-fbef-47f2-a2c4-38ed6049b254 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:47:19.466798 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b6a43b-e36b-4357-a3d2-f7e81728f73d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:47:19.467460 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b6a43b-e36b-4357-a3d2-f7e81728f73d service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:47:19.467744 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b6a43b-e36b-4357-a3d2-f7e81728f73d service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:47:19.468020 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b6a43b-e36b-4357-a3d2-f7e81728f73d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:47:19.477418 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b6a43b-e36b-4357-a3d2-f7e81728f73d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:47:19.478858 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b6a43b-e36b-4357-a3d2-f7e81728f73d service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:47:19.489272 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1432/2889] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:47:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 15:47:19.768280 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91749310-2805-45fb-9759-61875b928421 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:47:19.769929 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-91749310-2805-45fb-9759-61875b928421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:47:19.787156 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91749310-2805-45fb-9759-61875b928421 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:47:19.792135 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bb8f29-4b8e-452b-9201-eeefa47fdadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:47:19.792705 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb8f29-4b8e-452b-9201-eeefa47fdadf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:47:19.793012 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb8f29-4b8e-452b-9201-eeefa47fdadf admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:47:19.793252 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb8f29-4b8e-452b-9201-eeefa47fdadf admin admin] PATH_INFO: `/v3/projects/92d3362bdf8b4708ac7bab3ef8daa36b` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:47:19.794445 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bb8f29-4b8e-452b-9201-eeefa47fdadf admin admin] RBAC: Authorizing `identity:delete_project(project_id=92d3362bdf8b4708ac7bab3ef8daa36b)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:47:19.796427 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bb8f29-4b8e-452b-9201-eeefa47fdadf admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:47:19.851426 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-95bb8f29-4b8e-452b-9201-eeefa47fdadf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92d3362bdf8b4708ac7bab3ef8daa36b', 'request_id': 'req-95bb8f29-4b8e-452b-9201-eeefa47fdadf'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:47:19.860296 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-95bb8f29-4b8e-452b-9201-eeefa47fdadf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92d3362bdf8b4708ac7bab3ef8daa36b', 'request_id': 'req-95bb8f29-4b8e-452b-9201-eeefa47fdadf'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:47:19.867973 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-95bb8f29-4b8e-452b-9201-eeefa47fdadf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92d3362bdf8b4708ac7bab3ef8daa36b', 'request_id': 'req-95bb8f29-4b8e-452b-9201-eeefa47fdadf'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:47:19.878464 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-95bb8f29-4b8e-452b-9201-eeefa47fdadf admin admin] The token cache is being invalidate because project 92d3362bdf8b4708ac7bab3ef8daa36b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:47:19.878750 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-95bb8f29-4b8e-452b-9201-eeefa47fdadf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:47:19.879437 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-95bb8f29-4b8e-452b-9201-eeefa47fdadf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:47:19.881005 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1458/2890] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:47:19 2022] DELETE /identity/v3/projects/92d3362bdf8b4708ac7bab3ef8daa36b => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:47:19.885181 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b6a43b-e36b-4357-a3d2-f7e81728f73d service neutron] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:47:19.895246 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b6a43b-e36b-4357-a3d2-f7e81728f73d service neutron] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:47:19.953349 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e78c639-11b6-478d-96cf-09c491a38e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:47:19.953900 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78c639-11b6-478d-96cf-09c491a38e89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:47:19.954180 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78c639-11b6-478d-96cf-09c491a38e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:47:19.954452 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78c639-11b6-478d-96cf-09c491a38e89 admin admin] PATH_INFO: `/v3/users/06b46b00bdb44351be2828b04f3e3d93` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:47:19.955649 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e78c639-11b6-478d-96cf-09c491a38e89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06b46b00bdb44351be2828b04f3e3d93)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:47:19.957559 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e78c639-11b6-478d-96cf-09c491a38e89 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:47:20.009960 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-4e78c639-11b6-478d-96cf-09c491a38e89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06b46b00bdb44351be2828b04f3e3d93'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:47:20.017128 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-4e78c639-11b6-478d-96cf-09c491a38e89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06b46b00bdb44351be2828b04f3e3d93'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:47:20.028949 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-4e78c639-11b6-478d-96cf-09c491a38e89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06b46b00bdb44351be2828b04f3e3d93'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:47:20.029647 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-4e78c639-11b6-478d-96cf-09c491a38e89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06b46b00bdb44351be2828b04f3e3d93'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:47:20.030254 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-4e78c639-11b6-478d-96cf-09c491a38e89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06b46b00bdb44351be2828b04f3e3d93'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:47:20.044863 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1433/2891] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:47:19 2022] DELETE /identity/v3/users/06b46b00bdb44351be2828b04f3e3d93 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:47:20.328001 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bb8f29-4b8e-452b-9201-eeefa47fdadf admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:47:20.329561 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-95bb8f29-4b8e-452b-9201-eeefa47fdadf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:47:20.343269 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bb8f29-4b8e-452b-9201-eeefa47fdadf admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:47:20.401244 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8097a5-4704-4725-9f08-3d7bb91cce14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:47:20.401834 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8097a5-4704-4725-9f08-3d7bb91cce14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:47:20.402118 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8097a5-4704-4725-9f08-3d7bb91cce14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:47:20.402389 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8097a5-4704-4725-9f08-3d7bb91cce14 admin admin] PATH_INFO: `/v3/projects/3ed06b34db9a4195b5ca8a180e431e3e` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:47:20.403595 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8097a5-4704-4725-9f08-3d7bb91cce14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ed06b34db9a4195b5ca8a180e431e3e)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:47:20.405497 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8097a5-4704-4725-9f08-3d7bb91cce14 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:47:20.440367 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:47:20.468948 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-7a8097a5-4704-4725-9f08-3d7bb91cce14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ed06b34db9a4195b5ca8a180e431e3e', 'request_id': 'req-7a8097a5-4704-4725-9f08-3d7bb91cce14'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:47:20.479058 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-7a8097a5-4704-4725-9f08-3d7bb91cce14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ed06b34db9a4195b5ca8a180e431e3e', 'request_id': 'req-7a8097a5-4704-4725-9f08-3d7bb91cce14'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:47:20.485784 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-7a8097a5-4704-4725-9f08-3d7bb91cce14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ed06b34db9a4195b5ca8a180e431e3e', 'request_id': 'req-7a8097a5-4704-4725-9f08-3d7bb91cce14'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:47:20.496079 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-7a8097a5-4704-4725-9f08-3d7bb91cce14 admin admin] The token cache is being invalidate because project 3ed06b34db9a4195b5ca8a180e431e3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:47:20.496373 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-7a8097a5-4704-4725-9f08-3d7bb91cce14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:47:20.497036 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-7a8097a5-4704-4725-9f08-3d7bb91cce14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:47:20.498574 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1459/2892] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:47:20 2022] DELETE /identity/v3/projects/3ed06b34db9a4195b5ca8a180e431e3e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:47:20.502663 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e78c639-11b6-478d-96cf-09c491a38e89 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:47:20.504201 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-4e78c639-11b6-478d-96cf-09c491a38e89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:47:20.517093 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e78c639-11b6-478d-96cf-09c491a38e89 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:47:20.558862 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:47:20.576591 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da10431-cc80-4d3f-9c9a-489bcefd86d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:47:20.577241 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da10431-cc80-4d3f-9c9a-489bcefd86d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:47:20.577526 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da10431-cc80-4d3f-9c9a-489bcefd86d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:47:20.577811 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da10431-cc80-4d3f-9c9a-489bcefd86d1 admin admin] PATH_INFO: `/v3/users/2274c321faa343ce9296f64462c71d85` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:47:20.578985 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da10431-cc80-4d3f-9c9a-489bcefd86d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2274c321faa343ce9296f64462c71d85)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:47:20.580959 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da10431-cc80-4d3f-9c9a-489bcefd86d1 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:47:20.631469 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-7da10431-cc80-4d3f-9c9a-489bcefd86d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2274c321faa343ce9296f64462c71d85'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:47:20.639434 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-7da10431-cc80-4d3f-9c9a-489bcefd86d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2274c321faa343ce9296f64462c71d85'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:47:20.653051 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-7da10431-cc80-4d3f-9c9a-489bcefd86d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2274c321faa343ce9296f64462c71d85'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:47:20.653784 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-7da10431-cc80-4d3f-9c9a-489bcefd86d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2274c321faa343ce9296f64462c71d85'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:47:20.654408 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-7da10431-cc80-4d3f-9c9a-489bcefd86d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2274c321faa343ce9296f64462c71d85'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:47:20.667859 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1434/2893] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:47:20 2022] DELETE /identity/v3/users/2274c321faa343ce9296f64462c71d85 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:47:20.967933 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8097a5-4704-4725-9f08-3d7bb91cce14 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:47:20.969461 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-7a8097a5-4704-4725-9f08-3d7bb91cce14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:47:20.989368 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8097a5-4704-4725-9f08-3d7bb91cce14 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:47:21.048356 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bdd4c6-321e-45c3-b9e1-e099aa1c1abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:47:21.048916 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bdd4c6-321e-45c3-b9e1-e099aa1c1abc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:47:21.049200 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bdd4c6-321e-45c3-b9e1-e099aa1c1abc admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:47:21.049479 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bdd4c6-321e-45c3-b9e1-e099aa1c1abc admin admin] PATH_INFO: `/v3/projects/39831e9ec2cd41d980681d0dfeb619b3` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:47:21.051173 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bdd4c6-321e-45c3-b9e1-e099aa1c1abc admin admin] RBAC: Authorizing `identity:delete_project(project_id=39831e9ec2cd41d980681d0dfeb619b3)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:47:21.053581 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bdd4c6-321e-45c3-b9e1-e099aa1c1abc admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:47:21.105168 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-54bdd4c6-321e-45c3-b9e1-e099aa1c1abc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39831e9ec2cd41d980681d0dfeb619b3', 'request_id': 'req-54bdd4c6-321e-45c3-b9e1-e099aa1c1abc'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:47:21.113399 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-54bdd4c6-321e-45c3-b9e1-e099aa1c1abc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39831e9ec2cd41d980681d0dfeb619b3', 'request_id': 'req-54bdd4c6-321e-45c3-b9e1-e099aa1c1abc'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:47:21.120238 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-54bdd4c6-321e-45c3-b9e1-e099aa1c1abc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39831e9ec2cd41d980681d0dfeb619b3', 'request_id': 'req-54bdd4c6-321e-45c3-b9e1-e099aa1c1abc'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:47:21.131323 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-54bdd4c6-321e-45c3-b9e1-e099aa1c1abc admin admin] The token cache is being invalidate because project 39831e9ec2cd41d980681d0dfeb619b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:47:21.131612 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-54bdd4c6-321e-45c3-b9e1-e099aa1c1abc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:47:21.132264 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-54bdd4c6-321e-45c3-b9e1-e099aa1c1abc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:47:21.133813 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1460/2894] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:47:20 2022] DELETE /identity/v3/projects/39831e9ec2cd41d980681d0dfeb619b3 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:47:21.138698 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54dfc6-5763-4c7c-81ae-acf9ed893b1c None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:47:21.138990 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54dfc6-5763-4c7c-81ae-acf9ed893b1c None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:47:21.139301 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54dfc6-5763-4c7c-81ae-acf9ed893b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:47:21.160249 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-2d54dfc6-5763-4c7c-81ae-acf9ed893b1c None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:47:21.160823 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-2d54dfc6-5763-4c7c-81ae-acf9ed893b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:47:21.222519 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1435/2895] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:47:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:47:21.231646 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f868f-7229-4d7c-b8c9-97a5324d6bf8 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:47:21.231932 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f868f-7229-4d7c-b8c9-97a5324d6bf8 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:47:21.232211 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f868f-7229-4d7c-b8c9-97a5324d6bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:47:21.252322 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-0a6f868f-7229-4d7c-b8c9-97a5324d6bf8 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:47:21.254086 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-0a6f868f-7229-4d7c-b8c9-97a5324d6bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:47:21.261920 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1461/2896] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:47:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:47:21.266228 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d54dfc6-5763-4c7c-81ae-acf9ed893b1c None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:47:21.276343 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d54dfc6-5763-4c7c-81ae-acf9ed893b1c None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:47:21.280984 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb5935-94a2-4e26-b80a-e50ddc0c47a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:47:21.281603 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb5935-94a2-4e26-b80a-e50ddc0c47a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:47:21.281888 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb5935-94a2-4e26-b80a-e50ddc0c47a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:47:21.282167 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb5935-94a2-4e26-b80a-e50ddc0c47a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:47:21.282859 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cb5935-94a2-4e26-b80a-e50ddc0c47a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 15:47:21.283166 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cb5935-94a2-4e26-b80a-e50ddc0c47a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:47:21.284798 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cb5935-94a2-4e26-b80a-e50ddc0c47a6 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:47:21.297075 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1436/2897] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 2 15:47:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 15:47:21.302646 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f868f-7229-4d7c-b8c9-97a5324d6bf8 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:47:21.312318 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f868f-7229-4d7c-b8c9-97a5324d6bf8 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:47:21.320110 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d134dc-7d29-4a1d-bee0-d19d9bbb0485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:47:21.320748 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d134dc-7d29-4a1d-bee0-d19d9bbb0485 admin admin] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:47:21.321172 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d134dc-7d29-4a1d-bee0-d19d9bbb0485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:47:21.322385 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d134dc-7d29-4a1d-bee0-d19d9bbb0485 admin admin] PATH_INFO: `/v3/projects` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:47:21.323097 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d134dc-7d29-4a1d-bee0-d19d9bbb0485 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:47:21.325053 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d134dc-7d29-4a1d-bee0-d19d9bbb0485 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:47:21.353677 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1462/2898] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 2 15:47:21 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:47:21.357987 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb5935-94a2-4e26-b80a-e50ddc0c47a6 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:47:21.368856 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb5935-94a2-4e26-b80a-e50ddc0c47a6 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:47:21.420687 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:47:21.436077 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1eb861-9938-4a9a-a05e-775d10e2700a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:47:21.436706 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1eb861-9938-4a9a-a05e-775d10e2700a admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:47:21.437018 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1eb861-9938-4a9a-a05e-775d10e2700a admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:47:21.437295 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1eb861-9938-4a9a-a05e-775d10e2700a admin admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:47:21.437976 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1eb861-9938-4a9a-a05e-775d10e2700a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:47:21.439950 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1eb861-9938-4a9a-a05e-775d10e2700a admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:47:21.462648 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1437/2899] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 2 15:47:21 2022] POST /identity/v3/users => generated 286 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 15:47:21.466904 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d134dc-7d29-4a1d-bee0-d19d9bbb0485 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:47:21.478110 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d134dc-7d29-4a1d-bee0-d19d9bbb0485 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:47:21.483020 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd16d2-7c14-4983-bb80-603dacc35b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:47:21.483697 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd16d2-7c14-4983-bb80-603dacc35b91 admin admin] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:47:21.483981 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd16d2-7c14-4983-bb80-603dacc35b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:47:21.484258 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd16d2-7c14-4983-bb80-603dacc35b91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:47:21.484953 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd16d2-7c14-4983-bb80-603dacc35b91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:47:21.486578 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd16d2-7c14-4983-bb80-603dacc35b91 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:47:21.493115 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:47:21.498764 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1463/2900] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:47:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:47:21.502679 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1eb861-9938-4a9a-a05e-775d10e2700a admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:47:21.513780 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1eb861-9938-4a9a-a05e-775d10e2700a admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:47:21.518735 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536f7368-af57-46f8-a59d-cf52d333369a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:47:21.519426 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f7368-af57-46f8-a59d-cf52d333369a admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:47:21.519709 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f7368-af57-46f8-a59d-cf52d333369a admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:47:21.519986 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f7368-af57-46f8-a59d-cf52d333369a admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:47:21.520679 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536f7368-af57-46f8-a59d-cf52d333369a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:47:21.522317 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536f7368-af57-46f8-a59d-cf52d333369a admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:47:21.533536 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1438/2901] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 2 15:47:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 15:47:21.538531 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd16d2-7c14-4983-bb80-603dacc35b91 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:47:21.548799 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd16d2-7c14-4983-bb80-603dacc35b91 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:47:21.554398 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3dc914-78bf-4268-babd-102597e94f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:47:21.554995 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3dc914-78bf-4268-babd-102597e94f52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:47:21.555310 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3dc914-78bf-4268-babd-102597e94f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:47:21.555588 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3dc914-78bf-4268-babd-102597e94f52 admin admin] PATH_INFO: `/v3/projects/8e580eb57380411dbbdbb15ba604c7a9/users/80d243df95664140b485de1d3431185a/roles/bf4fcdd92d8a4a6d855f3eaa4f542529` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:47:21.570991 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3dc914-78bf-4268-babd-102597e94f52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e580eb57380411dbbdbb15ba604c7a9, user_id=80d243df95664140b485de1d3431185a, role_id=bf4fcdd92d8a4a6d855f3eaa4f542529)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:47:21.573715 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3dc914-78bf-4268-babd-102597e94f52 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:47:21.588018 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1464/2902] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 2 15:47:21 2022] PUT /identity/v3/projects/8e580eb57380411dbbdbb15ba604c7a9/users/80d243df95664140b485de1d3431185a/roles/bf4fcdd92d8a4a6d855f3eaa4f542529 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:47:21.599270 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591bf8d-21e0-4298-ae0e-7dc0e0cc188e None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:47:21.599564 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591bf8d-21e0-4298-ae0e-7dc0e0cc188e None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:47:21.599844 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591bf8d-21e0-4298-ae0e-7dc0e0cc188e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:47:21.628379 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-3591bf8d-21e0-4298-ae0e-7dc0e0cc188e None None] MFA Rules not processed for user `80d243df95664140b485de1d3431185a`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:47:21.629610 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-3591bf8d-21e0-4298-ae0e-7dc0e0cc188e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:47:21.694858 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1439/2903] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:47:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:47:21.706098 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3dc914-78bf-4268-babd-102597e94f52 admin admin] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:47:21.708293 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-1a3dc914-78bf-4268-babd-102597e94f52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:47:21.767389 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3dc914-78bf-4268-babd-102597e94f52 admin admin] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:47:21.771738 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f03d7-a3a0-429c-ac1e-64a4dab02370 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d09126f1821420bb4218b611c89402a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:47:21.772356 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f03d7-a3a0-429c-ac1e-64a4dab02370 service cinder] REQUEST_METHOD: `GET` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:47:21.772632 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f03d7-a3a0-429c-ac1e-64a4dab02370 service cinder] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:47:21.772906 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f03d7-a3a0-429c-ac1e-64a4dab02370 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:47:21.781706 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f03d7-a3a0-429c-ac1e-64a4dab02370 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:47:21.783142 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f03d7-a3a0-429c-ac1e-64a4dab02370 service cinder] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:47:21.793004 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1465/2904] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:47:21 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:47:21.819994 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3591bf8d-21e0-4298-ae0e-7dc0e0cc188e None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:47:21.884386 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3591bf8d-21e0-4298-ae0e-7dc0e0cc188e None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:47:21.889056 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4254f912-3932-4fc0-bd17-ef757074a533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:47:21.889708 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254f912-3932-4fc0-bd17-ef757074a533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:47:21.889992 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254f912-3932-4fc0-bd17-ef757074a533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:47:21.890270 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254f912-3932-4fc0-bd17-ef757074a533 admin admin] PATH_INFO: `/v3/users/80d243df95664140b485de1d3431185a` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:47:21.891531 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4254f912-3932-4fc0-bd17-ef757074a533 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80d243df95664140b485de1d3431185a)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:47:21.893455 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4254f912-3932-4fc0-bd17-ef757074a533 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:47:21.951690 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-4254f912-3932-4fc0-bd17-ef757074a533 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80d243df95664140b485de1d3431185a'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:47:21.959256 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-4254f912-3932-4fc0-bd17-ef757074a533 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80d243df95664140b485de1d3431185a'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:47:21.961240 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:47:21.975447 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-4254f912-3932-4fc0-bd17-ef757074a533 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80d243df95664140b485de1d3431185a'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:47:21.976205 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-4254f912-3932-4fc0-bd17-ef757074a533 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80d243df95664140b485de1d3431185a'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:47:21.976856 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-4254f912-3932-4fc0-bd17-ef757074a533 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80d243df95664140b485de1d3431185a'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:47:21.990128 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1440/2905] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 2 15:47:21 2022] DELETE /identity/v3/users/80d243df95664140b485de1d3431185a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:47:21.994647 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe5236-1ad6-4456-ae2a-059cec3b7962 None None] REQUEST_METHOD: `POST` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:47:21.994938 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe5236-1ad6-4456-ae2a-059cec3b7962 None None] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:47:21.995272 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe5236-1ad6-4456-ae2a-059cec3b7962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:47:22.014588 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.auth.core [None req-3ebe5236-1ad6-4456-ae2a-059cec3b7962 None None] MFA Rules not processed for user `f4dc4eb9d79745cba683d968af36705d`. Rule list: `[]` (Enabled: `True`). {{(pid=80359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 15:47:22.015926 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-3ebe5236-1ad6-4456-ae2a-059cec3b7962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:47:22.076102 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1466/2906] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 2 15:47:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 15:47:22.086454 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4254f912-3932-4fc0-bd17-ef757074a533 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:47:22.088593 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-4254f912-3932-4fc0-bd17-ef757074a533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:47:22.153305 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4254f912-3932-4fc0-bd17-ef757074a533 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:47:22.160032 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e47cf80-339e-4dfb-8a00-438a9a071bc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d1caa34f2b41bfbcc95fa58d85f004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:47:22.160680 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47cf80-339e-4dfb-8a00-438a9a071bc9 service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:47:22.160963 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47cf80-339e-4dfb-8a00-438a9a071bc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:47:22.161239 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47cf80-339e-4dfb-8a00-438a9a071bc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:47:22.170961 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e47cf80-339e-4dfb-8a00-438a9a071bc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:47:22.172442 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e47cf80-339e-4dfb-8a00-438a9a071bc9 service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:47:22.182832 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1441/2907] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:47:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 15:47:22.465422 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe5236-1ad6-4456-ae2a-059cec3b7962 None None] Authenticating user token {{(pid=80359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:47:22.467203 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.fernet_utils [None req-3ebe5236-1ad6-4456-ae2a-059cec3b7962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:47:22.482588 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe5236-1ad6-4456-ae2a-059cec3b7962 None None] Validating token access rules against request {{(pid=80359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:47:22.489553 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a209cb-a07c-4f3e-a328-b1f8a443b999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc4eb9d79745cba683d968af36705d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01cd4e1a6a040d99206efa57fc6e2e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:47:22.490319 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a209cb-a07c-4f3e-a328-b1f8a443b999 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:47:22.490629 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a209cb-a07c-4f3e-a328-b1f8a443b999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:47:22.491031 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a209cb-a07c-4f3e-a328-b1f8a443b999 admin admin] PATH_INFO: `/v3/projects/8e580eb57380411dbbdbb15ba604c7a9` {{(pid=80359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:47:22.492580 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a209cb-a07c-4f3e-a328-b1f8a443b999 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e580eb57380411dbbdbb15ba604c7a9)` {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:47:22.494890 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a209cb-a07c-4f3e-a328-b1f8a443b999 admin admin] RBAC: Authorization granted {{(pid=80359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:47:22.542312 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-d9a209cb-a07c-4f3e-a328-b1f8a443b999 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e580eb57380411dbbdbb15ba604c7a9', 'request_id': 'req-d9a209cb-a07c-4f3e-a328-b1f8a443b999'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:47:22.549455 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-d9a209cb-a07c-4f3e-a328-b1f8a443b999 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e580eb57380411dbbdbb15ba604c7a9', 'request_id': 'req-d9a209cb-a07c-4f3e-a328-b1f8a443b999'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:47:22.556684 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-d9a209cb-a07c-4f3e-a328-b1f8a443b999 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e580eb57380411dbbdbb15ba604c7a9', 'request_id': 'req-d9a209cb-a07c-4f3e-a328-b1f8a443b999'} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:47:22.567826 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-d9a209cb-a07c-4f3e-a328-b1f8a443b999 admin admin] The token cache is being invalidate because project 8e580eb57380411dbbdbb15ba604c7a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 15:47:22.568114 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-d9a209cb-a07c-4f3e-a328-b1f8a443b999 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:47:22.568770 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG keystone.notifications [None req-d9a209cb-a07c-4f3e-a328-b1f8a443b999 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 15:47:22.570271 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: [pid: 80359|app: 0|req: 1467/2908] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 2 15:47:22 2022] DELETE /identity/v3/projects/8e580eb57380411dbbdbb15ba604c7a9 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 15:47:32.178279 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=33,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:47:32.564039 dv-cinder-850318-7-iscsi devstack@keystone.service[80359]: DEBUG dbcounter [-] [80359] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 15:48:59.613997 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e47cf80-339e-4dfb-8a00-438a9a071bc9 service neutron] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 15:48:59.615395 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-1e47cf80-339e-4dfb-8a00-438a9a071bc9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:48:59.706277 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e47cf80-339e-4dfb-8a00-438a9a071bc9 service neutron] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 15:48:59.764478 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb9df65-cdfc-4f34-b4b2-1d5731517b53 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57dfafee636a45ca98fe0e8bb13dd754', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc19d22b4cd64dd1bc89ed78155d2732', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 15:48:59.765090 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9df65-cdfc-4f34-b4b2-1d5731517b53 service placement] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 15:48:59.765368 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9df65-cdfc-4f34-b4b2-1d5731517b53 service placement] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 15:48:59.765639 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9df65-cdfc-4f34-b4b2-1d5731517b53 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 15:48:59.767407 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-2cb9df65-cdfc-4f34-b4b2-1d5731517b53 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 15:48:59.779675 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb9df65-cdfc-4f34-b4b2-1d5731517b53 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 15:48:59.781255 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb9df65-cdfc-4f34-b4b2-1d5731517b53 service placement] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 15:48:59.791713 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1442/2909] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 2 15:48:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 15:49:09.786976 dv-cinder-850318-7-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=67 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}